Jul 30 16:43:30 devstack cinder-volume[77304]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 30 16:43:30 devstack cinder-volume[77304]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 30 16:43:30 devstack cinder-volume[77304]: we strongly recommend against using it for new projects. Jul 30 16:43:30 devstack cinder-volume[77304]: If you are already using Eventlet, we recommend migrating to a different Jul 30 16:43:30 devstack cinder-volume[77304]: framework. For more detail see Jul 30 16:43:30 devstack cinder-volume[77304]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 30 16:43:30 devstack cinder-volume[77304]: import eventlet # noqa Jul 30 16:43:33 devstack cinder-volume[77304]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=77304) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 30 16:43:33 devstack cinder-volume[77304]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=77304) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 30 16:43:33 devstack cinder-volume[77304]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=77304) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 30 16:43:34 devstack cinder-volume[77304]: INFO dbcounter [None req-2783c127-e856-4382-b88c-67c00853d59a None None] Registered counter for database cinder Jul 30 16:43:34 devstack cinder-volume[77304]: DEBUG oslo_db.sqlalchemy.engines [None req-2783c127-e856-4382-b88c-67c00853d59a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77304) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 30 16:43:34 devstack cinder-volume[77304]: DEBUG dbcounter [-] [77304] Writer thread running {{(pid=77304) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 30 16:43:34 devstack cinder-volume[77304]: INFO cinder.rpc [None req-2783c127-e856-4382-b88c-67c00853d59a None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 30 16:43:34 devstack cinder-volume[77304]: INFO cinder.rpc [None req-2783c127-e856-4382-b88c-67c00853d59a None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 30 16:43:34 devstack cinder-volume[77304]: DEBUG oslo_db.sqlalchemy.engines [None req-2783c127-e856-4382-b88c-67c00853d59a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77304) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 30 16:43:34 devstack cinder-volume[77304]: INFO cinder.volume.manager [None req-2783c127-e856-4382-b88c-67c00853d59a None None] Determined volume DB was empty at startup. Jul 30 16:43:34 devstack cinder-volume[77304]: DEBUG cinder.volume.manager [None req-2783c127-e856-4382-b88c-67c00853d59a None None] Cinder Volume DB check: vol_db_empty=True {{(pid=77304) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 30 16:43:34 devstack cinder-volume[77304]: INFO cinder.volume.manager [None req-2783c127-e856-4382-b88c-67c00853d59a None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 30 16:43:34 devstack cinder-volume[77304]: WARNING stevedore.named [None req-2783c127-e856-4382-b88c-67c00853d59a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 30 16:43:34 devstack cinder-volume[77304]: WARNING castellan.key_manager [None req-2783c127-e856-4382-b88c-67c00853d59a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 30 16:43:34 devstack cinder-volume[77304]: WARNING cinder.keymgr.conf_key_mgr [None req-2783c127-e856-4382-b88c-67c00853d59a None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 30 16:43:34 devstack cinder-volume[77304]: DEBUG cinder.volume.drivers.lvm [None req-2783c127-e856-4382-b88c-67c00853d59a None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=77304) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Jul 30 16:43:34 devstack cinder-volume[77304]: DEBUG oslo_concurrency.processutils [None req-2783c127-e856-4382-b88c-67c00853d59a None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=77304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_concurrency.processutils [None req-2783c127-e856-4382-b88c-67c00853d59a None None] CMD "cinder-rtstool verify" returned: 0 in 0.428s {{(pid=77304) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_db.sqlalchemy.engines [None req-2783c127-e856-4382-b88c-67c00853d59a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77304) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 30 16:43:35 devstack cinder-volume[77304]: INFO cinder.rpc [None req-2783c127-e856-4382-b88c-67c00853d59a None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 30 16:43:35 devstack cinder-volume[77304]: INFO cinder.rpc [None req-2783c127-e856-4382-b88c-67c00853d59a None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 30 16:43:35 devstack cinder-volume[77304]: WARNING stevedore.named [None req-2783c127-e856-4382-b88c-67c00853d59a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 30 16:43:35 devstack cinder-volume[77304]: WARNING castellan.key_manager [None req-2783c127-e856-4382-b88c-67c00853d59a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 30 16:43:35 devstack cinder-volume[77304]: INFO cinder.volume.manager [None req-2783c127-e856-4382-b88c-67c00853d59a None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_db.sqlalchemy.engines [None req-2783c127-e856-4382-b88c-67c00853d59a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77304) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 30 16:43:35 devstack cinder-volume[77304]: INFO oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] Starting 1 workers Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] Started child 77466 {{(pid=77304) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] Full set of CONF: {{(pid=77304) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] ******************************************************************************** {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] Configuration options gathered from: {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] ================================================================================ {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] allow_availability_zone_fallback = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] allow_compression_on_image_upload = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] allowed_direct_url_schemes = [] {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] api_rate_limit = True {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] auth_strategy = keystone {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] az_cache_duration = 3600 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] backend_availability_zone = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] backend_host = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] backend_name = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] backend_stats_polling_interval = 60 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] backup_api_class = cinder.backup.api.API {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77466]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] backup_name_template = backup-%s {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] backup_use_same_host = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] backup_use_temp_snapshot = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] chap_password = **** {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] chap_username = {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] cinder_internal_tenant_project_id = f0880ba56ad24852ab4c0ca52731b94c {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] cinder_internal_tenant_user_id = 321331f796e043ebbd77229341086ec8 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] cloned_volume_same_az = True {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] cluster = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] compression_format = gzip {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] compute_api_class = cinder.compute.nova.API {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] config_dir = [] {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] config_source = [] {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] control_exchange = openstack {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] debug = True {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] default_availability_zone = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] default_group_type = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] default_volume_type = lvmdriver-1 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] disk_geometry = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] driver_client_cert = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] driver_client_cert_key = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] driver_data_namespace = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] driver_ssl_cert_path = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] driver_ssl_cert_verify = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] driver_use_ssl = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] enable_force_upload = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] enable_new_services = True {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] enable_unsupported_driver = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] enabled_backends = ['lvmdriver-1'] {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] enforce_multipath_for_image_xfer = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] filter_function = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] glance_api_insecure = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] glance_api_servers = ['http://192.168.122.209/image'] {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] glance_api_ssl_compression = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] glance_ca_certificates_file = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] glance_catalog_info = image:glance:publicURL {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] glance_certfile = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] glance_keyfile = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] glance_num_retries = 3 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] glance_request_timeout = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] goodness_function = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] graceful_shutdown_timeout = 5 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] group_api_class = cinder.group.api.API {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] host = devstack {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] image_compress_on_upload = True {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] image_conversion_address_space_limit = 1 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] image_conversion_cpu_limit = 60 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] image_conversion_disable = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] image_upload_use_cinder_backend = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] image_upload_use_internal_tenant = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] image_volume_cache_enabled = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] image_volume_cache_max_count = 0 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] image_volume_cache_max_size_gb = 0 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] init_host_max_objects_retrieval = 0 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] instance_format = [instance: %(uuid)s] {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] iscsi_target_flags = {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] iscsi_write_cache = on {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] iser_helper = tgtadm {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] iser_ip_address = 192.168.122.209 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] iser_port = 3260 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] log_color = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] log_config_append = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] log_dir = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] log_file = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] log_options = True {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] log_rotate_interval = 1 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] log_rotate_interval_type = days {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] log_rotation_type = none {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] max_age = 0 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] max_logfile_count = 30 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] max_logfile_size_mb = 200 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] max_over_subscription_ratio = 20.0 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] message_reap_interval = 86400 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] message_ttl = 2592000 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] migration_create_volume_timeout_secs = 300 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] monkey_patch = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] monkey_patch_modules = [] {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] my_ip = 192.168.122.209 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] no_snapshot_gb_quota = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] num_iser_scan_tries = 3 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] num_shell_tries = 3 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] num_volume_device_scan_tries = 3 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] nvmeof_conn_info_version = 1 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] nvmet_ns_id = 10 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] nvmet_port_id = 1 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] osapi_max_limit = 1000 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] osapi_volume_ext_list = [] {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] osapi_volume_listen = 0.0.0.0 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] osapi_volume_listen_port = 8776 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] osapi_volume_use_ssl = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] osapi_volume_workers = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] per_volume_size_limit = -1 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] periodic_fuzzy_delay = 60 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] periodic_interval = 60 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] project_id_regex = [0-9a-f\-]+ {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] public_endpoint = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] publish_errors = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] quota_backup_gigabytes = 1000 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] quota_backups = 10 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] quota_gigabytes = 1000 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] quota_groups = 10 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] quota_snapshots = 10 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] quota_volumes = 10 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] rate_limit_burst = 0 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] rate_limit_except_level = CRITICAL {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] rate_limit_interval = 0 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] reinit_driver_count = 3 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] replication_device = **** {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] report_discard_supported = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] report_interval = 120 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] reservation_clean_interval = 86400 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] reservation_expire = 86400 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] reserved_image_namespaces = [] {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] reserved_percentage = 0 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] rpc_response_timeout = 120 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] run_external_periodic_tasks = True {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] scst_target_driver = iscsi {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] scst_target_iqn_name = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] service_down_time = 720 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] shell_completion = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] snapshot_name_template = snapshot-%s {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] snapshot_same_host = True {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] split_loggers = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] state_path = /opt/stack/data/cinder {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] storage_availability_zone = nova {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] storage_protocol = iSCSI {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] syslog_log_facility = LOG_USER {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] target_helper = lioadm {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] target_ip_address = 192.168.122.209 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77466]: INFO cinder.volume.manager [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] target_port = 3260 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] target_protocol = iscsi {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] target_secondary_ip_addresses = [] {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] trace_flags = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] transfer_api_class = cinder.transfer.api.API {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] transport_url = **** {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] until_refresh = 0 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] use_chap_auth = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] use_default_quota_class = True {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] use_journal = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] use_json = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] use_multipath_for_image_xfer = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] use_stderr = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] use_syslog = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] verify_glance_signatures = enabled {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] volume_api_class = cinder.volume.api.API {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] volume_backend_name = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] volume_clear = zero {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] volume_clear_ionice = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] volume_clear_size = 0 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] volume_copy_bps_limit = 0 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] volume_dd_blocksize = 1M {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] volume_name_template = volume-%s {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] volume_service_inithost_offload = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] volume_usage_audit_period = month {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] zoning_mode = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] oslo_concurrency.disable_process_locking = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] os_brick.lightos_discovery_client_address = localhost {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] os_brick.wait_mpath_device_interval = 1 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] keystone_authtoken.auth_section = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] keystone_authtoken.auth_type = password {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] keystone_authtoken.auth_version = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] keystone_authtoken.cache = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] keystone_authtoken.certfile = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] keystone_authtoken.delay_auth_decision = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] keystone_authtoken.http_connect_timeout = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] keystone_authtoken.include_service_catalog = True {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] keystone_authtoken.insecure = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] keystone_authtoken.interface = public {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] keystone_authtoken.keyfile = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] keystone_authtoken.memcache_password = {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] keystone_authtoken.memcache_secret_key = **** {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] keystone_authtoken.memcache_security_strategy = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] keystone_authtoken.memcache_username = {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] keystone_authtoken.region_name = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] keystone_authtoken.service_token_roles_required = True {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] keystone_authtoken.service_type = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] keystone_authtoken.token_cache_time = 300 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.209/identity {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] cache.backend = dogpile.cache.null {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] cache.backend_argument = **** {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] cache.backend_expiration_time = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.039s {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] cache.config_prefix = cache.oslo {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] cache.debug_cache_backend = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] cache.enable_retry_client = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] cache.enable_socket_keepalive = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] cache.enabled = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] cache.expiration_time = 600 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] cache.hashclient_dead_timeout = 60.0 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] cache.hashclient_retry_attempts = 2 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] cache.hashclient_retry_timeout = 1.0 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] cache.memcache_dead_retry = 300 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] cache.memcache_pool_maxsize = 10 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] cache.memcache_sasl_enabled = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] cache.memcache_servers = ['localhost:11211'] {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] cache.password = **** {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] cache.proxies = [] {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] cache.redis_db = 0 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] cache.redis_sentinel_service_name = mymaster {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] cache.redis_server = localhost:6379 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] cache.retry_attempts = 2 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] cache.retry_delay = 0.0 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] cache.socket_keepalive_count = 1 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] cache.socket_keepalive_idle = 1 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] cache.socket_keepalive_interval = 1 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] cache.socket_timeout = 1.0 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] cache.tls_allowed_ciphers = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] cache.tls_cafile = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] cache.tls_certfile = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] cache.tls_enabled = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] cache.tls_keyfile = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] cache.username = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] coordination.backend_url = **** {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] database.asyncio_connection = **** {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] database.asyncio_slave_connection = **** {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] database.backend = sqlalchemy {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] database.connection = **** {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] database.connection_debug = 0 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] database.connection_parameters = {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] database.connection_recycle_time = 3600 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] database.connection_trace = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] database.db_inc_retry_interval = True {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] database.db_max_retries = 20 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] database.db_max_retry_interval = 10 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] database.db_retry_interval = 1 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] database.max_overflow = 50 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] database.max_pool_size = 5 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] database.max_retries = 10 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] database.mysql_sql_mode = TRADITIONAL {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] database.mysql_wsrep_sync_wait = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] database.pool_timeout = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] database.retry_interval = 10 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] database.slave_connection = **** {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] database.sqlite_synchronous = True {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] database.synchronous_reader = True {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] database.use_db_reconnect = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] oslo_messaging_metrics.metrics_process_name = {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] profiler.connection_string = messaging:// {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] profiler.enabled = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] profiler.es_doc_type = notification {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] profiler.es_scroll_size = 10000 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] profiler.es_scroll_time = 2m {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] profiler.filter_error_trace = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] profiler.hmac_keys = **** {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] profiler.sentinel_service_name = mymaster {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] profiler.socket_timeout = 0.1 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] profiler.trace_requests = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] profiler.trace_sqlalchemy = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] profiler_jaeger.process_tags = {} {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] profiler_jaeger.service_name_prefix = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] profiler_otlp.service_name_prefix = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:35 devstack sudo[77470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] oslo_policy.enforce_new_defaults = True {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] oslo_policy.policy_default_rule = default {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] oslo_policy.policy_file = policy.yaml {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack sudo[77470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] oslo_policy.remote_timeout = 60.0 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] privsep_osbrick.capabilities = [21, 2] {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] privsep_osbrick.group = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] privsep_osbrick.helper_command = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] privsep_osbrick.log_daemon_traceback = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] privsep_osbrick.thread_pool_size = 4 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] privsep_osbrick.user = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] cinder_sys_admin.group = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] cinder_sys_admin.helper_command = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] cinder_sys_admin.user = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] service_user.auth_section = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] service_user.auth_type = password {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] service_user.cafile = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] service_user.certfile = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] service_user.collect_timing = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] service_user.insecure = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] service_user.keyfile = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] service_user.send_service_user_token = True {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] service_user.split_loggers = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] service_user.timeout = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] glance.auth_section = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] glance.auth_type = password {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] glance.certfile = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] glance.collect_timing = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] glance.insecure = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] glance.keyfile = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] glance.region_name = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] glance.split_loggers = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] glance.timeout = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] backend_defaults.backend_availability_zone = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] backend_defaults.chap_password = **** {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] backend_defaults.chap_username = {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] backend_defaults.disk_geometry = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] backend_defaults.driver_client_cert = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] backend_defaults.driver_client_cert_key = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] backend_defaults.driver_data_namespace = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] backend_defaults.driver_ssl_cert_path = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] backend_defaults.driver_use_ssl = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] backend_defaults.enable_unsupported_driver = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] backend_defaults.extra_capabilities = {} {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] backend_defaults.filter_function = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] backend_defaults.goodness_function = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] backend_defaults.image_volume_cache_enabled = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] backend_defaults.iscsi_target_flags = {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] backend_defaults.iscsi_write_cache = on {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] backend_defaults.iser_helper = tgtadm {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] backend_defaults.iser_ip_address = 192.168.122.209 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] backend_defaults.iser_port = 3260 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] backend_defaults.lvm_mirrors = 0 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] backend_defaults.lvm_share_target = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] backend_defaults.lvm_type = auto {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] backend_defaults.num_shell_tries = 3 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] backend_defaults.nvmet_ns_id = 10 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] backend_defaults.nvmet_port_id = 1 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] backend_defaults.replication_device = **** {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] backend_defaults.report_discard_supported = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] backend_defaults.reserved_percentage = 0 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] backend_defaults.scst_target_driver = iscsi {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] backend_defaults.scst_target_iqn_name = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] backend_defaults.storage_protocol = iSCSI {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] backend_defaults.target_helper = tgtadm {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] backend_defaults.target_ip_address = 192.168.122.209 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] backend_defaults.target_port = 3260 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] backend_defaults.target_protocol = iscsi {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] backend_defaults.trace_flags = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] backend_defaults.unique_fqdn_network = True {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] backend_defaults.use_chap_auth = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] backend_defaults.volume_backend_name = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] backend_defaults.volume_clear = zero {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] backend_defaults.volume_clear_ionice = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] backend_defaults.volume_clear_size = 0 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] backend_defaults.volume_group = cinder-volumes {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] oslo_reports.file_event_handler = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] oslo_reports.log_dir = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] lvmdriver-1.backend_availability_zone = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] lvmdriver-1.backend_host = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] lvmdriver-1.chap_password = **** {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] lvmdriver-1.chap_username = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] lvmdriver-1.chiscsi_conf = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] lvmdriver-1.disk_geometry = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] lvmdriver-1.driver_client_cert = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] lvmdriver-1.driver_client_cert_key = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] lvmdriver-1.driver_data_namespace = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] lvmdriver-1.driver_use_ssl = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] lvmdriver-1.extra_capabilities = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] lvmdriver-1.filter_function = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] lvmdriver-1.goodness_function = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] lvmdriver-1.iscsi_target_flags = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] lvmdriver-1.iscsi_write_cache = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] lvmdriver-1.iser_helper = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] lvmdriver-1.iser_ip_address = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] lvmdriver-1.iser_port = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] lvmdriver-1.iser_target_prefix = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] lvmdriver-1.lvm_conf_file = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] lvmdriver-1.lvm_mirrors = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] lvmdriver-1.lvm_share_target = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] lvmdriver-1.lvm_type = auto {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] lvmdriver-1.num_shell_tries = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] lvmdriver-1.nvmet_ns_id = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] lvmdriver-1.nvmet_port_id = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] lvmdriver-1.replication_device = **** {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] lvmdriver-1.report_discard_supported = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] lvmdriver-1.reserved_percentage = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] lvmdriver-1.scst_target_driver = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] lvmdriver-1.storage_protocol = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] lvmdriver-1.target_helper = lioadm {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] lvmdriver-1.target_ip_address = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] lvmdriver-1.target_port = 3260 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] lvmdriver-1.target_protocol = iscsi {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] lvmdriver-1.trace_flags = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] lvmdriver-1.unique_fqdn_network = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] lvmdriver-1.use_chap_auth = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] lvmdriver-1.volume_clear = zero {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] lvmdriver-1.volume_clear_ionice = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] lvmdriver-1.volume_clear_size = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] lvmdriver-1.volumes_dir = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] oslo_messaging_rabbit.hostname = devstack {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] oslo_messaging_rabbit.ssl = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] oslo_messaging_rabbit.ssl_version = {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] oslo_messaging_notifications.driver = [] {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] oslo_messaging_notifications.retry = -1 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] oslo_messaging_notifications.transport_url = **** {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] key_manager.fixed_key = **** {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] barbican.barbican_api_version = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] barbican.barbican_endpoint = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] barbican.barbican_endpoint_type = public {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] barbican.barbican_region_name = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] barbican.cafile = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] barbican.certfile = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] barbican.collect_timing = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] barbican.insecure = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] barbican.keyfile = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] barbican.number_of_retries = 60 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] barbican.retry_delay = 1 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] barbican.send_service_user_token = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] barbican.split_loggers = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] barbican.timeout = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] barbican.verify_ssl = True {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] barbican.verify_ssl_path = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] barbican_service_user.auth_section = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] barbican_service_user.auth_type = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] barbican_service_user.cafile = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] barbican_service_user.certfile = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] barbican_service_user.collect_timing = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] barbican_service_user.insecure = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] barbican_service_user.keyfile = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] barbican_service_user.split_loggers = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] barbican_service_user.timeout = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] vault.approle_role_id = **** {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] vault.approle_secret_id = **** {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] vault.auth_method = approle {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] vault.auth_path = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] vault.kv_mountpoint = secret {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] vault.kv_path = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] vault.kv_version = 2 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] vault.namespace = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] vault.root_token_id = **** {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] vault.ssl_ca_crt_file = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] vault.timeout = 60.0 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] vault.token_file = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] vault.token_role = None {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] vault.use_ssl = False {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:43:35 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] ******************************************************************************** {{(pid=77304) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 30 16:43:35 devstack sudo[77470]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:35 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.361s {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:35 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:35 devstack sudo[77473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 30 16:43:35 devstack sudo[77473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:36 devstack sudo[77473]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:36 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.311s {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:36 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 16:43:36 devstack cinder-volume[77466]: INFO cinder.brick.local_dev.lvm [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 30 16:43:36 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:36 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:36 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:36 devstack sudo[77478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 30 16:43:36 devstack sudo[77478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:36 devstack sudo[77478]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:36 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:36 devstack cinder-volume[77466]: DEBUG cinder.brick.local_dev.lvm [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=77466) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Jul 30 16:43:36 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:36 devstack sudo[77485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 30 16:43:36 devstack sudo[77485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:37 devstack sudo[77485]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:37 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.645s {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:37 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:37 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:37 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:37 devstack sudo[77687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 30 16:43:37 devstack sudo[77687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:37 devstack sudo[77687]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:37 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.337s {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:37 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:37 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:37 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:37 devstack sudo[77795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 30 16:43:37 devstack sudo[77795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:37 devstack sudo[77795]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:37 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.269s {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:37 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:37 devstack sudo[77864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 30 16:43:37 devstack sudo[77864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:38 devstack sudo[77864]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:38 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.290s {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:38 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:38 devstack sudo[77974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 30 16:43:38 devstack sudo[77974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:38 devstack sudo[77974]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:38 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.346s {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:38 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:38 devstack sudo[78091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 30 16:43:38 devstack sudo[78091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:38 devstack sudo[78091]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:38 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.310s {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:38 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:38 devstack sudo[78094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 30 16:43:38 devstack sudo[78094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:39 devstack sudo[78094]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:39 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.323s {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:39 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:39 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:39 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:39 devstack sudo[78178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 30 16:43:39 devstack sudo[78178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:39 devstack sudo[78178]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:39 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.243s {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:39 devstack cinder-volume[77466]: INFO cinder.volume.drivers.lvm [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 30 16:43:39 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:39 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:39 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:39 devstack sudo[78182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 30 16:43:39 devstack sudo[78182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:39 devstack sudo[78182]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:39 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.335s {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:39 devstack cinder-volume[77466]: DEBUG cinder.volume.drivers.lvm [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] Updating volume stats {{(pid=77466) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 30 16:43:39 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:39 devstack sudo[78259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 30 16:43:39 devstack sudo[78259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:40 devstack sudo[78259]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:40 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.308s {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:40 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:40 devstack sudo[78274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 30 16:43:40 devstack sudo[78274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:40 devstack sudo[78274]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:40 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.313s {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:40 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:40 devstack sudo[78283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 30 16:43:40 devstack sudo[78283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:40 devstack sudo[78283]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:40 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.300s {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:40 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:40 devstack sudo[78286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 30 16:43:40 devstack sudo[78286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:41 devstack sudo[78286]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:41 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.306s {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:41 devstack cinder-volume[77466]: INFO cinder.volume.driver [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] Driver hasn't implemented _init_vendor_properties() Jul 30 16:43:41 devstack cinder-volume[77466]: DEBUG cinder.volume.driver [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=77466) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 30 16:43:41 devstack cinder-volume[77466]: DEBUG oslo_db.sqlalchemy.engines [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77466) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 30 16:43:41 devstack cinder-volume[77466]: DEBUG dbcounter [-] [77466] Writer thread running {{(pid=77466) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 30 16:43:41 devstack cinder-volume[77466]: DEBUG cinder.db.api [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] Building query based on filter {{(pid=77466) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 30 16:43:41 devstack cinder-volume[77466]: DEBUG cinder.image.image_utils [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=77466) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 30 16:43:41 devstack cinder-volume[77466]: INFO cinder.keymgr.migration [None req-833bac50-a2aa-47ed-af73-e710b435fd33 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 30 16:43:41 devstack cinder-volume[77466]: DEBUG cinder.volume.drivers.lvm [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] Updating volume stats {{(pid=77466) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 30 16:43:41 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:41 devstack sudo[78290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 30 16:43:41 devstack sudo[78290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:41 devstack sudo[78290]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:41 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:41 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:41 devstack sudo[78293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 30 16:43:41 devstack sudo[78293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:41 devstack sudo[78293]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:41 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.345s {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:41 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:41 devstack sudo[78296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 30 16:43:41 devstack sudo[78296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:42 devstack sudo[78296]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:42 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.274s {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:42 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:42 devstack sudo[78301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 30 16:43:42 devstack sudo[78301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:42 devstack sudo[78301]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:42 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:42 devstack cinder-volume[77466]: DEBUG cinder.manager [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] Notifying Schedulers of capabilities ... {{(pid=77466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:43:42 devstack cinder-volume[77466]: INFO cinder.volume.manager [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] Driver initialization completed successfully. Jul 30 16:43:42 devstack cinder-volume[77466]: INFO cinder.manager [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] Initiating service 2 cleanup Jul 30 16:43:42 devstack cinder-volume[77466]: INFO cinder.manager [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] Service 2 cleanup completed. Jul 30 16:43:42 devstack cinder-volume[77466]: DEBUG cinder.service [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] Creating RPC server for service cinder-volume {{(pid=77466) start /opt/stack/cinder/cinder/service.py:231}} Jul 30 16:43:42 devstack cinder-volume[77466]: DEBUG cinder.service [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=77466) start /opt/stack/cinder/cinder/service.py:237}} Jul 30 16:43:42 devstack cinder-volume[77466]: INFO cinder.volume.manager [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 30 16:43:42 devstack cinder-volume[77466]: DEBUG cinder.volume.drivers.lvm [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] Updating volume stats {{(pid=77466) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 30 16:43:42 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:42 devstack sudo[78305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 30 16:43:42 devstack sudo[78305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:42 devstack sudo[78305]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:42 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:42 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:42 devstack sudo[78309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 30 16:43:42 devstack sudo[78309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:43 devstack sudo[78309]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:43 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.287s {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:43 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:43 devstack sudo[78313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 30 16:43:43 devstack sudo[78313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:43 devstack sudo[78313]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:43 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.299s {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:43 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:43 devstack sudo[78316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 30 16:43:43 devstack sudo[78316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:43 devstack sudo[78316]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:43 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:43 devstack cinder-volume[77466]: INFO cinder.volume.manager [None req-da00d157-e230-4a60-b140-7fb2663adc9e None None] Driver post RPC initialization completed successfully. Jul 30 16:43:45 devstack cinder-volume[77304]: DEBUG dbcounter [-] [77304] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=77304) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:43:47 devstack cinder-volume[77466]: DEBUG oslo_service.periodic_task [None req-7f93fc1e-ac9a-4135-ac0c-827c806240cf None None] Running periodic task VolumeManager._thread_info {{(pid=77466) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:43:47 devstack cinder-volume[77466]: DEBUG cinder.volume.manager [None req-7f93fc1e-ac9a-4135-ac0c-827c806240cf None None] thread count: 6 {{(pid=77466) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:43:47 devstack cinder-volume[77466]: DEBUG cinder.volume.manager [None req-7f93fc1e-ac9a-4135-ac0c-827c806240cf None None] thread info: [<_MainThread(MainThread, started 135159723430016)>, , , , , ] {{(pid=77466) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:43:53 devstack cinder-volume[77466]: DEBUG dbcounter [-] [77466] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=77466) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:43:53 devstack cinder-volume[77466]: DEBUG dbcounter [-] [77466] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=77466) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:44:47 devstack cinder-volume[77466]: DEBUG oslo_service.periodic_task [None req-7f93fc1e-ac9a-4135-ac0c-827c806240cf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77466) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:44:47 devstack cinder-volume[77466]: DEBUG cinder.volume.drivers.lvm [None req-7f93fc1e-ac9a-4135-ac0c-827c806240cf None None] Updating volume stats {{(pid=77466) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 30 16:44:47 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-7f93fc1e-ac9a-4135-ac0c-827c806240cf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:47 devstack sudo[80350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 30 16:44:47 devstack sudo[80350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:47 devstack sudo[80350]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:47 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-7f93fc1e-ac9a-4135-ac0c-827c806240cf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:47 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-7f93fc1e-ac9a-4135-ac0c-827c806240cf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:47 devstack sudo[80353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 30 16:44:47 devstack sudo[80353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:48 devstack sudo[80353]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:48 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-7f93fc1e-ac9a-4135-ac0c-827c806240cf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.290s {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:48 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-7f93fc1e-ac9a-4135-ac0c-827c806240cf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:48 devstack sudo[80356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 30 16:44:48 devstack sudo[80356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:48 devstack sudo[80356]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:48 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-7f93fc1e-ac9a-4135-ac0c-827c806240cf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.265s {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:48 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-7f93fc1e-ac9a-4135-ac0c-827c806240cf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:48 devstack sudo[80359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 30 16:44:48 devstack sudo[80359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:48 devstack sudo[80359]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:48 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-7f93fc1e-ac9a-4135-ac0c-827c806240cf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:48 devstack cinder-volume[77466]: DEBUG cinder.manager [None req-7f93fc1e-ac9a-4135-ac0c-827c806240cf None None] Notifying Schedulers of capabilities ... {{(pid=77466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:44:48 devstack cinder-volume[77466]: DEBUG oslo_service.periodic_task [None req-7f93fc1e-ac9a-4135-ac0c-827c806240cf None None] Running periodic task VolumeManager._thread_info {{(pid=77466) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:44:48 devstack cinder-volume[77466]: DEBUG cinder.volume.manager [None req-7f93fc1e-ac9a-4135-ac0c-827c806240cf None None] thread count: 6 {{(pid=77466) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:44:48 devstack cinder-volume[77466]: DEBUG cinder.volume.manager [None req-7f93fc1e-ac9a-4135-ac0c-827c806240cf None None] thread info: [<_MainThread(MainThread, started 135159723430016)>, , , , , ] {{(pid=77466) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:45:47 devstack cinder-volume[77466]: DEBUG oslo_service.periodic_task [None req-7f93fc1e-ac9a-4135-ac0c-827c806240cf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77466) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:45:47 devstack cinder-volume[77466]: DEBUG cinder.volume.drivers.lvm [None req-7f93fc1e-ac9a-4135-ac0c-827c806240cf None None] Updating volume stats {{(pid=77466) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 30 16:45:47 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-7f93fc1e-ac9a-4135-ac0c-827c806240cf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:47 devstack sudo[83643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 30 16:45:47 devstack sudo[83643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:48 devstack sudo[83643]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:48 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-7f93fc1e-ac9a-4135-ac0c-827c806240cf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.292s {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:48 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-7f93fc1e-ac9a-4135-ac0c-827c806240cf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:48 devstack sudo[83651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 30 16:45:48 devstack sudo[83651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:48 devstack sudo[83651]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:48 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-7f93fc1e-ac9a-4135-ac0c-827c806240cf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:48 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-7f93fc1e-ac9a-4135-ac0c-827c806240cf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:48 devstack sudo[83654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 30 16:45:48 devstack sudo[83654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:48 devstack sudo[83654]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:48 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-7f93fc1e-ac9a-4135-ac0c-827c806240cf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.279s {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:48 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-7f93fc1e-ac9a-4135-ac0c-827c806240cf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:48 devstack sudo[83697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 30 16:45:48 devstack sudo[83697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:48 devstack sudo[83697]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:48 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-7f93fc1e-ac9a-4135-ac0c-827c806240cf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:48 devstack cinder-volume[77466]: DEBUG cinder.manager [None req-7f93fc1e-ac9a-4135-ac0c-827c806240cf None None] Notifying Schedulers of capabilities ... {{(pid=77466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:45:53 devstack cinder-volume[77466]: DEBUG dbcounter [-] [77466] Writing DB stats cinder:SELECT=1 {{(pid=77466) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:45:53 devstack cinder-volume[77466]: DEBUG dbcounter [-] [77466] Writing DB stats cinder:UPDATE=1 {{(pid=77466) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:46:47 devstack cinder-volume[77466]: DEBUG oslo_service.periodic_task [None req-7f93fc1e-ac9a-4135-ac0c-827c806240cf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77466) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:46:47 devstack cinder-volume[77466]: DEBUG cinder.volume.drivers.lvm [None req-7f93fc1e-ac9a-4135-ac0c-827c806240cf None None] Updating volume stats {{(pid=77466) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 30 16:46:47 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-7f93fc1e-ac9a-4135-ac0c-827c806240cf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:47 devstack sudo[85613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 30 16:46:47 devstack sudo[85613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:47 devstack sudo[85613]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:47 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-7f93fc1e-ac9a-4135-ac0c-827c806240cf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:47 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-7f93fc1e-ac9a-4135-ac0c-827c806240cf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:48 devstack sudo[85625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 30 16:46:48 devstack sudo[85625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:48 devstack sudo[85625]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:48 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-7f93fc1e-ac9a-4135-ac0c-827c806240cf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:48 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-7f93fc1e-ac9a-4135-ac0c-827c806240cf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:48 devstack sudo[85635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 30 16:46:48 devstack sudo[85635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:48 devstack sudo[85635]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:48 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-7f93fc1e-ac9a-4135-ac0c-827c806240cf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.284s {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:48 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-7f93fc1e-ac9a-4135-ac0c-827c806240cf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:48 devstack sudo[85651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 30 16:46:48 devstack sudo[85651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:48 devstack sudo[85651]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:48 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-7f93fc1e-ac9a-4135-ac0c-827c806240cf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.372s {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:48 devstack cinder-volume[77466]: DEBUG cinder.manager [None req-7f93fc1e-ac9a-4135-ac0c-827c806240cf None None] Notifying Schedulers of capabilities ... {{(pid=77466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:46:48 devstack cinder-volume[77466]: DEBUG oslo_service.periodic_task [None req-7f93fc1e-ac9a-4135-ac0c-827c806240cf None None] Running periodic task VolumeManager._thread_info {{(pid=77466) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:46:48 devstack cinder-volume[77466]: DEBUG cinder.volume.manager [None req-7f93fc1e-ac9a-4135-ac0c-827c806240cf None None] thread count: 6 {{(pid=77466) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:46:48 devstack cinder-volume[77466]: DEBUG cinder.volume.manager [None req-7f93fc1e-ac9a-4135-ac0c-827c806240cf None None] thread info: [<_MainThread(MainThread, started 135159723430016)>, , , , , ] {{(pid=77466) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:47:47 devstack cinder-volume[77466]: DEBUG oslo_service.periodic_task [None req-7f93fc1e-ac9a-4135-ac0c-827c806240cf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77466) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:47:47 devstack cinder-volume[77466]: DEBUG cinder.volume.drivers.lvm [None req-7f93fc1e-ac9a-4135-ac0c-827c806240cf None None] Updating volume stats {{(pid=77466) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 30 16:47:47 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-7f93fc1e-ac9a-4135-ac0c-827c806240cf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:47 devstack sudo[86766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 30 16:47:47 devstack sudo[86766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:47 devstack sudo[86766]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:47 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-7f93fc1e-ac9a-4135-ac0c-827c806240cf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:47 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-7f93fc1e-ac9a-4135-ac0c-827c806240cf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:48 devstack sudo[86770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 30 16:47:48 devstack sudo[86770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:48 devstack sudo[86770]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:48 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-7f93fc1e-ac9a-4135-ac0c-827c806240cf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.296s {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:48 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-7f93fc1e-ac9a-4135-ac0c-827c806240cf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:48 devstack sudo[86773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 30 16:47:48 devstack sudo[86773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:48 devstack sudo[86773]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:48 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-7f93fc1e-ac9a-4135-ac0c-827c806240cf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.290s {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:48 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-7f93fc1e-ac9a-4135-ac0c-827c806240cf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:48 devstack sudo[86787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 30 16:47:48 devstack sudo[86787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:48 devstack sudo[86787]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:48 devstack cinder-volume[77466]: DEBUG oslo_concurrency.processutils [None req-7f93fc1e-ac9a-4135-ac0c-827c806240cf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=77466) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:48 devstack cinder-volume[77466]: DEBUG cinder.manager [None req-7f93fc1e-ac9a-4135-ac0c-827c806240cf None None] Notifying Schedulers of capabilities ... {{(pid=77466) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:47:48 devstack cinder-volume[77466]: DEBUG oslo_service.periodic_task [None req-7f93fc1e-ac9a-4135-ac0c-827c806240cf None None] Running periodic task VolumeManager._thread_info {{(pid=77466) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:47:48 devstack cinder-volume[77466]: DEBUG cinder.volume.manager [None req-7f93fc1e-ac9a-4135-ac0c-827c806240cf None None] thread count: 6 {{(pid=77466) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:47:48 devstack cinder-volume[77466]: DEBUG cinder.volume.manager [None req-7f93fc1e-ac9a-4135-ac0c-827c806240cf None None] thread info: [<_MainThread(MainThread, started 135159723430016)>, , , , , ] {{(pid=77466) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:47:53 devstack cinder-volume[77466]: DEBUG dbcounter [-] [77466] Writing DB stats cinder:SELECT=1 {{(pid=77466) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:47:53 devstack cinder-volume[77466]: DEBUG dbcounter [-] [77466] Writing DB stats cinder:UPDATE=1 {{(pid=77466) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:48:23 devstack cinder-volume[77304]: INFO oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] Caught SIGTERM, stopping children Jul 30 16:48:23 devstack cinder-volume[77304]: DEBUG oslo_concurrency.lockutils [None req-2783c127-e856-4382-b88c-67c00853d59a None None] Acquiring lock "singleton_lock" {{(pid=77304) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 30 16:48:23 devstack cinder-volume[77304]: DEBUG oslo_concurrency.lockutils [None req-2783c127-e856-4382-b88c-67c00853d59a None None] Acquired lock "singleton_lock" {{(pid=77304) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 30 16:48:23 devstack cinder-volume[77304]: DEBUG oslo_concurrency.lockutils [None req-2783c127-e856-4382-b88c-67c00853d59a None None] Releasing lock "singleton_lock" {{(pid=77304) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 30 16:48:23 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] Stop services. {{(pid=77304) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 30 16:48:23 devstack cinder-volume[77304]: DEBUG oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] Killing children. {{(pid=77304) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 30 16:48:23 devstack cinder-volume[77304]: INFO oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] Waiting on 1 children to exit Jul 30 16:48:27 devstack cinder-volume[77466]: DEBUG oslo_concurrency.lockutils [None req-2783c127-e856-4382-b88c-67c00853d59a None None] Acquiring lock "singleton_lock" {{(pid=77466) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 30 16:48:27 devstack cinder-volume[77466]: DEBUG oslo_concurrency.lockutils [None req-2783c127-e856-4382-b88c-67c00853d59a None None] Acquired lock "singleton_lock" {{(pid=77466) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 30 16:48:27 devstack cinder-volume[77466]: DEBUG oslo_concurrency.lockutils [None req-2783c127-e856-4382-b88c-67c00853d59a None None] Releasing lock "singleton_lock" {{(pid=77466) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 30 16:48:27 devstack cinder-volume[77466]: WARNING amqp [None req-2783c127-e856-4382-b88c-67c00853d59a None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 30 16:48:27 devstack cinder-volume[77466]: WARNING amqp [None req-2783c127-e856-4382-b88c-67c00853d59a None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 30 16:48:27 devstack cinder-volume[77304]: INFO oslo_service.backend._eventlet.service [None req-2783c127-e856-4382-b88c-67c00853d59a None None] Child 77466 exited with status 0 Jul 30 16:48:27 devstack cinder-volume[87699]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 30 16:48:27 devstack cinder-volume[87699]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 30 16:48:27 devstack cinder-volume[87699]: we strongly recommend against using it for new projects. Jul 30 16:48:27 devstack cinder-volume[87699]: If you are already using Eventlet, we recommend migrating to a different Jul 30 16:48:27 devstack cinder-volume[87699]: framework. For more detail see Jul 30 16:48:27 devstack cinder-volume[87699]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 30 16:48:27 devstack cinder-volume[87699]: import eventlet # noqa Jul 30 16:48:30 devstack cinder-volume[87699]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87699) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 30 16:48:30 devstack cinder-volume[87699]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87699) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 30 16:48:30 devstack cinder-volume[87699]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87699) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 30 16:48:31 devstack cinder-volume[87699]: INFO dbcounter [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] Registered counter for database cinder Jul 30 16:48:31 devstack cinder-volume[87699]: DEBUG oslo_db.sqlalchemy.engines [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87699) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 30 16:48:31 devstack cinder-volume[87699]: DEBUG dbcounter [-] [87699] Writer thread running {{(pid=87699) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 30 16:48:31 devstack cinder-volume[87699]: INFO cinder.rpc [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 30 16:48:31 devstack cinder-volume[87699]: INFO cinder.rpc [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 30 16:48:31 devstack cinder-volume[87699]: DEBUG oslo_db.sqlalchemy.engines [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87699) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 30 16:48:31 devstack cinder-volume[87699]: INFO cinder.volume.manager [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] Determined volume DB was empty at startup. Jul 30 16:48:31 devstack cinder-volume[87699]: DEBUG cinder.volume.manager [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87699) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 30 16:48:31 devstack cinder-volume[87699]: INFO cinder.volume.manager [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 30 16:48:31 devstack cinder-volume[87699]: WARNING stevedore.named [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 30 16:48:31 devstack cinder-volume[87699]: WARNING castellan.key_manager [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 30 16:48:31 devstack cinder-volume[87699]: WARNING cinder.keymgr.conf_key_mgr [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 30 16:48:31 devstack cinder-volume[87699]: INFO cinder.volume.manager [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_db.sqlalchemy.engines [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87699) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 30 16:48:32 devstack cinder-volume[87699]: INFO oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] Starting 1 workers Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] Started child 87989 {{(pid=87699) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] Full set of CONF: {{(pid=87699) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] ******************************************************************************** {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] Configuration options gathered from: {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 30 16:48:32 devstack cinder-volume[87989]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] ================================================================================ {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] allow_availability_zone_fallback = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] allow_compression_on_image_upload = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] allowed_direct_url_schemes = [] {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] api_rate_limit = True {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] auth_strategy = keystone {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_availability_zone = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_host = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_name = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_stats_polling_interval = 60 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backup_api_class = cinder.backup.api.API {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backup_name_template = backup-%s {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backup_use_same_host = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backup_use_temp_snapshot = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] chap_password = **** {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] chap_username = {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] cinder_internal_tenant_project_id = f0880ba56ad24852ab4c0ca52731b94c {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] cinder_internal_tenant_user_id = 321331f796e043ebbd77229341086ec8 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] cluster = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] compression_format = gzip {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] compute_api_class = cinder.compute.nova.API {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] config_dir = [] {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] config_source = [] {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] control_exchange = openstack {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] debug = True {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] default_availability_zone = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] default_group_type = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] default_volume_type = QuobyteHD {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] disk_geometry = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] driver_client_cert = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] driver_client_cert_key = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] driver_data_namespace = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] driver_ssl_cert_path = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] driver_ssl_cert_verify = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] driver_use_ssl = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] enable_new_services = True {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] enable_unsupported_driver = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] enabled_backends = ['QuobyteHD'] {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] enforce_multipath_for_image_xfer = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] filter_function = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] glance_api_insecure = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] glance_api_servers = ['http://192.168.122.209/image'] {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] glance_api_ssl_compression = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] glance_ca_certificates_file = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] glance_catalog_info = image:glance:publicURL {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] glance_certfile = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] glance_keyfile = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] glance_num_retries = 3 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] glance_request_timeout = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] goodness_function = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] graceful_shutdown_timeout = 5 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] group_api_class = cinder.group.api.API {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] host = devstack {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] image_compress_on_upload = True {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] image_conversion_address_space_limit = 1 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] image_conversion_cpu_limit = 60 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] image_conversion_disable = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] image_upload_use_cinder_backend = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] image_upload_use_internal_tenant = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] image_volume_cache_enabled = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] image_volume_cache_max_count = 0 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] image_volume_cache_max_size_gb = 0 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] init_host_max_objects_retrieval = 0 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] instance_format = [instance: %(uuid)s] {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] iscsi_target_flags = {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] iscsi_write_cache = on {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] iser_helper = tgtadm {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] iser_ip_address = 192.168.122.209 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] iser_port = 3260 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] log_color = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] log_config_append = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] log_dir = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] log_file = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] log_options = True {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] log_rotate_interval = 1 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] log_rotate_interval_type = days {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] log_rotation_type = none {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] max_age = 0 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] max_logfile_count = 30 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] max_logfile_size_mb = 200 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] max_over_subscription_ratio = 20.0 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] message_reap_interval = 86400 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] message_ttl = 2592000 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] migration_create_volume_timeout_secs = 300 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] monkey_patch = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] monkey_patch_modules = [] {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] my_ip = 192.168.122.209 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] no_snapshot_gb_quota = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] num_iser_scan_tries = 3 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] num_shell_tries = 3 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] num_volume_device_scan_tries = 3 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] nvmeof_conn_info_version = 1 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] nvmet_ns_id = 10 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] nvmet_port_id = 1 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] osapi_max_limit = 1000 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] osapi_volume_ext_list = [] {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] osapi_volume_listen = 0.0.0.0 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] osapi_volume_listen_port = 8776 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] osapi_volume_use_ssl = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] osapi_volume_workers = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] per_volume_size_limit = -1 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] periodic_fuzzy_delay = 60 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] periodic_interval = 60 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] project_id_regex = [0-9a-f\-]+ {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] public_endpoint = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] publish_errors = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] quota_backup_gigabytes = 1000 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] quota_backups = 10 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] quota_gigabytes = 1000 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] quota_groups = 10 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] quota_snapshots = 10 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87989]: INFO cinder.volume.manager [None req-2e233d18-e4e0-4970-9780-7cb5f94c5646 None None] Starting volume driver QuobyteDriver (1.2) Jul 30 16:48:32 devstack cinder-volume[87989]: DEBUG cinder.volume.drivers.remotefs [None req-2e233d18-e4e0-4970-9780-7cb5f94c5646 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87989) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] quota_volumes = 10 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] rate_limit_burst = 0 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] rate_limit_except_level = CRITICAL {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] rate_limit_interval = 0 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] reinit_driver_count = 3 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] replication_device = **** {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] report_discard_supported = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] report_interval = 120 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] reservation_clean_interval = 86400 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] reservation_expire = 86400 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] reserved_image_namespaces = [] {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] reserved_percentage = 0 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] rpc_response_timeout = 120 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] run_external_periodic_tasks = True {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] scst_target_driver = iscsi {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] scst_target_iqn_name = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] service_down_time = 720 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] shell_completion = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] snapshot_name_template = snapshot-%s {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] split_loggers = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] state_path = /opt/stack/data/cinder {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] storage_availability_zone = nova {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] storage_protocol = iSCSI {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] syslog_log_facility = LOG_USER {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] target_helper = lioadm {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] target_ip_address = 192.168.122.209 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] target_port = 3260 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] target_protocol = iscsi {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] target_secondary_ip_addresses = [] {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] trace_flags = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] transfer_api_class = cinder.transfer.api.API {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] transport_url = **** {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] until_refresh = 0 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] use_chap_auth = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] use_default_quota_class = True {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] use_journal = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] use_json = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] use_multipath_for_image_xfer = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] use_stderr = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] use_syslog = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] verify_glance_signatures = enabled {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] volume_api_class = cinder.volume.api.API {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] volume_backend_name = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] volume_clear = zero {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] volume_clear_ionice = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] volume_clear_size = 0 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] volume_copy_bps_limit = 0 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] volume_dd_blocksize = 1M {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] volume_name_template = volume-%s {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] volume_service_inithost_offload = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] volume_usage_audit_period = month {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] zoning_mode = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] oslo_concurrency.disable_process_locking = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] keystone_authtoken.auth_section = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] keystone_authtoken.auth_type = password {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] keystone_authtoken.auth_version = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] keystone_authtoken.cache = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] keystone_authtoken.certfile = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] keystone_authtoken.delay_auth_decision = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] keystone_authtoken.http_connect_timeout = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] keystone_authtoken.include_service_catalog = True {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] keystone_authtoken.insecure = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] keystone_authtoken.interface = public {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] keystone_authtoken.keyfile = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] keystone_authtoken.memcache_password = {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] keystone_authtoken.memcache_username = {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] keystone_authtoken.region_name = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] keystone_authtoken.service_token_roles_required = True {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] keystone_authtoken.service_type = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] keystone_authtoken.token_cache_time = 300 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.209/identity {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] cache.backend = dogpile.cache.null {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] cache.backend_argument = **** {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] cache.backend_expiration_time = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] cache.config_prefix = cache.oslo {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] cache.debug_cache_backend = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] cache.enable_retry_client = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] cache.enable_socket_keepalive = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] cache.enabled = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] cache.expiration_time = 600 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] cache.hashclient_retry_attempts = 2 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] cache.memcache_dead_retry = 300 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] cache.memcache_pool_maxsize = 10 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] cache.memcache_sasl_enabled = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] cache.password = **** {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] cache.proxies = [] {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] cache.redis_db = 0 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] cache.redis_sentinel_service_name = mymaster {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] cache.redis_server = localhost:6379 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] cache.retry_attempts = 2 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] cache.retry_delay = 0.0 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] cache.socket_keepalive_count = 1 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] cache.socket_keepalive_idle = 1 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] cache.socket_keepalive_interval = 1 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] cache.socket_timeout = 1.0 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] cache.tls_allowed_ciphers = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] cache.tls_cafile = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] cache.tls_certfile = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] cache.tls_enabled = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] cache.tls_keyfile = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] cache.username = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] coordination.backend_url = **** {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] database.asyncio_connection = **** {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] database.asyncio_slave_connection = **** {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] database.backend = sqlalchemy {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] database.connection = **** {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] database.connection_debug = 0 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] database.connection_parameters = {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] database.connection_recycle_time = 3600 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] database.connection_trace = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] database.db_inc_retry_interval = True {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] database.db_max_retries = 20 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] database.db_max_retry_interval = 10 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] database.db_retry_interval = 1 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] database.max_overflow = 50 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] database.max_pool_size = 5 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] database.max_retries = 10 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] database.mysql_wsrep_sync_wait = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] database.pool_timeout = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] database.retry_interval = 10 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] database.slave_connection = **** {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] database.sqlite_synchronous = True {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] database.synchronous_reader = True {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] database.use_db_reconnect = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87989]: DEBUG cinder.volume.drivers.quobyte [None req-2e233d18-e4e0-4970-9780-7cb5f94c5646 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87989) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 30 16:48:32 devstack cinder-volume[87989]: WARNING cinder.volume.drivers.quobyte [None req-2e233d18-e4e0-4970-9780-7cb5f94c5646 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] profiler.connection_string = messaging:// {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87989]: WARNING cinder.volume.drivers.quobyte [None req-2e233d18-e4e0-4970-9780-7cb5f94c5646 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] profiler.enabled = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87989]: DEBUG oslo_concurrency.processutils [None req-2e233d18-e4e0-4970-9780-7cb5f94c5646 None None] Running cmd (subprocess): mount.quobyte {{(pid=87989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] profiler.es_doc_type = notification {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] profiler.es_scroll_size = 10000 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] profiler.es_scroll_time = 2m {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] profiler.filter_error_trace = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] profiler.hmac_keys = **** {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] profiler.sentinel_service_name = mymaster {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] profiler.socket_timeout = 0.1 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] profiler.trace_requests = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] profiler.trace_sqlalchemy = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] profiler_jaeger.process_tags = {} {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] profiler_jaeger.service_name_prefix = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] profiler_otlp.service_name_prefix = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] oslo_policy.enforce_new_defaults = True {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] oslo_policy.policy_default_rule = default {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] oslo_policy.policy_file = policy.yaml {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] oslo_policy.remote_timeout = 60.0 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] privsep_osbrick.group = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] privsep_osbrick.helper_command = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] privsep_osbrick.user = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] cinder_sys_admin.group = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] cinder_sys_admin.helper_command = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] cinder_sys_admin.user = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] service_user.auth_section = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] service_user.auth_type = password {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] service_user.cafile = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] service_user.certfile = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] service_user.collect_timing = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] service_user.insecure = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] service_user.keyfile = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] service_user.send_service_user_token = True {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] service_user.split_loggers = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] service_user.timeout = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] glance.auth_section = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] glance.auth_type = password {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] glance.certfile = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] glance.collect_timing = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] glance.insecure = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] glance.keyfile = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] glance.region_name = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] glance.split_loggers = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] glance.timeout = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_defaults.backend_availability_zone = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_defaults.chap_password = **** {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_defaults.chap_username = {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_defaults.disk_geometry = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_defaults.driver_client_cert = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_defaults.driver_client_cert_key = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_defaults.driver_data_namespace = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_defaults.driver_use_ssl = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_defaults.enable_unsupported_driver = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_defaults.extra_capabilities = {} {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_defaults.filter_function = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_defaults.goodness_function = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_defaults.iscsi_target_flags = {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_defaults.iscsi_write_cache = on {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_defaults.iser_helper = tgtadm {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_defaults.iser_ip_address = 192.168.122.209 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_defaults.iser_port = 3260 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_defaults.nas_host = {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_defaults.nas_login = admin {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_defaults.nas_mount_options = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_defaults.nas_password = **** {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_defaults.nas_private_key = {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_defaults.nas_share_path = {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_defaults.nas_ssh_port = 22 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_defaults.num_shell_tries = 3 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_defaults.nvmet_port_id = 1 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_defaults.quobyte_client_cfg = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_defaults.quobyte_volume_url = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_defaults.replication_device = **** {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_defaults.report_discard_supported = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_defaults.reserved_percentage = 0 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_defaults.scst_target_driver = iscsi {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_defaults.scst_target_iqn_name = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_defaults.storage_protocol = iSCSI {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_defaults.target_helper = tgtadm {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_defaults.target_ip_address = 192.168.122.209 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_defaults.target_port = 3260 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_defaults.target_protocol = iscsi {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_defaults.trace_flags = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_defaults.unique_fqdn_network = True {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_defaults.use_chap_auth = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_defaults.volume_backend_name = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_defaults.volume_clear = zero {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_defaults.volume_clear_ionice = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_defaults.volume_clear_size = 0 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack quobyte-client[87990]: Reading configuration file: /etc/quobyte/client.cfg Jul 30 16:48:32 devstack quobyte-client[87990]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] oslo_reports.file_event_handler = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] oslo_reports.log_dir = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] QuobyteHD.backend_availability_zone = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] QuobyteHD.backend_host = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] QuobyteHD.chap_password = **** {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] QuobyteHD.chap_username = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] QuobyteHD.chiscsi_conf = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] QuobyteHD.disk_geometry = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] QuobyteHD.driver_client_cert = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] QuobyteHD.driver_client_cert_key = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] QuobyteHD.driver_data_namespace = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] QuobyteHD.driver_use_ssl = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] QuobyteHD.extra_capabilities = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] QuobyteHD.filter_function = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] QuobyteHD.goodness_function = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87989]: DEBUG oslo_concurrency.processutils [None req-2e233d18-e4e0-4970-9780-7cb5f94c5646 None None] CMD "mount.quobyte" returned: 1 in 0.102s {{(pid=87989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] QuobyteHD.iscsi_target_flags = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] QuobyteHD.iscsi_write_cache = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] QuobyteHD.iser_helper = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] QuobyteHD.iser_ip_address = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87989]: DEBUG oslo_concurrency.lockutils [None req-2e233d18-e4e0-4970-9780-7cb5f94c5646 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87989) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:48:32 devstack cinder-volume[87989]: DEBUG oslo_concurrency.lockutils [None req-2e233d18-e4e0-4970-9780-7cb5f94c5646 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87989) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:48:32 devstack cinder-volume[87989]: DEBUG cinder.volume.drivers.quobyte [None req-2e233d18-e4e0-4970-9780-7cb5f94c5646 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=87989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] QuobyteHD.iser_port = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] QuobyteHD.iser_target_prefix = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] QuobyteHD.nas_host = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] QuobyteHD.nas_login = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] QuobyteHD.nas_mount_options = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] QuobyteHD.nas_password = **** {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] QuobyteHD.nas_private_key = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87989]: INFO cinder.volume.drivers.quobyte [None req-2e233d18-e4e0-4970-9780-7cb5f94c5646 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 ... Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87989]: DEBUG oslo_concurrency.processutils [None req-2e233d18-e4e0-4970-9780-7cb5f94c5646 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 -c /etc/quobyte/client-cinder.cfg {{(pid=87989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] QuobyteHD.nas_share_path = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] QuobyteHD.nas_ssh_port = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] QuobyteHD.num_shell_tries = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] QuobyteHD.nvmet_ns_id = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] QuobyteHD.nvmet_port_id = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] QuobyteHD.replication_device = **** {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] QuobyteHD.report_discard_supported = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] QuobyteHD.reserved_percentage = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] QuobyteHD.scst_target_driver = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] QuobyteHD.storage_protocol = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] QuobyteHD.target_helper = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] QuobyteHD.target_ip_address = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] QuobyteHD.target_port = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] QuobyteHD.target_prefix = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] QuobyteHD.target_protocol = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] QuobyteHD.trace_flags = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] QuobyteHD.unique_fqdn_network = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] QuobyteHD.use_chap_auth = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] QuobyteHD.volume_clear = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] QuobyteHD.volume_clear_ionice = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] QuobyteHD.volume_clear_size = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] QuobyteHD.volumes_dir = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] oslo_messaging_rabbit.ssl = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] oslo_messaging_rabbit.ssl_version = {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] oslo_messaging_notifications.driver = [] {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] oslo_messaging_notifications.retry = -1 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] oslo_messaging_notifications.transport_url = **** {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack sudo[87991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 -c /etc/quobyte/client-cinder.cfg Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] key_manager.fixed_key = **** {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] barbican.barbican_api_version = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] barbican.barbican_endpoint = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] barbican.barbican_endpoint_type = public {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] barbican.barbican_region_name = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack sudo[87991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] barbican.cafile = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] barbican.certfile = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] barbican.collect_timing = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] barbican.insecure = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] barbican.keyfile = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] barbican.number_of_retries = 60 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] barbican.retry_delay = 1 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] barbican.send_service_user_token = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] barbican.split_loggers = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] barbican.timeout = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] barbican.verify_ssl = True {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] barbican.verify_ssl_path = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] barbican_service_user.auth_section = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] barbican_service_user.auth_type = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] barbican_service_user.cafile = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] barbican_service_user.certfile = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] barbican_service_user.collect_timing = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] barbican_service_user.insecure = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] barbican_service_user.keyfile = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] barbican_service_user.split_loggers = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] barbican_service_user.timeout = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] vault.approle_role_id = **** {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] vault.approle_secret_id = **** {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] vault.auth_method = approle {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] vault.auth_path = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] vault.kv_mountpoint = secret {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] vault.kv_path = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] vault.kv_version = 2 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] vault.namespace = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] vault.root_token_id = **** {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] vault.ssl_ca_crt_file = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] vault.timeout = 60.0 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] vault.token_file = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] vault.token_role = None {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] vault.use_ssl = False {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:32 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] ******************************************************************************** {{(pid=87699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 30 16:48:33 devstack sudo[87991]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:33 devstack cinder-volume[87989]: DEBUG oslo_concurrency.processutils [None req-2e233d18-e4e0-4970-9780-7cb5f94c5646 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.559s {{(pid=87989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:33 devstack cinder-volume[87989]: INFO cinder.volume.drivers.quobyte [None req-2e233d18-e4e0-4970-9780-7cb5f94c5646 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 succeeded Jul 30 16:48:33 devstack cinder-volume[87989]: DEBUG cinder.volume.drivers.quobyte [None req-2e233d18-e4e0-4970-9780-7cb5f94c5646 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=87989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:48:33 devstack cinder-volume[87989]: DEBUG oslo_concurrency.lockutils [None req-2e233d18-e4e0-4970-9780-7cb5f94c5646 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.579s {{(pid=87989) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:48:33 devstack cinder-volume[87989]: DEBUG oslo_concurrency.processutils [None req-2e233d18-e4e0-4970-9780-7cb5f94c5646 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=87989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:33 devstack sudo[88076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:48:33 devstack sudo[88076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:33 devstack sudo[88076]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:33 devstack cinder-volume[87989]: DEBUG oslo_concurrency.processutils [None req-2e233d18-e4e0-4970-9780-7cb5f94c5646 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.406s {{(pid=87989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:33 devstack cinder-volume[87989]: INFO cinder.volume.driver [None req-2e233d18-e4e0-4970-9780-7cb5f94c5646 None None] Driver hasn't implemented _init_vendor_properties() Jul 30 16:48:33 devstack cinder-volume[87989]: DEBUG cinder.volume.driver [None req-2e233d18-e4e0-4970-9780-7cb5f94c5646 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6410598754883, 'free_capacity_gb': 1775.6410598754883, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87989) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 30 16:48:33 devstack cinder-volume[87989]: DEBUG oslo_db.sqlalchemy.engines [None req-2e233d18-e4e0-4970-9780-7cb5f94c5646 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87989) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 30 16:48:33 devstack cinder-volume[87989]: DEBUG dbcounter [-] [87989] Writer thread running {{(pid=87989) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 30 16:48:33 devstack cinder-volume[87989]: DEBUG cinder.db.api [None req-2e233d18-e4e0-4970-9780-7cb5f94c5646 None None] Building query based on filter {{(pid=87989) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 30 16:48:33 devstack cinder-volume[87989]: DEBUG cinder.image.image_utils [None req-2e233d18-e4e0-4970-9780-7cb5f94c5646 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87989) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 30 16:48:33 devstack cinder-volume[87989]: INFO cinder.keymgr.migration [None req-8d829254-05ff-4a61-aeea-61f219970e84 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 30 16:48:33 devstack cinder-volume[87989]: DEBUG oslo_concurrency.lockutils [None req-2e233d18-e4e0-4970-9780-7cb5f94c5646 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87989) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:48:33 devstack cinder-volume[87989]: DEBUG oslo_concurrency.lockutils [None req-2e233d18-e4e0-4970-9780-7cb5f94c5646 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87989) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:48:33 devstack cinder-volume[87989]: DEBUG cinder.volume.drivers.quobyte [None req-2e233d18-e4e0-4970-9780-7cb5f94c5646 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=87989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:48:33 devstack cinder-volume[87989]: DEBUG cinder.volume.drivers.quobyte [None req-2e233d18-e4e0-4970-9780-7cb5f94c5646 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=87989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:48:33 devstack cinder-volume[87989]: DEBUG oslo_concurrency.lockutils [None req-2e233d18-e4e0-4970-9780-7cb5f94c5646 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87989) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:48:33 devstack cinder-volume[87989]: DEBUG oslo_concurrency.processutils [None req-2e233d18-e4e0-4970-9780-7cb5f94c5646 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=87989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:33 devstack sudo[88114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:48:33 devstack sudo[88114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:34 devstack sudo[88114]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:34 devstack cinder-volume[87989]: DEBUG oslo_concurrency.processutils [None req-2e233d18-e4e0-4970-9780-7cb5f94c5646 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.340s {{(pid=87989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:34 devstack cinder-volume[87989]: DEBUG cinder.manager [None req-2e233d18-e4e0-4970-9780-7cb5f94c5646 None None] Notifying Schedulers of capabilities ... {{(pid=87989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:48:34 devstack cinder-volume[87989]: INFO cinder.volume.manager [None req-2e233d18-e4e0-4970-9780-7cb5f94c5646 None None] Driver initialization completed successfully. Jul 30 16:48:34 devstack cinder-volume[87989]: INFO cinder.manager [None req-2e233d18-e4e0-4970-9780-7cb5f94c5646 None None] Initiating service 3 cleanup Jul 30 16:48:34 devstack cinder-volume[87989]: INFO cinder.manager [None req-2e233d18-e4e0-4970-9780-7cb5f94c5646 None None] Service 3 cleanup completed. Jul 30 16:48:34 devstack cinder-volume[87989]: DEBUG cinder.service [None req-2e233d18-e4e0-4970-9780-7cb5f94c5646 None None] Creating RPC server for service cinder-volume {{(pid=87989) start /opt/stack/cinder/cinder/service.py:231}} Jul 30 16:48:34 devstack cinder-volume[87989]: DEBUG cinder.service [None req-2e233d18-e4e0-4970-9780-7cb5f94c5646 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87989) start /opt/stack/cinder/cinder/service.py:237}} Jul 30 16:48:34 devstack cinder-volume[87989]: INFO cinder.volume.manager [None req-2e233d18-e4e0-4970-9780-7cb5f94c5646 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 30 16:48:34 devstack cinder-volume[87989]: DEBUG oslo_concurrency.lockutils [None req-2e233d18-e4e0-4970-9780-7cb5f94c5646 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87989) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:48:34 devstack cinder-volume[87989]: DEBUG oslo_concurrency.lockutils [None req-2e233d18-e4e0-4970-9780-7cb5f94c5646 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87989) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:48:34 devstack cinder-volume[87989]: DEBUG cinder.volume.drivers.quobyte [None req-2e233d18-e4e0-4970-9780-7cb5f94c5646 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=87989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:48:34 devstack cinder-volume[87989]: DEBUG cinder.volume.drivers.quobyte [None req-2e233d18-e4e0-4970-9780-7cb5f94c5646 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=87989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:48:34 devstack cinder-volume[87989]: DEBUG oslo_concurrency.lockutils [None req-2e233d18-e4e0-4970-9780-7cb5f94c5646 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87989) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:48:34 devstack cinder-volume[87989]: DEBUG oslo_concurrency.processutils [None req-2e233d18-e4e0-4970-9780-7cb5f94c5646 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=87989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:34 devstack sudo[88177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:48:34 devstack sudo[88177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:34 devstack sudo[88177]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:34 devstack cinder-volume[87989]: DEBUG oslo_concurrency.processutils [None req-2e233d18-e4e0-4970-9780-7cb5f94c5646 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.350s {{(pid=87989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:34 devstack cinder-volume[87989]: INFO cinder.volume.manager [None req-2e233d18-e4e0-4970-9780-7cb5f94c5646 None None] Driver post RPC initialization completed successfully. Jul 30 16:48:35 devstack cinder-volume[87989]: DEBUG oslo_service.periodic_task [None req-cad49de5-4cc6-477b-9710-308b8c7815ae None None] Running periodic task VolumeManager._thread_info {{(pid=87989) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:48:35 devstack cinder-volume[87989]: DEBUG cinder.volume.manager [None req-cad49de5-4cc6-477b-9710-308b8c7815ae None None] thread count: 6 {{(pid=87989) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:48:35 devstack cinder-volume[87989]: DEBUG cinder.volume.manager [None req-cad49de5-4cc6-477b-9710-308b8c7815ae None None] thread info: [<_MainThread(MainThread, started 124222890213504)>, , , , , ] {{(pid=87989) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:48:38 devstack cinder-volume[87989]: DEBUG oslo_concurrency.lockutils [None req-bde9cf5e-e834-46dc-aa4c-9b3cd732e292 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87989) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:48:38 devstack cinder-volume[87989]: DEBUG oslo_concurrency.lockutils [None req-bde9cf5e-e834-46dc-aa4c-9b3cd732e292 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87989) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:48:38 devstack cinder-volume[87989]: DEBUG cinder.volume.drivers.quobyte [None req-bde9cf5e-e834-46dc-aa4c-9b3cd732e292 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=87989) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:48:38 devstack cinder-volume[87989]: DEBUG cinder.volume.drivers.quobyte [None req-bde9cf5e-e834-46dc-aa4c-9b3cd732e292 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=87989) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:48:38 devstack cinder-volume[87989]: DEBUG oslo_concurrency.lockutils [None req-bde9cf5e-e834-46dc-aa4c-9b3cd732e292 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87989) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:48:38 devstack cinder-volume[87989]: DEBUG oslo_concurrency.processutils [None req-bde9cf5e-e834-46dc-aa4c-9b3cd732e292 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=87989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:38 devstack sudo[88222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:48:38 devstack sudo[88222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:38 devstack sudo[88222]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:38 devstack cinder-volume[87989]: DEBUG oslo_concurrency.processutils [None req-bde9cf5e-e834-46dc-aa4c-9b3cd732e292 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.239s {{(pid=87989) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:38 devstack cinder-volume[87989]: DEBUG cinder.manager [None req-bde9cf5e-e834-46dc-aa4c-9b3cd732e292 None None] Notifying Schedulers of capabilities ... {{(pid=87989) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:48:41 devstack cinder-volume[87699]: INFO oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] Caught SIGTERM, stopping children Jul 30 16:48:41 devstack cinder-volume[87699]: DEBUG oslo_concurrency.lockutils [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] Acquiring lock "singleton_lock" {{(pid=87699) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 30 16:48:41 devstack cinder-volume[87699]: DEBUG oslo_concurrency.lockutils [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] Acquired lock "singleton_lock" {{(pid=87699) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 30 16:48:41 devstack cinder-volume[87699]: DEBUG oslo_concurrency.lockutils [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] Releasing lock "singleton_lock" {{(pid=87699) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 30 16:48:41 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] Stop services. {{(pid=87699) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 30 16:48:41 devstack cinder-volume[87699]: DEBUG oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] Killing children. {{(pid=87699) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 30 16:48:41 devstack cinder-volume[87699]: INFO oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] Waiting on 1 children to exit Jul 30 16:48:42 devstack cinder-volume[87989]: DEBUG oslo_concurrency.lockutils [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] Acquiring lock "singleton_lock" {{(pid=87989) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 30 16:48:42 devstack cinder-volume[87989]: DEBUG oslo_concurrency.lockutils [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] Acquired lock "singleton_lock" {{(pid=87989) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 30 16:48:42 devstack cinder-volume[87989]: DEBUG oslo_concurrency.lockutils [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] Releasing lock "singleton_lock" {{(pid=87989) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 30 16:48:42 devstack cinder-volume[87989]: WARNING amqp [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 30 16:48:42 devstack cinder-volume[87989]: WARNING amqp [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 30 16:48:42 devstack cinder-volume[87699]: INFO oslo_service.backend._eventlet.service [None req-f3e74282-64af-4e5d-80cd-3c4638b6611a None None] Child 87989 exited with status 0 Jul 30 16:48:43 devstack cinder-volume[88295]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 30 16:48:43 devstack cinder-volume[88295]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 30 16:48:43 devstack cinder-volume[88295]: we strongly recommend against using it for new projects. Jul 30 16:48:43 devstack cinder-volume[88295]: If you are already using Eventlet, we recommend migrating to a different Jul 30 16:48:43 devstack cinder-volume[88295]: framework. For more detail see Jul 30 16:48:43 devstack cinder-volume[88295]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 30 16:48:43 devstack cinder-volume[88295]: import eventlet # noqa Jul 30 16:48:46 devstack cinder-volume[88295]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=88295) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 30 16:48:46 devstack cinder-volume[88295]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=88295) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 30 16:48:46 devstack cinder-volume[88295]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=88295) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 30 16:48:47 devstack cinder-volume[88295]: INFO dbcounter [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] Registered counter for database cinder Jul 30 16:48:47 devstack cinder-volume[88295]: DEBUG oslo_db.sqlalchemy.engines [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88295) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 30 16:48:48 devstack cinder-volume[88295]: DEBUG dbcounter [-] [88295] Writer thread running {{(pid=88295) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 30 16:48:48 devstack cinder-volume[88295]: INFO cinder.rpc [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 30 16:48:48 devstack cinder-volume[88295]: INFO cinder.rpc [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 30 16:48:48 devstack cinder-volume[88295]: DEBUG oslo_db.sqlalchemy.engines [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88295) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 30 16:48:48 devstack cinder-volume[88295]: INFO cinder.volume.manager [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] Determined volume DB was empty at startup. Jul 30 16:48:48 devstack cinder-volume[88295]: DEBUG cinder.volume.manager [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=88295) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 30 16:48:48 devstack cinder-volume[88295]: WARNING stevedore.named [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 30 16:48:48 devstack cinder-volume[88295]: WARNING castellan.key_manager [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 30 16:48:48 devstack cinder-volume[88295]: WARNING cinder.keymgr.conf_key_mgr [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 30 16:48:48 devstack cinder-volume[88295]: INFO cinder.volume.manager [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 30 16:48:48 devstack cinder-volume[88295]: DEBUG oslo_db.sqlalchemy.engines [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88295) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 30 16:48:48 devstack cinder-volume[88295]: INFO oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] Starting 1 workers Jul 30 16:48:48 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] Started child 88568 {{(pid=88295) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 30 16:48:48 devstack cinder-volume[88568]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 30 16:48:48 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] Full set of CONF: {{(pid=88295) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 30 16:48:48 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] ******************************************************************************** {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 30 16:48:48 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] Configuration options gathered from: {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 30 16:48:48 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 30 16:48:48 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 30 16:48:48 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] ================================================================================ {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 30 16:48:48 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] allow_availability_zone_fallback = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:48 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] allow_compression_on_image_upload = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:48 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] allowed_direct_url_schemes = [] {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:48 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] api_rate_limit = True {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:48 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] auth_strategy = keystone {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:48 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_availability_zone = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:48 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_host = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:48 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_name = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:48 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_stats_polling_interval = 60 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:48 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backup_api_class = cinder.backup.api.API {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:48 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:48 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backup_name_template = backup-%s {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:48 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backup_use_same_host = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:48 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backup_use_temp_snapshot = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:48 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] chap_password = **** {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:48 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] chap_username = {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:48 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:48 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] cinder_internal_tenant_project_id = f0880ba56ad24852ab4c0ca52731b94c {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:48 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] cinder_internal_tenant_user_id = 321331f796e043ebbd77229341086ec8 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:48 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] cluster = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:48 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] compression_format = gzip {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:48 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] compute_api_class = cinder.compute.nova.API {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:48 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] config_dir = [] {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:48 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:48 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] config_source = [] {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:48 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:48 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] control_exchange = openstack {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:48 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] debug = True {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:48 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] default_availability_zone = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:48 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] default_group_type = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:48 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:48 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] default_volume_type = QuobyteHD {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:48 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] disk_geometry = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:48 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] driver_client_cert = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:48 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] driver_client_cert_key = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:48 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] driver_data_namespace = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:48 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] driver_ssl_cert_path = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:48 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] driver_ssl_cert_verify = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:48 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] driver_use_ssl = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:48 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] enable_new_services = True {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:48 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] enable_unsupported_driver = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:48 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] enabled_backends = ['QuobyteHD'] {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:48 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] enforce_multipath_for_image_xfer = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:48 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] filter_function = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:48 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] glance_api_insecure = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:48 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] glance_api_servers = ['http://192.168.122.209/image'] {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:48 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] glance_api_ssl_compression = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:48 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] glance_ca_certificates_file = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:48 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] glance_catalog_info = image:glance:publicURL {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:48 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] glance_certfile = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:48 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:48 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] glance_keyfile = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:48 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] glance_num_retries = 3 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:48 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] glance_request_timeout = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:48 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] goodness_function = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:48 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] graceful_shutdown_timeout = 5 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:48 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] group_api_class = cinder.group.api.API {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:48 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] host = devstack {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:48 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] image_compress_on_upload = True {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:48 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] image_conversion_address_space_limit = 1 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:48 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] image_conversion_cpu_limit = 60 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:48 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:48 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] image_conversion_disable = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:48 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] image_upload_use_cinder_backend = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:48 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] image_upload_use_internal_tenant = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:48 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] image_volume_cache_enabled = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:48 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] image_volume_cache_max_count = 0 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:48 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] image_volume_cache_max_size_gb = 0 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:48 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] init_host_max_objects_retrieval = 0 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:48 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] instance_format = [instance: %(uuid)s] {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] iscsi_target_flags = {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] iscsi_write_cache = on {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] iser_helper = tgtadm {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] iser_ip_address = 192.168.122.209 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] iser_port = 3260 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] log_color = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] log_config_append = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] log_dir = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] log_file = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-0f9532a0-ac3d-401a-9a81-b5052d88242b None None] Starting volume driver QuobyteDriver (1.2) Jul 30 16:48:49 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-0f9532a0-ac3d-401a-9a81-b5052d88242b None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=88568) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] log_options = True {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] log_rotate_interval = 1 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] log_rotate_interval_type = days {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] log_rotation_type = none {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] max_age = 0 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] max_logfile_count = 30 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] max_logfile_size_mb = 200 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] max_over_subscription_ratio = 20.0 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] message_reap_interval = 86400 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] message_ttl = 2592000 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] migration_create_volume_timeout_secs = 300 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] monkey_patch = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] monkey_patch_modules = [] {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] my_ip = 192.168.122.209 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] no_snapshot_gb_quota = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] num_iser_scan_tries = 3 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] num_shell_tries = 3 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] num_volume_device_scan_tries = 3 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] nvmeof_conn_info_version = 1 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] nvmet_ns_id = 10 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] nvmet_port_id = 1 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] osapi_max_limit = 1000 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] osapi_volume_ext_list = [] {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] osapi_volume_listen = 0.0.0.0 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] osapi_volume_listen_port = 8776 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] osapi_volume_use_ssl = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] osapi_volume_workers = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] per_volume_size_limit = -1 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] periodic_fuzzy_delay = 60 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] periodic_interval = 60 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] project_id_regex = [0-9a-f\-]+ {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] public_endpoint = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] publish_errors = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] quota_backup_gigabytes = 1000 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] quota_backups = 10 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] quota_gigabytes = 1000 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] quota_groups = 10 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] quota_snapshots = 10 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] quota_volumes = 10 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] rate_limit_burst = 0 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] rate_limit_except_level = CRITICAL {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] rate_limit_interval = 0 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] reinit_driver_count = 3 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] replication_device = **** {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] report_discard_supported = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] report_interval = 120 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] reservation_clean_interval = 86400 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] reservation_expire = 86400 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] reserved_image_namespaces = [] {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] reserved_percentage = 0 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] rpc_response_timeout = 120 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] run_external_periodic_tasks = True {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] scst_target_driver = iscsi {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] scst_target_iqn_name = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] service_down_time = 720 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] shell_completion = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] snapshot_name_template = snapshot-%s {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] split_loggers = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] state_path = /opt/stack/data/cinder {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] storage_availability_zone = nova {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] storage_protocol = iSCSI {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] syslog_log_facility = LOG_USER {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] target_helper = lioadm {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] target_ip_address = 192.168.122.209 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] target_port = 3260 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] target_protocol = iscsi {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] target_secondary_ip_addresses = [] {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] trace_flags = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] transfer_api_class = cinder.transfer.api.API {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] transport_url = **** {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] until_refresh = 0 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] use_chap_auth = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] use_default_quota_class = True {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] use_journal = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] use_json = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] use_multipath_for_image_xfer = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] use_stderr = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] use_syslog = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] verify_glance_signatures = enabled {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] volume_api_class = cinder.volume.api.API {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] volume_backend_name = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] volume_clear = zero {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] volume_clear_ionice = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] volume_clear_size = 0 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] volume_copy_bps_limit = 0 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] volume_dd_blocksize = 1M {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] volume_name_template = volume-%s {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] volume_service_inithost_offload = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] volume_usage_audit_period = month {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] zoning_mode = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] oslo_concurrency.disable_process_locking = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] keystone_authtoken.auth_section = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] keystone_authtoken.auth_type = password {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] keystone_authtoken.auth_version = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] keystone_authtoken.cache = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] keystone_authtoken.certfile = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] keystone_authtoken.delay_auth_decision = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-0f9532a0-ac3d-401a-9a81-b5052d88242b None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=88568) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 30 16:48:49 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.quobyte [None req-0f9532a0-ac3d-401a-9a81-b5052d88242b None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 30 16:48:49 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.quobyte [None req-0f9532a0-ac3d-401a-9a81-b5052d88242b None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] keystone_authtoken.http_connect_timeout = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] keystone_authtoken.include_service_catalog = True {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] keystone_authtoken.insecure = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] keystone_authtoken.interface = public {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] keystone_authtoken.keyfile = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] keystone_authtoken.memcache_password = {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0f9532a0-ac3d-401a-9a81-b5052d88242b None None] Running cmd (subprocess): mount.quobyte {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] keystone_authtoken.memcache_username = {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] keystone_authtoken.region_name = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] keystone_authtoken.service_token_roles_required = True {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] keystone_authtoken.service_type = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] keystone_authtoken.token_cache_time = 300 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.209/identity {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] cache.backend = dogpile.cache.null {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] cache.backend_argument = **** {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] cache.backend_expiration_time = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] cache.config_prefix = cache.oslo {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] cache.debug_cache_backend = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] cache.enable_retry_client = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] cache.enable_socket_keepalive = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] cache.enabled = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] cache.expiration_time = 600 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] cache.hashclient_retry_attempts = 2 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] cache.memcache_dead_retry = 300 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] cache.memcache_pool_maxsize = 10 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] cache.memcache_sasl_enabled = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] cache.password = **** {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] cache.proxies = [] {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] cache.redis_db = 0 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] cache.redis_sentinel_service_name = mymaster {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] cache.redis_server = localhost:6379 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] cache.retry_attempts = 2 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] cache.retry_delay = 0.0 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] cache.socket_keepalive_count = 1 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] cache.socket_keepalive_idle = 1 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] cache.socket_keepalive_interval = 1 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] cache.socket_timeout = 1.0 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] cache.tls_allowed_ciphers = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] cache.tls_cafile = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] cache.tls_certfile = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] cache.tls_enabled = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] cache.tls_keyfile = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] cache.username = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] coordination.backend_url = **** {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack quobyte-client[88569]: Reading configuration file: /etc/quobyte/client.cfg Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] database.asyncio_connection = **** {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] database.asyncio_slave_connection = **** {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] database.backend = sqlalchemy {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] database.connection = **** {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] database.connection_debug = 0 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] database.connection_parameters = {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] database.connection_recycle_time = 3600 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack quobyte-client[88569]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] database.connection_trace = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] database.db_inc_retry_interval = True {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] database.db_max_retries = 20 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] database.db_max_retry_interval = 10 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] database.db_retry_interval = 1 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] database.max_overflow = 50 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] database.max_pool_size = 5 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] database.max_retries = 10 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0f9532a0-ac3d-401a-9a81-b5052d88242b None None] CMD "mount.quobyte" returned: 1 in 0.091s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:49 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-0f9532a0-ac3d-401a-9a81-b5052d88242b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] database.mysql_wsrep_sync_wait = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-0f9532a0-ac3d-401a-9a81-b5052d88242b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:48:49 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-0f9532a0-ac3d-401a-9a81-b5052d88242b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] database.pool_timeout = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] database.retry_interval = 10 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] database.slave_connection = **** {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] database.sqlite_synchronous = True {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] database.synchronous_reader = True {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] database.use_db_reconnect = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] profiler.connection_string = messaging:// {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] profiler.enabled = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] profiler.es_doc_type = notification {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] profiler.es_scroll_size = 10000 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] profiler.es_scroll_time = 2m {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] profiler.filter_error_trace = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] profiler.hmac_keys = **** {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] profiler.sentinel_service_name = mymaster {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] profiler.socket_timeout = 0.1 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-0f9532a0-ac3d-401a-9a81-b5052d88242b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:48:49 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-0f9532a0-ac3d-401a-9a81-b5052d88242b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:48:49 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0f9532a0-ac3d-401a-9a81-b5052d88242b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] profiler.trace_requests = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] profiler.trace_sqlalchemy = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] profiler_jaeger.process_tags = {} {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] profiler_jaeger.service_name_prefix = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] profiler_otlp.service_name_prefix = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] oslo_policy.enforce_new_defaults = True {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] oslo_policy.policy_default_rule = default {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] oslo_policy.policy_file = policy.yaml {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] oslo_policy.remote_timeout = 60.0 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] privsep_osbrick.group = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] privsep_osbrick.helper_command = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] privsep_osbrick.user = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] cinder_sys_admin.group = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] cinder_sys_admin.helper_command = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] cinder_sys_admin.user = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] service_user.auth_section = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] service_user.auth_type = password {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] service_user.cafile = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] service_user.certfile = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] service_user.collect_timing = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] service_user.insecure = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] service_user.keyfile = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] service_user.send_service_user_token = True {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] service_user.split_loggers = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] service_user.timeout = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] glance.auth_section = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack sudo[88571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] glance.auth_type = password {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] glance.certfile = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] glance.collect_timing = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] glance.insecure = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] glance.keyfile = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] glance.region_name = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack sudo[88571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] glance.split_loggers = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] glance.timeout = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_defaults.backend_availability_zone = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_defaults.chap_password = **** {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_defaults.chap_username = {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_defaults.disk_geometry = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_defaults.driver_client_cert = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_defaults.driver_client_cert_key = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_defaults.driver_data_namespace = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_defaults.driver_use_ssl = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_defaults.enable_unsupported_driver = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_defaults.extra_capabilities = {} {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_defaults.filter_function = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_defaults.goodness_function = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_defaults.iscsi_target_flags = {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_defaults.iscsi_write_cache = on {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_defaults.iser_helper = tgtadm {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_defaults.iser_ip_address = 192.168.122.209 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_defaults.iser_port = 3260 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_defaults.nas_host = {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_defaults.nas_login = admin {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_defaults.nas_mount_options = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_defaults.nas_password = **** {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_defaults.nas_private_key = {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_defaults.nas_share_path = {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_defaults.nas_ssh_port = 22 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_defaults.num_shell_tries = 3 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_defaults.nvmet_port_id = 1 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_defaults.quobyte_client_cfg = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_defaults.quobyte_volume_url = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_defaults.replication_device = **** {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_defaults.report_discard_supported = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_defaults.reserved_percentage = 0 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_defaults.scst_target_driver = iscsi {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_defaults.scst_target_iqn_name = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_defaults.storage_protocol = iSCSI {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_defaults.target_helper = tgtadm {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_defaults.target_ip_address = 192.168.122.209 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_defaults.target_port = 3260 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_defaults.target_protocol = iscsi {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_defaults.trace_flags = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_defaults.unique_fqdn_network = True {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_defaults.use_chap_auth = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_defaults.volume_backend_name = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_defaults.volume_clear = zero {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_defaults.volume_clear_ionice = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_defaults.volume_clear_size = 0 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] oslo_reports.file_event_handler = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] oslo_reports.log_dir = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] QuobyteHD.backend_availability_zone = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] QuobyteHD.backend_host = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] QuobyteHD.chap_password = **** {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] QuobyteHD.chap_username = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] QuobyteHD.chiscsi_conf = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] QuobyteHD.disk_geometry = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] QuobyteHD.driver_client_cert = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] QuobyteHD.driver_client_cert_key = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] QuobyteHD.driver_data_namespace = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] QuobyteHD.driver_use_ssl = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] QuobyteHD.extra_capabilities = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] QuobyteHD.filter_function = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] QuobyteHD.goodness_function = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] QuobyteHD.iscsi_target_flags = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] QuobyteHD.iscsi_write_cache = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] QuobyteHD.iser_helper = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] QuobyteHD.iser_ip_address = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] QuobyteHD.iser_port = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] QuobyteHD.iser_target_prefix = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] QuobyteHD.nas_host = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] QuobyteHD.nas_login = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] QuobyteHD.nas_mount_options = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] QuobyteHD.nas_password = **** {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] QuobyteHD.nas_private_key = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] QuobyteHD.nas_share_path = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] QuobyteHD.nas_ssh_port = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] QuobyteHD.num_shell_tries = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] QuobyteHD.nvmet_ns_id = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] QuobyteHD.nvmet_port_id = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] QuobyteHD.replication_device = **** {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] QuobyteHD.report_discard_supported = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] QuobyteHD.reserved_percentage = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] QuobyteHD.scst_target_driver = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] QuobyteHD.storage_protocol = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] QuobyteHD.target_helper = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] QuobyteHD.target_ip_address = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] QuobyteHD.target_port = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] QuobyteHD.target_prefix = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] QuobyteHD.target_protocol = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] QuobyteHD.trace_flags = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] QuobyteHD.unique_fqdn_network = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] QuobyteHD.use_chap_auth = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] QuobyteHD.volume_clear = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] QuobyteHD.volume_clear_ionice = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] QuobyteHD.volume_clear_size = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] QuobyteHD.volumes_dir = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] oslo_messaging_rabbit.ssl = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] oslo_messaging_rabbit.ssl_version = {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] oslo_messaging_notifications.driver = [] {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] oslo_messaging_notifications.retry = -1 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] oslo_messaging_notifications.transport_url = **** {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] key_manager.fixed_key = **** {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] barbican.barbican_api_version = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] barbican.barbican_endpoint = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] barbican.barbican_endpoint_type = public {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] barbican.barbican_region_name = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] barbican.cafile = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] barbican.certfile = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] barbican.collect_timing = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] barbican.insecure = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] barbican.keyfile = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] barbican.number_of_retries = 60 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] barbican.retry_delay = 1 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] barbican.send_service_user_token = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] barbican.split_loggers = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] barbican.timeout = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] barbican.verify_ssl = True {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] barbican.verify_ssl_path = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] barbican_service_user.auth_section = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] barbican_service_user.auth_type = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] barbican_service_user.cafile = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] barbican_service_user.certfile = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] barbican_service_user.collect_timing = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] barbican_service_user.insecure = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] barbican_service_user.keyfile = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] barbican_service_user.split_loggers = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] barbican_service_user.timeout = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] vault.approle_role_id = **** {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] vault.approle_secret_id = **** {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] vault.auth_method = approle {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] vault.auth_path = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] vault.kv_mountpoint = secret {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] vault.kv_path = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] vault.kv_version = 2 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] vault.namespace = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] vault.root_token_id = **** {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] vault.ssl_ca_crt_file = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] vault.timeout = 60.0 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] vault.token_file = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] vault.token_role = None {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] vault.use_ssl = False {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:48:49 devstack cinder-volume[88295]: DEBUG oslo_service.backend._eventlet.service [None req-25f52e1f-4cd9-4439-b5c5-5d750acf5c78 None None] ******************************************************************************** {{(pid=88295) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 30 16:48:49 devstack sudo[88571]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:49 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0f9532a0-ac3d-401a-9a81-b5052d88242b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.372s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:49 devstack cinder-volume[88568]: INFO cinder.volume.driver [None req-0f9532a0-ac3d-401a-9a81-b5052d88242b None None] Driver hasn't implemented _init_vendor_properties() Jul 30 16:48:49 devstack cinder-volume[88568]: DEBUG cinder.volume.driver [None req-0f9532a0-ac3d-401a-9a81-b5052d88242b None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6410598754883, 'free_capacity_gb': 1775.6410598754883, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88568) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 30 16:48:49 devstack cinder-volume[88568]: DEBUG oslo_db.sqlalchemy.engines [None req-0f9532a0-ac3d-401a-9a81-b5052d88242b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88568) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 30 16:48:49 devstack cinder-volume[88568]: DEBUG dbcounter [-] [88568] Writer thread running {{(pid=88568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 30 16:48:49 devstack cinder-volume[88568]: DEBUG cinder.db.api [None req-0f9532a0-ac3d-401a-9a81-b5052d88242b None None] Building query based on filter {{(pid=88568) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 30 16:48:49 devstack cinder-volume[88568]: DEBUG cinder.image.image_utils [None req-0f9532a0-ac3d-401a-9a81-b5052d88242b None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=88568) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 30 16:48:49 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-0f9532a0-ac3d-401a-9a81-b5052d88242b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:48:49 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-0f9532a0-ac3d-401a-9a81-b5052d88242b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:48:49 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-0f9532a0-ac3d-401a-9a81-b5052d88242b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:48:49 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-0f9532a0-ac3d-401a-9a81-b5052d88242b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:48:49 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-0f9532a0-ac3d-401a-9a81-b5052d88242b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:48:49 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0f9532a0-ac3d-401a-9a81-b5052d88242b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:49 devstack cinder-volume[88568]: INFO cinder.keymgr.migration [None req-a49a2b38-3793-43b8-87ac-c1b9ab874f51 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 30 16:48:49 devstack sudo[88576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:48:49 devstack sudo[88576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:50 devstack sudo[88576]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0f9532a0-ac3d-401a-9a81-b5052d88242b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.303s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:50 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-0f9532a0-ac3d-401a-9a81-b5052d88242b None None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:48:50 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-0f9532a0-ac3d-401a-9a81-b5052d88242b None None] Driver initialization completed successfully. Jul 30 16:48:50 devstack cinder-volume[88568]: INFO cinder.manager [None req-0f9532a0-ac3d-401a-9a81-b5052d88242b None None] Initiating service 3 cleanup Jul 30 16:48:50 devstack cinder-volume[88568]: INFO cinder.manager [None req-0f9532a0-ac3d-401a-9a81-b5052d88242b None None] Service 3 cleanup completed. Jul 30 16:48:50 devstack cinder-volume[88568]: DEBUG cinder.service [None req-0f9532a0-ac3d-401a-9a81-b5052d88242b None None] Creating RPC server for service cinder-volume {{(pid=88568) start /opt/stack/cinder/cinder/service.py:231}} Jul 30 16:48:50 devstack cinder-volume[88568]: DEBUG cinder.service [None req-0f9532a0-ac3d-401a-9a81-b5052d88242b None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=88568) start /opt/stack/cinder/cinder/service.py:237}} Jul 30 16:48:50 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-0f9532a0-ac3d-401a-9a81-b5052d88242b None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 30 16:48:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-0f9532a0-ac3d-401a-9a81-b5052d88242b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:48:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-0f9532a0-ac3d-401a-9a81-b5052d88242b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:48:50 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-0f9532a0-ac3d-401a-9a81-b5052d88242b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:48:50 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-0f9532a0-ac3d-401a-9a81-b5052d88242b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:48:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-0f9532a0-ac3d-401a-9a81-b5052d88242b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:48:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0f9532a0-ac3d-401a-9a81-b5052d88242b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-b2d79b74-4257-4eba-bc17-6f55779cd86c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:48:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-b2d79b74-4257-4eba-bc17-6f55779cd86c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:48:50 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-b2d79b74-4257-4eba-bc17-6f55779cd86c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:48:50 devstack sudo[88579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:48:50 devstack sudo[88579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:50 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-b2d79b74-4257-4eba-bc17-6f55779cd86c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:48:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-b2d79b74-4257-4eba-bc17-6f55779cd86c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:48:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-b2d79b74-4257-4eba-bc17-6f55779cd86c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:50 devstack sudo[88581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:48:50 devstack sudo[88581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:50 devstack sudo[88579]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0f9532a0-ac3d-401a-9a81-b5052d88242b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.241s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:50 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-0f9532a0-ac3d-401a-9a81-b5052d88242b None None] Driver post RPC initialization completed successfully. Jul 30 16:48:50 devstack sudo[88581]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-b2d79b74-4257-4eba-bc17-6f55779cd86c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.244s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:50 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-b2d79b74-4257-4eba-bc17-6f55779cd86c None None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:48:52 devstack cinder-volume[88568]: DEBUG oslo_service.periodic_task [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Running periodic task VolumeManager._thread_info {{(pid=88568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:48:52 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] thread count: 6 {{(pid=88568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:48:52 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] thread info: [<_MainThread(MainThread, started 127406866608256)>, , , , , ] {{(pid=88568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:48:58 devstack cinder-volume[88295]: DEBUG dbcounter [-] [88295] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=88295) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:48:59 devstack cinder-volume[88568]: DEBUG dbcounter [-] [88568] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=88568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:49:00 devstack cinder-volume[88568]: DEBUG dbcounter [-] [88568] Writing DB stats cinder:SELECT=4 {{(pid=88568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:49:52 devstack cinder-volume[88568]: DEBUG oslo_service.periodic_task [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:49:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:49:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:49:52 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:49:52 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:49:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:49:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:49:52 devstack sudo[88973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:49:52 devstack sudo[88973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:49:53 devstack sudo[88973]: pam_unix(sudo:session): session closed for user root Jul 30 16:49:53 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.670s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:49:53 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:49:53 devstack cinder-volume[88568]: DEBUG oslo_service.periodic_task [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Running periodic task VolumeManager._thread_info {{(pid=88568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:49:53 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] thread count: 6 {{(pid=88568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:49:53 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] thread info: [<_MainThread(MainThread, started 127406866608256)>, , , , , ] {{(pid=88568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:50:28 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0844e5f-6ccb-40cf-80bc-3f164a3aa054 tempest-ServerRescueNegativeTestJSON-206218324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:50:28 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e0844e5f-6ccb-40cf-80bc-3f164a3aa054 tempest-ServerRescueNegativeTestJSON-206218324 None] Flow 'volume_create_manager' (664c84a8-4daa-42f6-8c6e-8472f25c3802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:50:28 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e0844e5f-6ccb-40cf-80bc-3f164a3aa054 tempest-ServerRescueNegativeTestJSON-206218324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8db285cc-3f25-44a7-a871-b94ced3ce474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:50:28 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e0844e5f-6ccb-40cf-80bc-3f164a3aa054 tempest-ServerRescueNegativeTestJSON-206218324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8db285cc-3f25-44a7-a871-b94ced3ce474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:50:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-47292223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4de35070-8b01-4365-9b40-c1b348609ddd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a75fe8dd2dc8406cb40d16b566590626',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:50:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:50:28Z,use_quota=True,user_id='71d5662829c543fa99c710a11df93b61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:50:28 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e0844e5f-6ccb-40cf-80bc-3f164a3aa054 tempest-ServerRescueNegativeTestJSON-206218324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (910b994e-6bea-41a9-8fb7-947b06b70444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:50:28 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e0844e5f-6ccb-40cf-80bc-3f164a3aa054 tempest-ServerRescueNegativeTestJSON-206218324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (910b994e-6bea-41a9-8fb7-947b06b70444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:50:28 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e0844e5f-6ccb-40cf-80bc-3f164a3aa054 tempest-ServerRescueNegativeTestJSON-206218324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f039423-232a-42ce-9ef7-56862053beb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:50:28 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e0844e5f-6ccb-40cf-80bc-3f164a3aa054 tempest-ServerRescueNegativeTestJSON-206218324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f039423-232a-42ce-9ef7-56862053beb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4de35070-8b01-4365-9b40-c1b348609ddd', 'volume_name': 'volume-4de35070-8b01-4365-9b40-c1b348609ddd', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:50:28 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e0844e5f-6ccb-40cf-80bc-3f164a3aa054 tempest-ServerRescueNegativeTestJSON-206218324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06346aff-ac6e-4f70-930d-d239decca428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:50:28 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e0844e5f-6ccb-40cf-80bc-3f164a3aa054 tempest-ServerRescueNegativeTestJSON-206218324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06346aff-ac6e-4f70-930d-d239decca428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:50:28 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e0844e5f-6ccb-40cf-80bc-3f164a3aa054 tempest-ServerRescueNegativeTestJSON-206218324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a6c67a3-4fd8-4e2d-a22c-43d02296cf68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:50:28 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-e0844e5f-6ccb-40cf-80bc-3f164a3aa054 tempest-ServerRescueNegativeTestJSON-206218324 None] Volume 4de35070-8b01-4365-9b40-c1b348609ddd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4de35070-8b01-4365-9b40-c1b348609ddd', 'volume_size': 1} Jul 30 16:50:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-e0844e5f-6ccb-40cf-80bc-3f164a3aa054 tempest-ServerRescueNegativeTestJSON-206218324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:50:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-e0844e5f-6ccb-40cf-80bc-3f164a3aa054 tempest-ServerRescueNegativeTestJSON-206218324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:50:28 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-e0844e5f-6ccb-40cf-80bc-3f164a3aa054 tempest-ServerRescueNegativeTestJSON-206218324 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:50:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-47292223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4de35070-8b01-4365-9b40-c1b348609ddd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a75fe8dd2dc8406cb40d16b566590626',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:50:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:50:28Z,use_quota=True,user_id='71d5662829c543fa99c710a11df93b61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:50:28 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-e0844e5f-6ccb-40cf-80bc-3f164a3aa054 tempest-ServerRescueNegativeTestJSON-206218324 None] Creating volume 4de35070-8b01-4365-9b40-c1b348609ddd {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:50:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-e0844e5f-6ccb-40cf-80bc-3f164a3aa054 tempest-ServerRescueNegativeTestJSON-206218324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:50:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-e0844e5f-6ccb-40cf-80bc-3f164a3aa054 tempest-ServerRescueNegativeTestJSON-206218324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:50:28 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-e0844e5f-6ccb-40cf-80bc-3f164a3aa054 tempest-ServerRescueNegativeTestJSON-206218324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:50:28 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-e0844e5f-6ccb-40cf-80bc-3f164a3aa054 tempest-ServerRescueNegativeTestJSON-206218324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:50:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-e0844e5f-6ccb-40cf-80bc-3f164a3aa054 tempest-ServerRescueNegativeTestJSON-206218324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:50:28 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-e0844e5f-6ccb-40cf-80bc-3f164a3aa054 tempest-ServerRescueNegativeTestJSON-206218324 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:50:28 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-e0844e5f-6ccb-40cf-80bc-3f164a3aa054 tempest-ServerRescueNegativeTestJSON-206218324 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 16:50:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e0844e5f-6ccb-40cf-80bc-3f164a3aa054 tempest-ServerRescueNegativeTestJSON-206218324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4de35070-8b01-4365-9b40-c1b348609ddd 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:50:28 devstack sudo[89470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4de35070-8b01-4365-9b40-c1b348609ddd 1073741824 Jul 30 16:50:28 devstack sudo[89470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:50:29 devstack sudo[89470]: pam_unix(sudo:session): session closed for user root Jul 30 16:50:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e0844e5f-6ccb-40cf-80bc-3f164a3aa054 tempest-ServerRescueNegativeTestJSON-206218324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4de35070-8b01-4365-9b40-c1b348609ddd 1073741824" returned: 0 in 1.085s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:50:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e0844e5f-6ccb-40cf-80bc-3f164a3aa054 tempest-ServerRescueNegativeTestJSON-206218324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4de35070-8b01-4365-9b40-c1b348609ddd {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:50:29 devstack sudo[89789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4de35070-8b01-4365-9b40-c1b348609ddd Jul 30 16:50:29 devstack sudo[89789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:50:30 devstack sudo[89789]: pam_unix(sudo:session): session closed for user root Jul 30 16:50:30 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e0844e5f-6ccb-40cf-80bc-3f164a3aa054 tempest-ServerRescueNegativeTestJSON-206218324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4de35070-8b01-4365-9b40-c1b348609ddd" returned: 0 in 0.691s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:50:30 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-e0844e5f-6ccb-40cf-80bc-3f164a3aa054 tempest-ServerRescueNegativeTestJSON-206218324 None] <== create_volume: return (1945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:50:30 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-e0844e5f-6ccb-40cf-80bc-3f164a3aa054 tempest-ServerRescueNegativeTestJSON-206218324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.948s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:50:30 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e0844e5f-6ccb-40cf-80bc-3f164a3aa054 tempest-ServerRescueNegativeTestJSON-206218324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a6c67a3-4fd8-4e2d-a22c-43d02296cf68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4de35070-8b01-4365-9b40-c1b348609ddd', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:50:30 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e0844e5f-6ccb-40cf-80bc-3f164a3aa054 tempest-ServerRescueNegativeTestJSON-206218324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d7c13e5-1b94-4425-ba74-88ae7bbb9fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:50:30 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-e0844e5f-6ccb-40cf-80bc-3f164a3aa054 tempest-ServerRescueNegativeTestJSON-206218324 None] Volume volume-4de35070-8b01-4365-9b40-c1b348609ddd (4de35070-8b01-4365-9b40-c1b348609ddd): created successfully Jul 30 16:50:30 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e0844e5f-6ccb-40cf-80bc-3f164a3aa054 tempest-ServerRescueNegativeTestJSON-206218324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d7c13e5-1b94-4425-ba74-88ae7bbb9fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:50:30 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e0844e5f-6ccb-40cf-80bc-3f164a3aa054 tempest-ServerRescueNegativeTestJSON-206218324 None] Flow 'volume_create_manager' (664c84a8-4daa-42f6-8c6e-8472f25c3802) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:50:30 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-e0844e5f-6ccb-40cf-80bc-3f164a3aa054 tempest-ServerRescueNegativeTestJSON-206218324 None] Created volume successfully. Jul 30 16:50:30 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-f91a3e23-b421-4a70-8f3c-ef5b0bb3ee99 tempest-VolumesAdminNegativeTest-1346104181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:50:30 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f91a3e23-b421-4a70-8f3c-ef5b0bb3ee99 tempest-VolumesAdminNegativeTest-1346104181 None] Flow 'volume_create_manager' (60da7849-0df8-4798-b1b0-b0213876f4de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:50:30 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f91a3e23-b421-4a70-8f3c-ef5b0bb3ee99 tempest-VolumesAdminNegativeTest-1346104181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2791f8cd-1996-4371-bd1f-910ae0c23ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:50:30 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f91a3e23-b421-4a70-8f3c-ef5b0bb3ee99 tempest-VolumesAdminNegativeTest-1346104181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2791f8cd-1996-4371-bd1f-910ae0c23ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:50:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-505962208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2646a83-2e06-4d8d-84b2-45e097b2f052,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='076120a922b14a008ad255ee865ef360',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:50:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:50:30Z,use_quota=True,user_id='013abcb990654d6eb620a44d78168760',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:50:30 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f91a3e23-b421-4a70-8f3c-ef5b0bb3ee99 tempest-VolumesAdminNegativeTest-1346104181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7247a007-a033-4c72-9871-38f10156d214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:50:30 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f91a3e23-b421-4a70-8f3c-ef5b0bb3ee99 tempest-VolumesAdminNegativeTest-1346104181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7247a007-a033-4c72-9871-38f10156d214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:50:30 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f91a3e23-b421-4a70-8f3c-ef5b0bb3ee99 tempest-VolumesAdminNegativeTest-1346104181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23723f6e-1ee2-498d-8400-4f01eb1d659d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:50:30 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f91a3e23-b421-4a70-8f3c-ef5b0bb3ee99 tempest-VolumesAdminNegativeTest-1346104181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23723f6e-1ee2-498d-8400-4f01eb1d659d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2646a83-2e06-4d8d-84b2-45e097b2f052', 'volume_name': 'volume-c2646a83-2e06-4d8d-84b2-45e097b2f052', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:50:30 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f91a3e23-b421-4a70-8f3c-ef5b0bb3ee99 tempest-VolumesAdminNegativeTest-1346104181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a73de96c-d688-4328-afc6-0e7ac1af57d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:50:30 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f91a3e23-b421-4a70-8f3c-ef5b0bb3ee99 tempest-VolumesAdminNegativeTest-1346104181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a73de96c-d688-4328-afc6-0e7ac1af57d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:50:30 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f91a3e23-b421-4a70-8f3c-ef5b0bb3ee99 tempest-VolumesAdminNegativeTest-1346104181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e995a9b7-f16f-474b-8932-5b8f7eadd4ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:50:30 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-f91a3e23-b421-4a70-8f3c-ef5b0bb3ee99 tempest-VolumesAdminNegativeTest-1346104181 None] Volume c2646a83-2e06-4d8d-84b2-45e097b2f052: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2646a83-2e06-4d8d-84b2-45e097b2f052', 'volume_size': 1} Jul 30 16:50:30 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-f91a3e23-b421-4a70-8f3c-ef5b0bb3ee99 tempest-VolumesAdminNegativeTest-1346104181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:50:30 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-f91a3e23-b421-4a70-8f3c-ef5b0bb3ee99 tempest-VolumesAdminNegativeTest-1346104181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:50:30 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-f91a3e23-b421-4a70-8f3c-ef5b0bb3ee99 tempest-VolumesAdminNegativeTest-1346104181 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:50:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-505962208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2646a83-2e06-4d8d-84b2-45e097b2f052,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='076120a922b14a008ad255ee865ef360',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:50:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:50:30Z,use_quota=True,user_id='013abcb990654d6eb620a44d78168760',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:50:30 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-f91a3e23-b421-4a70-8f3c-ef5b0bb3ee99 tempest-VolumesAdminNegativeTest-1346104181 None] Creating volume c2646a83-2e06-4d8d-84b2-45e097b2f052 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:50:30 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-f91a3e23-b421-4a70-8f3c-ef5b0bb3ee99 tempest-VolumesAdminNegativeTest-1346104181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:50:30 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-f91a3e23-b421-4a70-8f3c-ef5b0bb3ee99 tempest-VolumesAdminNegativeTest-1346104181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:50:30 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-f91a3e23-b421-4a70-8f3c-ef5b0bb3ee99 tempest-VolumesAdminNegativeTest-1346104181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:50:30 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-f91a3e23-b421-4a70-8f3c-ef5b0bb3ee99 tempest-VolumesAdminNegativeTest-1346104181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:50:30 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-f91a3e23-b421-4a70-8f3c-ef5b0bb3ee99 tempest-VolumesAdminNegativeTest-1346104181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:50:30 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-f91a3e23-b421-4a70-8f3c-ef5b0bb3ee99 tempest-VolumesAdminNegativeTest-1346104181 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:50:30 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-f91a3e23-b421-4a70-8f3c-ef5b0bb3ee99 tempest-VolumesAdminNegativeTest-1346104181 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 16:50:30 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f91a3e23-b421-4a70-8f3c-ef5b0bb3ee99 tempest-VolumesAdminNegativeTest-1346104181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c2646a83-2e06-4d8d-84b2-45e097b2f052 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:50:30 devstack sudo[89793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c2646a83-2e06-4d8d-84b2-45e097b2f052 1073741824 Jul 30 16:50:30 devstack sudo[89793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:50:31 devstack sudo[89793]: pam_unix(sudo:session): session closed for user root Jul 30 16:50:31 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f91a3e23-b421-4a70-8f3c-ef5b0bb3ee99 tempest-VolumesAdminNegativeTest-1346104181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c2646a83-2e06-4d8d-84b2-45e097b2f052 1073741824" returned: 0 in 0.931s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:50:31 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f91a3e23-b421-4a70-8f3c-ef5b0bb3ee99 tempest-VolumesAdminNegativeTest-1346104181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c2646a83-2e06-4d8d-84b2-45e097b2f052 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:50:31 devstack sudo[89799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c2646a83-2e06-4d8d-84b2-45e097b2f052 Jul 30 16:50:31 devstack sudo[89799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:50:32 devstack sudo[89799]: pam_unix(sudo:session): session closed for user root Jul 30 16:50:32 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f91a3e23-b421-4a70-8f3c-ef5b0bb3ee99 tempest-VolumesAdminNegativeTest-1346104181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c2646a83-2e06-4d8d-84b2-45e097b2f052" returned: 0 in 0.589s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:50:32 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-f91a3e23-b421-4a70-8f3c-ef5b0bb3ee99 tempest-VolumesAdminNegativeTest-1346104181 None] <== create_volume: return (1623ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:50:32 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-f91a3e23-b421-4a70-8f3c-ef5b0bb3ee99 tempest-VolumesAdminNegativeTest-1346104181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.630s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:50:32 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f91a3e23-b421-4a70-8f3c-ef5b0bb3ee99 tempest-VolumesAdminNegativeTest-1346104181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e995a9b7-f16f-474b-8932-5b8f7eadd4ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2646a83-2e06-4d8d-84b2-45e097b2f052', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:50:32 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f91a3e23-b421-4a70-8f3c-ef5b0bb3ee99 tempest-VolumesAdminNegativeTest-1346104181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a88f2bb1-89aa-43b6-9e9e-e407b1cf6c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:50:32 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-f91a3e23-b421-4a70-8f3c-ef5b0bb3ee99 tempest-VolumesAdminNegativeTest-1346104181 None] Volume volume-c2646a83-2e06-4d8d-84b2-45e097b2f052 (c2646a83-2e06-4d8d-84b2-45e097b2f052): created successfully Jul 30 16:50:32 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f91a3e23-b421-4a70-8f3c-ef5b0bb3ee99 tempest-VolumesAdminNegativeTest-1346104181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a88f2bb1-89aa-43b6-9e9e-e407b1cf6c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:50:32 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f91a3e23-b421-4a70-8f3c-ef5b0bb3ee99 tempest-VolumesAdminNegativeTest-1346104181 None] Flow 'volume_create_manager' (60da7849-0df8-4798-b1b0-b0213876f4de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:50:32 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-f91a3e23-b421-4a70-8f3c-ef5b0bb3ee99 tempest-VolumesAdminNegativeTest-1346104181 None] Created volume successfully. Jul 30 16:50:34 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-1f8b9685-e7f0-4187-9f4f-af3b7962e04c tempest-VolumesAdminNegativeTest-1346104181 None] Acquiring lock "cinder-c2646a83-2e06-4d8d-84b2-45e097b2f052-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:50:34 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-1f8b9685-e7f0-4187-9f4f-af3b7962e04c tempest-VolumesAdminNegativeTest-1346104181 None] Lock "cinder-c2646a83-2e06-4d8d-84b2-45e097b2f052-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:50:35 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-1f8b9685-e7f0-4187-9f4f-af3b7962e04c tempest-VolumesAdminNegativeTest-1346104181 None] Acquiring lock "cinder-quobyte-c2646a83-2e06-4d8d-84b2-45e097b2f052" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:50:35 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-1f8b9685-e7f0-4187-9f4f-af3b7962e04c tempest-VolumesAdminNegativeTest-1346104181 None] Lock "cinder-quobyte-c2646a83-2e06-4d8d-84b2-45e097b2f052" acquired by "delete_volume" :: waited 0.042s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:50:35 devstack cinder-volume[88568]: INFO oslo.privsep.daemon [None req-1f8b9685-e7f0-4187-9f4f-af3b7962e04c tempest-VolumesAdminNegativeTest-1346104181 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpzz9vsjh9/privsep.sock'] Jul 30 16:50:35 devstack sudo[89831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpzz9vsjh9/privsep.sock Jul 30 16:50:35 devstack sudo[89831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:50:37 devstack cinder-volume[88568]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Jul 30 16:50:37 devstack cinder-volume[88568]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 30 16:50:37 devstack cinder-volume[88568]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 30 16:50:37 devstack cinder-volume[88568]: WARNING oslo.privsep.daemon [-] privsep log: Jul 30 16:50:37 devstack cinder-volume[88568]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 30 16:50:37 devstack cinder-volume[88568]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 30 16:50:37 devstack cinder-volume[88568]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 30 16:50:37 devstack cinder-volume[88568]: WARNING oslo.privsep.daemon [-] privsep log: Jul 30 16:50:37 devstack cinder-volume[88568]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Jul 30 16:50:37 devstack sudo[89831]: pam_unix(sudo:session): session closed for user root Jul 30 16:50:37 devstack cinder-volume[88568]: INFO oslo.privsep.daemon [None req-1f8b9685-e7f0-4187-9f4f-af3b7962e04c tempest-VolumesAdminNegativeTest-1346104181 None] Spawned new privsep daemon via rootwrap Jul 30 16:50:37 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [None req-1f8b9685-e7f0-4187-9f4f-af3b7962e04c tempest-VolumesAdminNegativeTest-1346104181 None] Accepted privsep connection to /tmp/tmpzz9vsjh9/privsep.sock {{(pid=88568) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 30 16:50:37 devstack cinder-volume[88568]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 30 16:50:37 devstack cinder-volume[88568]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 30 16:50:37 devstack cinder-volume[88568]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 30 16:50:37 devstack cinder-volume[88568]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 89882 Jul 30 16:50:37 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b5f9d0-6ede-42d7-a30b-ae0035177568]: (2,) {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:50:37 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eef7386-d224-4f75-bbc6-4519c700c28e]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:50:37 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-1f8b9685-e7f0-4187-9f4f-af3b7962e04c tempest-VolumesAdminNegativeTest-1346104181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c2646a83-2e06-4d8d-84b2-45e097b2f052 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:50:37 devstack sudo[89887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c2646a83-2e06-4d8d-84b2-45e097b2f052 Jul 30 16:50:37 devstack sudo[89887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:50:38 devstack sudo[89887]: pam_unix(sudo:session): session closed for user root Jul 30 16:50:38 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-1f8b9685-e7f0-4187-9f4f-af3b7962e04c tempest-VolumesAdminNegativeTest-1346104181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c2646a83-2e06-4d8d-84b2-45e097b2f052" returned: 0 in 0.933s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:50:38 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-1f8b9685-e7f0-4187-9f4f-af3b7962e04c tempest-VolumesAdminNegativeTest-1346104181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c2646a83-2e06-4d8d-84b2-45e097b2f052 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:50:38 devstack sudo[89899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c2646a83-2e06-4d8d-84b2-45e097b2f052 Jul 30 16:50:38 devstack sudo[89899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:50:39 devstack sudo[89899]: pam_unix(sudo:session): session closed for user root Jul 30 16:50:39 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-1f8b9685-e7f0-4187-9f4f-af3b7962e04c tempest-VolumesAdminNegativeTest-1346104181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c2646a83-2e06-4d8d-84b2-45e097b2f052" returned: 0 in 0.646s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:50:39 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-1f8b9685-e7f0-4187-9f4f-af3b7962e04c tempest-VolumesAdminNegativeTest-1346104181 None] Lock "cinder-quobyte-c2646a83-2e06-4d8d-84b2-45e097b2f052" released by "delete_volume" :: held 4.226s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:50:39 devstack cinder-volume[88568]: WARNING cinder.quota [None req-1f8b9685-e7f0-4187-9f4f-af3b7962e04c tempest-VolumesAdminNegativeTest-1346104181 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:50:39 devstack cinder-volume[88568]: WARNING cinder.quota [None req-1f8b9685-e7f0-4187-9f4f-af3b7962e04c tempest-VolumesAdminNegativeTest-1346104181 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:50:39 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-1f8b9685-e7f0-4187-9f4f-af3b7962e04c tempest-VolumesAdminNegativeTest-1346104181 None] Created reservations ['00f6f88e-0133-4b83-adfe-c3e0b296412e', '2cc32af1-6a4f-4c56-a163-32f287141e8f', '57575885-50de-4a24-9c3b-a83947a756f2', '4853ec21-fdf0-4eb8-92a6-1ee13d2024f4'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:50:39 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-1f8b9685-e7f0-4187-9f4f-af3b7962e04c tempest-VolumesAdminNegativeTest-1346104181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:50:39 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-1f8b9685-e7f0-4187-9f4f-af3b7962e04c tempest-VolumesAdminNegativeTest-1346104181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:50:39 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-1f8b9685-e7f0-4187-9f4f-af3b7962e04c tempest-VolumesAdminNegativeTest-1346104181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:50:39 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-1f8b9685-e7f0-4187-9f4f-af3b7962e04c tempest-VolumesAdminNegativeTest-1346104181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:50:39 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-1f8b9685-e7f0-4187-9f4f-af3b7962e04c tempest-VolumesAdminNegativeTest-1346104181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:50:39 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-1f8b9685-e7f0-4187-9f4f-af3b7962e04c tempest-VolumesAdminNegativeTest-1346104181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:50:39 devstack sudo[89902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:50:39 devstack sudo[89902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:50:40 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a31ecd5-3ae9-4421-b574-e5e1d4e68ab9 tempest-AttachVolumeTestJSON-1381673265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:50:40 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9a31ecd5-3ae9-4421-b574-e5e1d4e68ab9 tempest-AttachVolumeTestJSON-1381673265 None] Flow 'volume_create_manager' (b2618d5b-e71c-4645-a90f-98d6386d443a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:50:40 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9a31ecd5-3ae9-4421-b574-e5e1d4e68ab9 tempest-AttachVolumeTestJSON-1381673265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faa0f586-fd3d-4687-8be5-6084b362cf3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:50:40 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9a31ecd5-3ae9-4421-b574-e5e1d4e68ab9 tempest-AttachVolumeTestJSON-1381673265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faa0f586-fd3d-4687-8be5-6084b362cf3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:50:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1152507814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c3eee41-cff8-4afb-9fca-332790f73f54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b219135d1cf44e32a38d2e55a15cc768',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:50:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:50:40Z,use_quota=True,user_id='0f5f98258baf41b7980b7f1e7e487bdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:50:40 devstack sudo[89902]: pam_unix(sudo:session): session closed for user root Jul 30 16:50:40 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9a31ecd5-3ae9-4421-b574-e5e1d4e68ab9 tempest-AttachVolumeTestJSON-1381673265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05020664-b887-4ad5-b662-3764ea36b203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:50:40 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9a31ecd5-3ae9-4421-b574-e5e1d4e68ab9 tempest-AttachVolumeTestJSON-1381673265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05020664-b887-4ad5-b662-3764ea36b203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:50:40 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9a31ecd5-3ae9-4421-b574-e5e1d4e68ab9 tempest-AttachVolumeTestJSON-1381673265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00332d30-f005-4de1-b948-f36f5b9a723b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:50:40 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9a31ecd5-3ae9-4421-b574-e5e1d4e68ab9 tempest-AttachVolumeTestJSON-1381673265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00332d30-f005-4de1-b948-f36f5b9a723b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c3eee41-cff8-4afb-9fca-332790f73f54', 'volume_name': 'volume-2c3eee41-cff8-4afb-9fca-332790f73f54', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:50:40 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9a31ecd5-3ae9-4421-b574-e5e1d4e68ab9 tempest-AttachVolumeTestJSON-1381673265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fde05ee-e0ee-4979-b24c-f2b31c275461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:50:40 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9a31ecd5-3ae9-4421-b574-e5e1d4e68ab9 tempest-AttachVolumeTestJSON-1381673265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fde05ee-e0ee-4979-b24c-f2b31c275461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:50:40 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9a31ecd5-3ae9-4421-b574-e5e1d4e68ab9 tempest-AttachVolumeTestJSON-1381673265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00645cf8-67fb-41da-b9de-170bbe03c9ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:50:40 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-9a31ecd5-3ae9-4421-b574-e5e1d4e68ab9 tempest-AttachVolumeTestJSON-1381673265 None] Volume 2c3eee41-cff8-4afb-9fca-332790f73f54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c3eee41-cff8-4afb-9fca-332790f73f54', 'volume_size': 1} Jul 30 16:50:40 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-9a31ecd5-3ae9-4421-b574-e5e1d4e68ab9 tempest-AttachVolumeTestJSON-1381673265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:50:40 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-9a31ecd5-3ae9-4421-b574-e5e1d4e68ab9 tempest-AttachVolumeTestJSON-1381673265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:50:40 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-9a31ecd5-3ae9-4421-b574-e5e1d4e68ab9 tempest-AttachVolumeTestJSON-1381673265 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:50:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1152507814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c3eee41-cff8-4afb-9fca-332790f73f54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b219135d1cf44e32a38d2e55a15cc768',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:50:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:50:40Z,use_quota=True,user_id='0f5f98258baf41b7980b7f1e7e487bdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:50:40 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-9a31ecd5-3ae9-4421-b574-e5e1d4e68ab9 tempest-AttachVolumeTestJSON-1381673265 None] Creating volume 2c3eee41-cff8-4afb-9fca-332790f73f54 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:50:40 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-9a31ecd5-3ae9-4421-b574-e5e1d4e68ab9 tempest-AttachVolumeTestJSON-1381673265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:50:40 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-9a31ecd5-3ae9-4421-b574-e5e1d4e68ab9 tempest-AttachVolumeTestJSON-1381673265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:50:40 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-9a31ecd5-3ae9-4421-b574-e5e1d4e68ab9 tempest-AttachVolumeTestJSON-1381673265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:50:40 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-9a31ecd5-3ae9-4421-b574-e5e1d4e68ab9 tempest-AttachVolumeTestJSON-1381673265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:50:40 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-9a31ecd5-3ae9-4421-b574-e5e1d4e68ab9 tempest-AttachVolumeTestJSON-1381673265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:50:40 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-9a31ecd5-3ae9-4421-b574-e5e1d4e68ab9 tempest-AttachVolumeTestJSON-1381673265 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:50:40 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-9a31ecd5-3ae9-4421-b574-e5e1d4e68ab9 tempest-AttachVolumeTestJSON-1381673265 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 16:50:40 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9a31ecd5-3ae9-4421-b574-e5e1d4e68ab9 tempest-AttachVolumeTestJSON-1381673265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2c3eee41-cff8-4afb-9fca-332790f73f54 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:50:40 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-1f8b9685-e7f0-4187-9f4f-af3b7962e04c tempest-VolumesAdminNegativeTest-1346104181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.998s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:50:40 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-1f8b9685-e7f0-4187-9f4f-af3b7962e04c tempest-VolumesAdminNegativeTest-1346104181 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:50:40 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-1f8b9685-e7f0-4187-9f4f-af3b7962e04c tempest-VolumesAdminNegativeTest-1346104181 None] Deleted volume successfully. Jul 30 16:50:40 devstack sudo[89907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2c3eee41-cff8-4afb-9fca-332790f73f54 1073741824 Jul 30 16:50:40 devstack sudo[89907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:50:40 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-1f8b9685-e7f0-4187-9f4f-af3b7962e04c tempest-VolumesAdminNegativeTest-1346104181 None] Lock "cinder-c2646a83-2e06-4d8d-84b2-45e097b2f052-delete_volume" released by "delete_volume" :: held 5.925s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:50:41 devstack sudo[89907]: pam_unix(sudo:session): session closed for user root Jul 30 16:50:41 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9a31ecd5-3ae9-4421-b574-e5e1d4e68ab9 tempest-AttachVolumeTestJSON-1381673265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2c3eee41-cff8-4afb-9fca-332790f73f54 1073741824" returned: 0 in 1.085s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:50:41 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9a31ecd5-3ae9-4421-b574-e5e1d4e68ab9 tempest-AttachVolumeTestJSON-1381673265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2c3eee41-cff8-4afb-9fca-332790f73f54 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:50:41 devstack sudo[89939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2c3eee41-cff8-4afb-9fca-332790f73f54 Jul 30 16:50:41 devstack sudo[89939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:50:42 devstack sudo[89939]: pam_unix(sudo:session): session closed for user root Jul 30 16:50:42 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9a31ecd5-3ae9-4421-b574-e5e1d4e68ab9 tempest-AttachVolumeTestJSON-1381673265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2c3eee41-cff8-4afb-9fca-332790f73f54" returned: 0 in 0.563s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:50:42 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-9a31ecd5-3ae9-4421-b574-e5e1d4e68ab9 tempest-AttachVolumeTestJSON-1381673265 None] <== create_volume: return (1763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:50:42 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-9a31ecd5-3ae9-4421-b574-e5e1d4e68ab9 tempest-AttachVolumeTestJSON-1381673265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.770s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:50:42 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9a31ecd5-3ae9-4421-b574-e5e1d4e68ab9 tempest-AttachVolumeTestJSON-1381673265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00645cf8-67fb-41da-b9de-170bbe03c9ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c3eee41-cff8-4afb-9fca-332790f73f54', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:50:42 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9a31ecd5-3ae9-4421-b574-e5e1d4e68ab9 tempest-AttachVolumeTestJSON-1381673265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2113239-4ade-4e48-9ec2-28c5381e5bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:50:42 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-9a31ecd5-3ae9-4421-b574-e5e1d4e68ab9 tempest-AttachVolumeTestJSON-1381673265 None] Volume volume-2c3eee41-cff8-4afb-9fca-332790f73f54 (2c3eee41-cff8-4afb-9fca-332790f73f54): created successfully Jul 30 16:50:42 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9a31ecd5-3ae9-4421-b574-e5e1d4e68ab9 tempest-AttachVolumeTestJSON-1381673265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2113239-4ade-4e48-9ec2-28c5381e5bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:50:42 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9a31ecd5-3ae9-4421-b574-e5e1d4e68ab9 tempest-AttachVolumeTestJSON-1381673265 None] Flow 'volume_create_manager' (b2618d5b-e71c-4645-a90f-98d6386d443a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:50:42 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-9a31ecd5-3ae9-4421-b574-e5e1d4e68ab9 tempest-AttachVolumeTestJSON-1381673265 None] Created volume successfully. Jul 30 16:50:48 devstack cinder-volume[88568]: WARNING py.warnings [req-10797383-89ed-458e-a407-82c9eca2781d req-b3a8d3a6-15a6-47fa-bb76-6fe13d0f3c9c tempest-AttachVolumeTestJSON-1381673265 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Jul 30 16:50:48 devstack cinder-volume[88568]: .first() Jul 30 16:50:48 devstack cinder-volume[88568]: Jul 30 16:50:48 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-10797383-89ed-458e-a407-82c9eca2781d req-b3a8d3a6-15a6-47fa-bb76-6fe13d0f3c9c tempest-AttachVolumeTestJSON-1381673265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:50:48 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-10797383-89ed-458e-a407-82c9eca2781d req-b3a8d3a6-15a6-47fa-bb76-6fe13d0f3c9c tempest-AttachVolumeTestJSON-1381673265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:50:48 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-10797383-89ed-458e-a407-82c9eca2781d req-b3a8d3a6-15a6-47fa-bb76-6fe13d0f3c9c tempest-AttachVolumeTestJSON-1381673265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:50:48 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [req-10797383-89ed-458e-a407-82c9eca2781d req-b3a8d3a6-15a6-47fa-bb76-6fe13d0f3c9c tempest-AttachVolumeTestJSON-1381673265 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924', 'name': 'volume-2c3eee41-cff8-4afb-9fca-332790f73f54', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e1c0b083-6826-43e6-b075-9e2ff01edd9f', 'enforce_multipath': True} {{(pid=88568) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 16:50:48 devstack cinder-volume[88568]: INFO cinder.volume.manager [req-10797383-89ed-458e-a407-82c9eca2781d req-b3a8d3a6-15a6-47fa-bb76-6fe13d0f3c9c tempest-AttachVolumeTestJSON-1381673265 None] attachment_update completed successfully. Jul 30 16:50:52 devstack cinder-volume[88568]: DEBUG oslo_service.periodic_task [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:50:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:50:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:50:52 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:50:52 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:50:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:50:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:50:52 devstack sudo[90450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:50:52 devstack sudo[90450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:50:53 devstack sudo[90450]: pam_unix(sudo:session): session closed for user root Jul 30 16:50:53 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.488s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:50:53 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:50:53 devstack cinder-volume[88568]: DEBUG oslo_service.periodic_task [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Running periodic task VolumeManager._thread_info {{(pid=88568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:50:53 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] thread count: 8 {{(pid=88568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:50:53 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] thread info: [<_MainThread(MainThread, started 127406866608256)>, , , , , , , ] {{(pid=88568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:50:55 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-e8011797-045f-4431-8f33-3a9e34a9cc12 tempest-ServerRescueNegativeTestJSON-206218324 None] Acquiring lock "cinder-4de35070-8b01-4365-9b40-c1b348609ddd-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:50:55 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-e8011797-045f-4431-8f33-3a9e34a9cc12 tempest-ServerRescueNegativeTestJSON-206218324 None] Lock "cinder-4de35070-8b01-4365-9b40-c1b348609ddd-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:50:56 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-e8011797-045f-4431-8f33-3a9e34a9cc12 tempest-ServerRescueNegativeTestJSON-206218324 None] Acquiring lock "cinder-quobyte-4de35070-8b01-4365-9b40-c1b348609ddd" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:50:56 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-e8011797-045f-4431-8f33-3a9e34a9cc12 tempest-ServerRescueNegativeTestJSON-206218324 None] Lock "cinder-quobyte-4de35070-8b01-4365-9b40-c1b348609ddd" acquired by "delete_volume" :: waited 0.041s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:50:56 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[c66a1625-350a-415f-a688-aca69c479f73]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:50:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e8011797-045f-4431-8f33-3a9e34a9cc12 tempest-ServerRescueNegativeTestJSON-206218324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4de35070-8b01-4365-9b40-c1b348609ddd {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:50:56 devstack sudo[90454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4de35070-8b01-4365-9b40-c1b348609ddd Jul 30 16:50:56 devstack sudo[90454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:50:56 devstack sudo[90454]: pam_unix(sudo:session): session closed for user root Jul 30 16:50:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e8011797-045f-4431-8f33-3a9e34a9cc12 tempest-ServerRescueNegativeTestJSON-206218324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4de35070-8b01-4365-9b40-c1b348609ddd" returned: 0 in 0.743s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:50:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e8011797-045f-4431-8f33-3a9e34a9cc12 tempest-ServerRescueNegativeTestJSON-206218324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4de35070-8b01-4365-9b40-c1b348609ddd {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:50:56 devstack sudo[90462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4de35070-8b01-4365-9b40-c1b348609ddd Jul 30 16:50:56 devstack sudo[90462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:50:57 devstack sudo[90462]: pam_unix(sudo:session): session closed for user root Jul 30 16:50:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e8011797-045f-4431-8f33-3a9e34a9cc12 tempest-ServerRescueNegativeTestJSON-206218324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4de35070-8b01-4365-9b40-c1b348609ddd" returned: 0 in 0.447s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:50:57 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-e8011797-045f-4431-8f33-3a9e34a9cc12 tempest-ServerRescueNegativeTestJSON-206218324 None] Lock "cinder-quobyte-4de35070-8b01-4365-9b40-c1b348609ddd" released by "delete_volume" :: held 1.255s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:50:57 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-e8011797-045f-4431-8f33-3a9e34a9cc12 tempest-ServerRescueNegativeTestJSON-206218324 None] Created reservations ['7f7c38f8-0cf1-473f-a2df-f95b6f0b7277', '0bae4644-ff79-4267-904d-3fdaff2d1f30', '92d57f48-d9ed-48eb-a1c1-8c229872ee75', '4f368649-d71f-4825-8735-9dce7b46c065'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:50:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-e8011797-045f-4431-8f33-3a9e34a9cc12 tempest-ServerRescueNegativeTestJSON-206218324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:50:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-e8011797-045f-4431-8f33-3a9e34a9cc12 tempest-ServerRescueNegativeTestJSON-206218324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:50:57 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-e8011797-045f-4431-8f33-3a9e34a9cc12 tempest-ServerRescueNegativeTestJSON-206218324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:50:57 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-e8011797-045f-4431-8f33-3a9e34a9cc12 tempest-ServerRescueNegativeTestJSON-206218324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:50:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-e8011797-045f-4431-8f33-3a9e34a9cc12 tempest-ServerRescueNegativeTestJSON-206218324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:50:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e8011797-045f-4431-8f33-3a9e34a9cc12 tempest-ServerRescueNegativeTestJSON-206218324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:50:57 devstack sudo[90467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:50:57 devstack sudo[90467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:50:58 devstack sudo[90467]: pam_unix(sudo:session): session closed for user root Jul 30 16:50:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e8011797-045f-4431-8f33-3a9e34a9cc12 tempest-ServerRescueNegativeTestJSON-206218324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.480s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:50:58 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-e8011797-045f-4431-8f33-3a9e34a9cc12 tempest-ServerRescueNegativeTestJSON-206218324 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:50:58 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-e8011797-045f-4431-8f33-3a9e34a9cc12 tempest-ServerRescueNegativeTestJSON-206218324 None] Deleted volume successfully. Jul 30 16:50:58 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-e8011797-045f-4431-8f33-3a9e34a9cc12 tempest-ServerRescueNegativeTestJSON-206218324 None] Lock "cinder-4de35070-8b01-4365-9b40-c1b348609ddd-delete_volume" released by "delete_volume" :: held 2.251s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:51:07 devstack cinder-volume[88568]: DEBUG dbcounter [-] [88568] Writing DB stats cinder:SELECT=28,cinder:UPDATE=25,cinder:DELETE=2,cinder:INSERT=3 {{(pid=88568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:51:08 devstack cinder-volume[88568]: DEBUG dbcounter [-] [88568] Writing DB stats cinder:SELECT=18,cinder:INSERT=8,cinder:UPDATE=29,cinder:DELETE=3 {{(pid=88568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:51:17 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-48ceea56-d7d4-4a43-97e9-2a9c40df1f42 tempest-TaggedAttachmentsTest-385345408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:51:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-48ceea56-d7d4-4a43-97e9-2a9c40df1f42 tempest-TaggedAttachmentsTest-385345408 None] Flow 'volume_create_manager' (2a51a2d5-2631-4fdc-948d-535b55f8ebdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:51:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-48ceea56-d7d4-4a43-97e9-2a9c40df1f42 tempest-TaggedAttachmentsTest-385345408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a161d4dc-b1bd-4f7d-a59b-86b57d0881fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:51:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-48ceea56-d7d4-4a43-97e9-2a9c40df1f42 tempest-TaggedAttachmentsTest-385345408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a161d4dc-b1bd-4f7d-a59b-86b57d0881fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:51:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-614244021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9140023-a73b-41d1-b687-fb56fc17ffd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22bfb7c13d5240dba46ae299726de428',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:51:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:51:17Z,use_quota=True,user_id='2868ad377b214732939ae01b91a8e948',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:51:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-48ceea56-d7d4-4a43-97e9-2a9c40df1f42 tempest-TaggedAttachmentsTest-385345408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09cb29cb-ad75-45cf-b2ac-1206ccdf701f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:51:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-48ceea56-d7d4-4a43-97e9-2a9c40df1f42 tempest-TaggedAttachmentsTest-385345408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09cb29cb-ad75-45cf-b2ac-1206ccdf701f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:51:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-48ceea56-d7d4-4a43-97e9-2a9c40df1f42 tempest-TaggedAttachmentsTest-385345408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e105667b-3f21-4ca6-bd41-0260f3fdf592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:51:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-48ceea56-d7d4-4a43-97e9-2a9c40df1f42 tempest-TaggedAttachmentsTest-385345408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e105667b-3f21-4ca6-bd41-0260f3fdf592) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9140023-a73b-41d1-b687-fb56fc17ffd8', 'volume_name': 'volume-a9140023-a73b-41d1-b687-fb56fc17ffd8', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:51:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-48ceea56-d7d4-4a43-97e9-2a9c40df1f42 tempest-TaggedAttachmentsTest-385345408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d25e5095-510a-44c0-a03f-a793ae22845b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:51:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-48ceea56-d7d4-4a43-97e9-2a9c40df1f42 tempest-TaggedAttachmentsTest-385345408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d25e5095-510a-44c0-a03f-a793ae22845b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:51:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-48ceea56-d7d4-4a43-97e9-2a9c40df1f42 tempest-TaggedAttachmentsTest-385345408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1c485f7-5f8e-4557-a578-a893426b19b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:51:17 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-48ceea56-d7d4-4a43-97e9-2a9c40df1f42 tempest-TaggedAttachmentsTest-385345408 None] Volume a9140023-a73b-41d1-b687-fb56fc17ffd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9140023-a73b-41d1-b687-fb56fc17ffd8', 'volume_size': 1} Jul 30 16:51:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-48ceea56-d7d4-4a43-97e9-2a9c40df1f42 tempest-TaggedAttachmentsTest-385345408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:51:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-48ceea56-d7d4-4a43-97e9-2a9c40df1f42 tempest-TaggedAttachmentsTest-385345408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:51:17 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-48ceea56-d7d4-4a43-97e9-2a9c40df1f42 tempest-TaggedAttachmentsTest-385345408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:51:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-614244021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9140023-a73b-41d1-b687-fb56fc17ffd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22bfb7c13d5240dba46ae299726de428',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:51:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:51:17Z,use_quota=True,user_id='2868ad377b214732939ae01b91a8e948',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:51:17 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-48ceea56-d7d4-4a43-97e9-2a9c40df1f42 tempest-TaggedAttachmentsTest-385345408 None] Creating volume a9140023-a73b-41d1-b687-fb56fc17ffd8 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:51:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-48ceea56-d7d4-4a43-97e9-2a9c40df1f42 tempest-TaggedAttachmentsTest-385345408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:51:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-48ceea56-d7d4-4a43-97e9-2a9c40df1f42 tempest-TaggedAttachmentsTest-385345408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:51:17 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-48ceea56-d7d4-4a43-97e9-2a9c40df1f42 tempest-TaggedAttachmentsTest-385345408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:51:17 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-48ceea56-d7d4-4a43-97e9-2a9c40df1f42 tempest-TaggedAttachmentsTest-385345408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:51:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-48ceea56-d7d4-4a43-97e9-2a9c40df1f42 tempest-TaggedAttachmentsTest-385345408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:51:17 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-48ceea56-d7d4-4a43-97e9-2a9c40df1f42 tempest-TaggedAttachmentsTest-385345408 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:51:17 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-48ceea56-d7d4-4a43-97e9-2a9c40df1f42 tempest-TaggedAttachmentsTest-385345408 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 16:51:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-48ceea56-d7d4-4a43-97e9-2a9c40df1f42 tempest-TaggedAttachmentsTest-385345408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-a9140023-a73b-41d1-b687-fb56fc17ffd8 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:51:17 devstack sudo[91081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-a9140023-a73b-41d1-b687-fb56fc17ffd8 1073741824 Jul 30 16:51:17 devstack sudo[91081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:51:17 devstack sudo[91081]: pam_unix(sudo:session): session closed for user root Jul 30 16:51:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-48ceea56-d7d4-4a43-97e9-2a9c40df1f42 tempest-TaggedAttachmentsTest-385345408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-a9140023-a73b-41d1-b687-fb56fc17ffd8 1073741824" returned: 0 in 0.660s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:51:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-48ceea56-d7d4-4a43-97e9-2a9c40df1f42 tempest-TaggedAttachmentsTest-385345408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-a9140023-a73b-41d1-b687-fb56fc17ffd8 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:51:18 devstack sudo[91087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-a9140023-a73b-41d1-b687-fb56fc17ffd8 Jul 30 16:51:18 devstack sudo[91087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:51:18 devstack sudo[91087]: pam_unix(sudo:session): session closed for user root Jul 30 16:51:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-48ceea56-d7d4-4a43-97e9-2a9c40df1f42 tempest-TaggedAttachmentsTest-385345408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-a9140023-a73b-41d1-b687-fb56fc17ffd8" returned: 0 in 0.297s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:51:18 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-48ceea56-d7d4-4a43-97e9-2a9c40df1f42 tempest-TaggedAttachmentsTest-385345408 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:51:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-48ceea56-d7d4-4a43-97e9-2a9c40df1f42 tempest-TaggedAttachmentsTest-385345408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:51:18 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-48ceea56-d7d4-4a43-97e9-2a9c40df1f42 tempest-TaggedAttachmentsTest-385345408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1c485f7-5f8e-4557-a578-a893426b19b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9140023-a73b-41d1-b687-fb56fc17ffd8', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:51:18 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-48ceea56-d7d4-4a43-97e9-2a9c40df1f42 tempest-TaggedAttachmentsTest-385345408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aa241d6-4863-4ee9-97f7-31f3b0dd96f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:51:18 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-48ceea56-d7d4-4a43-97e9-2a9c40df1f42 tempest-TaggedAttachmentsTest-385345408 None] Volume volume-a9140023-a73b-41d1-b687-fb56fc17ffd8 (a9140023-a73b-41d1-b687-fb56fc17ffd8): created successfully Jul 30 16:51:18 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-48ceea56-d7d4-4a43-97e9-2a9c40df1f42 tempest-TaggedAttachmentsTest-385345408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aa241d6-4863-4ee9-97f7-31f3b0dd96f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:51:18 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-48ceea56-d7d4-4a43-97e9-2a9c40df1f42 tempest-TaggedAttachmentsTest-385345408 None] Flow 'volume_create_manager' (2a51a2d5-2631-4fdc-948d-535b55f8ebdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:51:18 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-48ceea56-d7d4-4a43-97e9-2a9c40df1f42 tempest-TaggedAttachmentsTest-385345408 None] Created volume successfully. Jul 30 16:51:28 devstack cinder-volume[88568]: DEBUG dbcounter [-] [88568] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2,cinder:INSERT=1 {{(pid=88568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:51:28 devstack cinder-volume[88568]: DEBUG dbcounter [-] [88568] Writing DB stats cinder:UPDATE=4,cinder:SELECT=2,cinder:DELETE=1 {{(pid=88568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:51:40 devstack cinder-volume[88568]: INFO cinder.volume.manager [req-57219d3c-79a5-439f-bc1f-a0b4b01e17f0 req-ec8901b7-2236-4e2b-91f3-b81ecadcc0d0 tempest-AttachVolumeTestJSON-1381673265 None] Terminate volume connection completed successfully. Jul 30 16:51:40 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [req-57219d3c-79a5-439f-bc1f-a0b4b01e17f0 req-ec8901b7-2236-4e2b-91f3-b81ecadcc0d0 tempest-AttachVolumeTestJSON-1381673265 None] Deleting attachment e1c0b083-6826-43e6-b075-9e2ff01edd9f. {{(pid=88568) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 16:51:50 devstack cinder-volume[88568]: DEBUG dbcounter [-] [88568] Writing DB stats cinder:SELECT=1 {{(pid=88568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:51:50 devstack cinder-volume[88568]: DEBUG dbcounter [-] [88568] Writing DB stats cinder:SELECT=1 {{(pid=88568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:51:52 devstack cinder-volume[88568]: DEBUG oslo_service.periodic_task [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:51:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:51:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:51:52 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:51:52 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:51:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:51:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:51:52 devstack sudo[91434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:51:52 devstack sudo[91434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:51:53 devstack sudo[91434]: pam_unix(sudo:session): session closed for user root Jul 30 16:51:53 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 1.239s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:51:53 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:51:53 devstack cinder-volume[88568]: DEBUG oslo_service.periodic_task [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Running periodic task VolumeManager._thread_info {{(pid=88568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:51:53 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] thread count: 8 {{(pid=88568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:51:53 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] thread info: [<_MainThread(MainThread, started 127406866608256)>, , , , , , , ] {{(pid=88568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:52:01 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-28784a64-1ecd-4c82-8bee-aa695199e571 tempest-DeleteServersTestJSON-1441602235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:52:01 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-28784a64-1ecd-4c82-8bee-aa695199e571 tempest-DeleteServersTestJSON-1441602235 None] Flow 'volume_create_manager' (92026359-c524-4a62-862c-3c93c1d60c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:52:01 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-28784a64-1ecd-4c82-8bee-aa695199e571 tempest-DeleteServersTestJSON-1441602235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff4c2fb8-b663-459f-918f-b524287ceaec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:52:01 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-28784a64-1ecd-4c82-8bee-aa695199e571 tempest-DeleteServersTestJSON-1441602235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff4c2fb8-b663-459f-918f-b524287ceaec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:52:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-991399462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcd3f3eb-e673-4f57-b9b7-6ea64d897c3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47c8ef39581045d988a3698f4805afc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:52:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:52:01Z,use_quota=True,user_id='470f51e9a6884c8e81d754d704f5d6ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:52:01 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-28784a64-1ecd-4c82-8bee-aa695199e571 tempest-DeleteServersTestJSON-1441602235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (428f329e-b8d5-4a91-937f-c41b9ef6177d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:52:01 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-28784a64-1ecd-4c82-8bee-aa695199e571 tempest-DeleteServersTestJSON-1441602235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (428f329e-b8d5-4a91-937f-c41b9ef6177d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:52:01 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-28784a64-1ecd-4c82-8bee-aa695199e571 tempest-DeleteServersTestJSON-1441602235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f690854c-b956-476f-91f2-a6a6680c5fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:52:01 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-28784a64-1ecd-4c82-8bee-aa695199e571 tempest-DeleteServersTestJSON-1441602235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f690854c-b956-476f-91f2-a6a6680c5fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcd3f3eb-e673-4f57-b9b7-6ea64d897c3f', 'volume_name': 'volume-fcd3f3eb-e673-4f57-b9b7-6ea64d897c3f', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:52:01 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-28784a64-1ecd-4c82-8bee-aa695199e571 tempest-DeleteServersTestJSON-1441602235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (420b46cd-ac7a-4015-97bd-f06432d0531f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:52:01 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-28784a64-1ecd-4c82-8bee-aa695199e571 tempest-DeleteServersTestJSON-1441602235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (420b46cd-ac7a-4015-97bd-f06432d0531f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:52:01 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-28784a64-1ecd-4c82-8bee-aa695199e571 tempest-DeleteServersTestJSON-1441602235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9602ad4a-78b0-4356-a95e-b7051b6fd55b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:52:01 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-28784a64-1ecd-4c82-8bee-aa695199e571 tempest-DeleteServersTestJSON-1441602235 None] Volume fcd3f3eb-e673-4f57-b9b7-6ea64d897c3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcd3f3eb-e673-4f57-b9b7-6ea64d897c3f', 'volume_size': 1} Jul 30 16:52:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-28784a64-1ecd-4c82-8bee-aa695199e571 tempest-DeleteServersTestJSON-1441602235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:52:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-28784a64-1ecd-4c82-8bee-aa695199e571 tempest-DeleteServersTestJSON-1441602235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:52:01 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-28784a64-1ecd-4c82-8bee-aa695199e571 tempest-DeleteServersTestJSON-1441602235 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:52:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-991399462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcd3f3eb-e673-4f57-b9b7-6ea64d897c3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47c8ef39581045d988a3698f4805afc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:52:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:52:01Z,use_quota=True,user_id='470f51e9a6884c8e81d754d704f5d6ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:52:01 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-28784a64-1ecd-4c82-8bee-aa695199e571 tempest-DeleteServersTestJSON-1441602235 None] Creating volume fcd3f3eb-e673-4f57-b9b7-6ea64d897c3f {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:52:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-28784a64-1ecd-4c82-8bee-aa695199e571 tempest-DeleteServersTestJSON-1441602235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:52:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-28784a64-1ecd-4c82-8bee-aa695199e571 tempest-DeleteServersTestJSON-1441602235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:52:01 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-28784a64-1ecd-4c82-8bee-aa695199e571 tempest-DeleteServersTestJSON-1441602235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:52:01 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-28784a64-1ecd-4c82-8bee-aa695199e571 tempest-DeleteServersTestJSON-1441602235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:52:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-28784a64-1ecd-4c82-8bee-aa695199e571 tempest-DeleteServersTestJSON-1441602235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:52:01 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-28784a64-1ecd-4c82-8bee-aa695199e571 tempest-DeleteServersTestJSON-1441602235 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:52:01 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-28784a64-1ecd-4c82-8bee-aa695199e571 tempest-DeleteServersTestJSON-1441602235 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 16:52:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-28784a64-1ecd-4c82-8bee-aa695199e571 tempest-DeleteServersTestJSON-1441602235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fcd3f3eb-e673-4f57-b9b7-6ea64d897c3f 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:52:01 devstack sudo[91664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fcd3f3eb-e673-4f57-b9b7-6ea64d897c3f 1073741824 Jul 30 16:52:01 devstack sudo[91664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:52:02 devstack sudo[91664]: pam_unix(sudo:session): session closed for user root Jul 30 16:52:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-28784a64-1ecd-4c82-8bee-aa695199e571 tempest-DeleteServersTestJSON-1441602235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fcd3f3eb-e673-4f57-b9b7-6ea64d897c3f 1073741824" returned: 0 in 1.082s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:52:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-28784a64-1ecd-4c82-8bee-aa695199e571 tempest-DeleteServersTestJSON-1441602235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fcd3f3eb-e673-4f57-b9b7-6ea64d897c3f {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:52:02 devstack sudo[91672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fcd3f3eb-e673-4f57-b9b7-6ea64d897c3f Jul 30 16:52:02 devstack sudo[91672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:52:03 devstack sudo[91672]: pam_unix(sudo:session): session closed for user root Jul 30 16:52:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-28784a64-1ecd-4c82-8bee-aa695199e571 tempest-DeleteServersTestJSON-1441602235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fcd3f3eb-e673-4f57-b9b7-6ea64d897c3f" returned: 0 in 0.677s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:52:03 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-28784a64-1ecd-4c82-8bee-aa695199e571 tempest-DeleteServersTestJSON-1441602235 None] <== create_volume: return (1840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:52:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-28784a64-1ecd-4c82-8bee-aa695199e571 tempest-DeleteServersTestJSON-1441602235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.843s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:52:03 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-28784a64-1ecd-4c82-8bee-aa695199e571 tempest-DeleteServersTestJSON-1441602235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9602ad4a-78b0-4356-a95e-b7051b6fd55b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcd3f3eb-e673-4f57-b9b7-6ea64d897c3f', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:52:03 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-28784a64-1ecd-4c82-8bee-aa695199e571 tempest-DeleteServersTestJSON-1441602235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91587ffa-50c2-4f81-9a68-01e237d4d977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:52:03 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-28784a64-1ecd-4c82-8bee-aa695199e571 tempest-DeleteServersTestJSON-1441602235 None] Volume volume-fcd3f3eb-e673-4f57-b9b7-6ea64d897c3f (fcd3f3eb-e673-4f57-b9b7-6ea64d897c3f): created successfully Jul 30 16:52:03 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-28784a64-1ecd-4c82-8bee-aa695199e571 tempest-DeleteServersTestJSON-1441602235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91587ffa-50c2-4f81-9a68-01e237d4d977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:52:03 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-28784a64-1ecd-4c82-8bee-aa695199e571 tempest-DeleteServersTestJSON-1441602235 None] Flow 'volume_create_manager' (92026359-c524-4a62-862c-3c93c1d60c69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:52:03 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-28784a64-1ecd-4c82-8bee-aa695199e571 tempest-DeleteServersTestJSON-1441602235 None] Created volume successfully. Jul 30 16:52:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-eb3ca89e-30e5-4873-9213-f0620cd7d22e req-24f8d20f-3ee2-4529-93be-6bac28a5e89d tempest-DeleteServersTestJSON-1441602235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:52:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-eb3ca89e-30e5-4873-9213-f0620cd7d22e req-24f8d20f-3ee2-4529-93be-6bac28a5e89d tempest-DeleteServersTestJSON-1441602235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:52:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-eb3ca89e-30e5-4873-9213-f0620cd7d22e req-24f8d20f-3ee2-4529-93be-6bac28a5e89d tempest-DeleteServersTestJSON-1441602235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.042s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:52:06 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [req-eb3ca89e-30e5-4873-9213-f0620cd7d22e req-24f8d20f-3ee2-4529-93be-6bac28a5e89d tempest-DeleteServersTestJSON-1441602235 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924', 'name': 'volume-fcd3f3eb-e673-4f57-b9b7-6ea64d897c3f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7f9827b1-78e1-42c8-926b-c31f3c4de8cb', 'enforce_multipath': True} {{(pid=88568) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 16:52:06 devstack cinder-volume[88568]: INFO cinder.volume.manager [req-eb3ca89e-30e5-4873-9213-f0620cd7d22e req-24f8d20f-3ee2-4529-93be-6bac28a5e89d tempest-DeleteServersTestJSON-1441602235 None] attachment_update completed successfully. Jul 30 16:52:14 devstack cinder-volume[88568]: INFO cinder.volume.manager [req-fea02cc3-22dc-4613-bf23-7f9f2ad527fa req-1672acef-28dc-4b71-b6e1-01138022fc8f tempest-DeleteServersTestJSON-1441602235 None] Terminate volume connection completed successfully. Jul 30 16:52:14 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [req-fea02cc3-22dc-4613-bf23-7f9f2ad527fa req-1672acef-28dc-4b71-b6e1-01138022fc8f tempest-DeleteServersTestJSON-1441602235 None] Deleting attachment 7f9827b1-78e1-42c8-926b-c31f3c4de8cb. {{(pid=88568) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 16:52:18 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-13d52954-e526-4b5b-a043-72fd76e8288c tempest-DeleteServersTestJSON-1441602235 None] Acquiring lock "cinder-fcd3f3eb-e673-4f57-b9b7-6ea64d897c3f-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:52:18 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-13d52954-e526-4b5b-a043-72fd76e8288c tempest-DeleteServersTestJSON-1441602235 None] Lock "cinder-fcd3f3eb-e673-4f57-b9b7-6ea64d897c3f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:52:18 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-13d52954-e526-4b5b-a043-72fd76e8288c tempest-DeleteServersTestJSON-1441602235 None] Acquiring lock "cinder-quobyte-fcd3f3eb-e673-4f57-b9b7-6ea64d897c3f" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:52:18 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-13d52954-e526-4b5b-a043-72fd76e8288c tempest-DeleteServersTestJSON-1441602235 None] Lock "cinder-quobyte-fcd3f3eb-e673-4f57-b9b7-6ea64d897c3f" acquired by "delete_volume" :: waited 0.047s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:52:18 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[1611364e-8695-4484-a0ad-2d70530de98c]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:52:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-13d52954-e526-4b5b-a043-72fd76e8288c tempest-DeleteServersTestJSON-1441602235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fcd3f3eb-e673-4f57-b9b7-6ea64d897c3f {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:52:19 devstack sudo[92317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fcd3f3eb-e673-4f57-b9b7-6ea64d897c3f Jul 30 16:52:19 devstack sudo[92317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:52:19 devstack sudo[92317]: pam_unix(sudo:session): session closed for user root Jul 30 16:52:19 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-13d52954-e526-4b5b-a043-72fd76e8288c tempest-DeleteServersTestJSON-1441602235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fcd3f3eb-e673-4f57-b9b7-6ea64d897c3f" returned: 0 in 0.805s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:52:19 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-13d52954-e526-4b5b-a043-72fd76e8288c tempest-DeleteServersTestJSON-1441602235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fcd3f3eb-e673-4f57-b9b7-6ea64d897c3f {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:52:19 devstack sudo[92350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fcd3f3eb-e673-4f57-b9b7-6ea64d897c3f Jul 30 16:52:19 devstack sudo[92350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:52:19 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-f27a3655-1673-4d11-8578-9e49dc1b2d06 req-e1d6273b-830b-401f-9bee-790eed442aec tempest-TaggedAttachmentsTest-385345408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:52:19 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-f27a3655-1673-4d11-8578-9e49dc1b2d06 req-e1d6273b-830b-401f-9bee-790eed442aec tempest-TaggedAttachmentsTest-385345408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:52:19 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-f27a3655-1673-4d11-8578-9e49dc1b2d06 req-e1d6273b-830b-401f-9bee-790eed442aec tempest-TaggedAttachmentsTest-385345408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:52:19 devstack sudo[92350]: pam_unix(sudo:session): session closed for user root Jul 30 16:52:19 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-13d52954-e526-4b5b-a043-72fd76e8288c tempest-DeleteServersTestJSON-1441602235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fcd3f3eb-e673-4f57-b9b7-6ea64d897c3f" returned: 0 in 0.306s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:52:20 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-13d52954-e526-4b5b-a043-72fd76e8288c tempest-DeleteServersTestJSON-1441602235 None] Lock "cinder-quobyte-fcd3f3eb-e673-4f57-b9b7-6ea64d897c3f" released by "delete_volume" :: held 1.190s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:52:20 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [req-f27a3655-1673-4d11-8578-9e49dc1b2d06 req-e1d6273b-830b-401f-9bee-790eed442aec tempest-TaggedAttachmentsTest-385345408 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924', 'name': 'volume-a9140023-a73b-41d1-b687-fb56fc17ffd8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '99a7cc3a-91b3-4533-8132-1df957721053', 'enforce_multipath': True} {{(pid=88568) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 16:52:20 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-13d52954-e526-4b5b-a043-72fd76e8288c tempest-DeleteServersTestJSON-1441602235 None] Created reservations ['ad380d4e-415f-475f-850a-ce34c3154d98', 'cd6aeb36-30e8-4910-a3e7-64d198144db2', '0af673e5-b193-4c76-a034-0d65a7b1fb5b', 'e5a7ec72-2ca0-4bae-9ca9-672585c9bd48'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:52:20 devstack cinder-volume[88568]: INFO cinder.volume.manager [req-f27a3655-1673-4d11-8578-9e49dc1b2d06 req-e1d6273b-830b-401f-9bee-790eed442aec tempest-TaggedAttachmentsTest-385345408 None] attachment_update completed successfully. Jul 30 16:52:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-13d52954-e526-4b5b-a043-72fd76e8288c tempest-DeleteServersTestJSON-1441602235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:52:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-13d52954-e526-4b5b-a043-72fd76e8288c tempest-DeleteServersTestJSON-1441602235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:52:20 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-13d52954-e526-4b5b-a043-72fd76e8288c tempest-DeleteServersTestJSON-1441602235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:52:20 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-13d52954-e526-4b5b-a043-72fd76e8288c tempest-DeleteServersTestJSON-1441602235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:52:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-13d52954-e526-4b5b-a043-72fd76e8288c tempest-DeleteServersTestJSON-1441602235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:52:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-13d52954-e526-4b5b-a043-72fd76e8288c tempest-DeleteServersTestJSON-1441602235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:52:20 devstack sudo[92361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:52:20 devstack sudo[92361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:52:20 devstack sudo[92361]: pam_unix(sudo:session): session closed for user root Jul 30 16:52:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-13d52954-e526-4b5b-a043-72fd76e8288c tempest-DeleteServersTestJSON-1441602235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.376s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:52:20 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-13d52954-e526-4b5b-a043-72fd76e8288c tempest-DeleteServersTestJSON-1441602235 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:52:20 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-13d52954-e526-4b5b-a043-72fd76e8288c tempest-DeleteServersTestJSON-1441602235 None] Deleted volume successfully. Jul 30 16:52:20 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-13d52954-e526-4b5b-a043-72fd76e8288c tempest-DeleteServersTestJSON-1441602235 None] Lock "cinder-fcd3f3eb-e673-4f57-b9b7-6ea64d897c3f-delete_volume" released by "delete_volume" :: held 1.953s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:52:22 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-000490e2-6203-4626-ac5e-57381bff89d3 tempest-ServersNegativeTestJSON-1700185947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:52:22 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-000490e2-6203-4626-ac5e-57381bff89d3 tempest-ServersNegativeTestJSON-1700185947 None] Flow 'volume_create_manager' (4ae173f8-c829-4b4a-ba26-5793c51cbf40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:52:22 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-000490e2-6203-4626-ac5e-57381bff89d3 tempest-ServersNegativeTestJSON-1700185947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (261de4de-5367-4df3-909b-58f2b1031fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:52:22 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-000490e2-6203-4626-ac5e-57381bff89d3 tempest-ServersNegativeTestJSON-1700185947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (261de4de-5367-4df3-909b-58f2b1031fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:52:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-859138406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe5552f4-959e-4c4d-b2b1-6e20e101a45a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc06b97201da4465bb2d367bf1c5c8fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:52:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:52:22Z,use_quota=True,user_id='52e0b69914d745dca93a3447612605e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:52:22 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-000490e2-6203-4626-ac5e-57381bff89d3 tempest-ServersNegativeTestJSON-1700185947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f612189-ec92-48aa-b796-6fc640244d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:52:22 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-000490e2-6203-4626-ac5e-57381bff89d3 tempest-ServersNegativeTestJSON-1700185947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f612189-ec92-48aa-b796-6fc640244d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:52:22 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-000490e2-6203-4626-ac5e-57381bff89d3 tempest-ServersNegativeTestJSON-1700185947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43bd5ca5-845a-4ab5-a9c7-7b792d40a670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:52:22 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-000490e2-6203-4626-ac5e-57381bff89d3 tempest-ServersNegativeTestJSON-1700185947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43bd5ca5-845a-4ab5-a9c7-7b792d40a670) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe5552f4-959e-4c4d-b2b1-6e20e101a45a', 'volume_name': 'volume-fe5552f4-959e-4c4d-b2b1-6e20e101a45a', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:52:22 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-000490e2-6203-4626-ac5e-57381bff89d3 tempest-ServersNegativeTestJSON-1700185947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c06f2e4f-8a2f-40a9-97ce-66f8e69b6058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:52:22 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-000490e2-6203-4626-ac5e-57381bff89d3 tempest-ServersNegativeTestJSON-1700185947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c06f2e4f-8a2f-40a9-97ce-66f8e69b6058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:52:22 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-000490e2-6203-4626-ac5e-57381bff89d3 tempest-ServersNegativeTestJSON-1700185947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ed7bb10-a0e9-4c25-b596-a46bb2f70ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:52:22 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-000490e2-6203-4626-ac5e-57381bff89d3 tempest-ServersNegativeTestJSON-1700185947 None] Volume fe5552f4-959e-4c4d-b2b1-6e20e101a45a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe5552f4-959e-4c4d-b2b1-6e20e101a45a', 'volume_size': 1} Jul 30 16:52:22 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-000490e2-6203-4626-ac5e-57381bff89d3 tempest-ServersNegativeTestJSON-1700185947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:52:22 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-000490e2-6203-4626-ac5e-57381bff89d3 tempest-ServersNegativeTestJSON-1700185947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:52:22 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-000490e2-6203-4626-ac5e-57381bff89d3 tempest-ServersNegativeTestJSON-1700185947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:52:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-859138406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe5552f4-959e-4c4d-b2b1-6e20e101a45a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc06b97201da4465bb2d367bf1c5c8fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:52:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:52:22Z,use_quota=True,user_id='52e0b69914d745dca93a3447612605e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:52:22 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-000490e2-6203-4626-ac5e-57381bff89d3 tempest-ServersNegativeTestJSON-1700185947 None] Creating volume fe5552f4-959e-4c4d-b2b1-6e20e101a45a {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:52:22 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-000490e2-6203-4626-ac5e-57381bff89d3 tempest-ServersNegativeTestJSON-1700185947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:52:22 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-000490e2-6203-4626-ac5e-57381bff89d3 tempest-ServersNegativeTestJSON-1700185947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:52:22 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-000490e2-6203-4626-ac5e-57381bff89d3 tempest-ServersNegativeTestJSON-1700185947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:52:22 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-000490e2-6203-4626-ac5e-57381bff89d3 tempest-ServersNegativeTestJSON-1700185947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:52:22 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-000490e2-6203-4626-ac5e-57381bff89d3 tempest-ServersNegativeTestJSON-1700185947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:52:22 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-000490e2-6203-4626-ac5e-57381bff89d3 tempest-ServersNegativeTestJSON-1700185947 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:52:22 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-000490e2-6203-4626-ac5e-57381bff89d3 tempest-ServersNegativeTestJSON-1700185947 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 16:52:22 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-000490e2-6203-4626-ac5e-57381bff89d3 tempest-ServersNegativeTestJSON-1700185947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fe5552f4-959e-4c4d-b2b1-6e20e101a45a 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:52:22 devstack sudo[92755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fe5552f4-959e-4c4d-b2b1-6e20e101a45a 1073741824 Jul 30 16:52:22 devstack sudo[92755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:52:23 devstack sudo[92755]: pam_unix(sudo:session): session closed for user root Jul 30 16:52:23 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-000490e2-6203-4626-ac5e-57381bff89d3 tempest-ServersNegativeTestJSON-1700185947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fe5552f4-959e-4c4d-b2b1-6e20e101a45a 1073741824" returned: 0 in 0.570s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:52:23 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-000490e2-6203-4626-ac5e-57381bff89d3 tempest-ServersNegativeTestJSON-1700185947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fe5552f4-959e-4c4d-b2b1-6e20e101a45a {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:52:23 devstack sudo[92763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fe5552f4-959e-4c4d-b2b1-6e20e101a45a Jul 30 16:52:23 devstack sudo[92763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:52:23 devstack sudo[92763]: pam_unix(sudo:session): session closed for user root Jul 30 16:52:23 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-000490e2-6203-4626-ac5e-57381bff89d3 tempest-ServersNegativeTestJSON-1700185947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fe5552f4-959e-4c4d-b2b1-6e20e101a45a" returned: 0 in 0.322s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:52:23 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-000490e2-6203-4626-ac5e-57381bff89d3 tempest-ServersNegativeTestJSON-1700185947 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:52:23 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-000490e2-6203-4626-ac5e-57381bff89d3 tempest-ServersNegativeTestJSON-1700185947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:52:23 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-000490e2-6203-4626-ac5e-57381bff89d3 tempest-ServersNegativeTestJSON-1700185947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ed7bb10-a0e9-4c25-b596-a46bb2f70ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe5552f4-959e-4c4d-b2b1-6e20e101a45a', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:52:23 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-000490e2-6203-4626-ac5e-57381bff89d3 tempest-ServersNegativeTestJSON-1700185947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1bf5d77-2459-4915-b205-65ec5aa5cf2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:52:23 devstack cinder-volume[88568]: INFO cinder.volume.manager [req-af8bbc99-154a-472e-ac47-c5c6cd97977e req-2d6f0784-24c1-4337-8550-ab91ef65780f tempest-TaggedAttachmentsTest-385345408 None] Terminate volume connection completed successfully. Jul 30 16:52:23 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [req-af8bbc99-154a-472e-ac47-c5c6cd97977e req-2d6f0784-24c1-4337-8550-ab91ef65780f tempest-TaggedAttachmentsTest-385345408 None] Deleting attachment 99a7cc3a-91b3-4533-8132-1df957721053. {{(pid=88568) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 16:52:23 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-000490e2-6203-4626-ac5e-57381bff89d3 tempest-ServersNegativeTestJSON-1700185947 None] Volume volume-fe5552f4-959e-4c4d-b2b1-6e20e101a45a (fe5552f4-959e-4c4d-b2b1-6e20e101a45a): created successfully Jul 30 16:52:23 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-000490e2-6203-4626-ac5e-57381bff89d3 tempest-ServersNegativeTestJSON-1700185947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1bf5d77-2459-4915-b205-65ec5aa5cf2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:52:23 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-000490e2-6203-4626-ac5e-57381bff89d3 tempest-ServersNegativeTestJSON-1700185947 None] Flow 'volume_create_manager' (4ae173f8-c829-4b4a-ba26-5793c51cbf40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:52:23 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-000490e2-6203-4626-ac5e-57381bff89d3 tempest-ServersNegativeTestJSON-1700185947 None] Created volume successfully. Jul 30 16:52:25 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-86e38d4b-61c5-4912-bcff-81ce5d61bdc7 tempest-ServersNegativeTestJSON-1700185947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:52:25 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-86e38d4b-61c5-4912-bcff-81ce5d61bdc7 tempest-ServersNegativeTestJSON-1700185947 None] Flow 'volume_create_manager' (f6044ff9-4c90-4dbf-8fc4-850d49f061c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:52:25 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-86e38d4b-61c5-4912-bcff-81ce5d61bdc7 tempest-ServersNegativeTestJSON-1700185947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfa567f5-4bed-487f-95c4-21729fbfa459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:52:26 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-86e38d4b-61c5-4912-bcff-81ce5d61bdc7 tempest-ServersNegativeTestJSON-1700185947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfa567f5-4bed-487f-95c4-21729fbfa459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:52:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2059711999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d0ea3ee-c9a3-403d-97cd-e9d290c0bce7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc06b97201da4465bb2d367bf1c5c8fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:52:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:52:26Z,use_quota=True,user_id='52e0b69914d745dca93a3447612605e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:52:26 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-86e38d4b-61c5-4912-bcff-81ce5d61bdc7 tempest-ServersNegativeTestJSON-1700185947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae065257-e48e-4f85-8e21-568245d635af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:52:26 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-86e38d4b-61c5-4912-bcff-81ce5d61bdc7 tempest-ServersNegativeTestJSON-1700185947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae065257-e48e-4f85-8e21-568245d635af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:52:26 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-86e38d4b-61c5-4912-bcff-81ce5d61bdc7 tempest-ServersNegativeTestJSON-1700185947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69efdf0b-7dc9-4cb4-b9c3-3323e667d666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:52:26 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-86e38d4b-61c5-4912-bcff-81ce5d61bdc7 tempest-ServersNegativeTestJSON-1700185947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69efdf0b-7dc9-4cb4-b9c3-3323e667d666) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d0ea3ee-c9a3-403d-97cd-e9d290c0bce7', 'volume_name': 'volume-9d0ea3ee-c9a3-403d-97cd-e9d290c0bce7', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:52:26 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-86e38d4b-61c5-4912-bcff-81ce5d61bdc7 tempest-ServersNegativeTestJSON-1700185947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (120a800c-7b56-4f04-9768-1dcc0e84c57b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:52:26 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-86e38d4b-61c5-4912-bcff-81ce5d61bdc7 tempest-ServersNegativeTestJSON-1700185947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (120a800c-7b56-4f04-9768-1dcc0e84c57b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:52:26 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-86e38d4b-61c5-4912-bcff-81ce5d61bdc7 tempest-ServersNegativeTestJSON-1700185947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a693155d-5986-482e-bc61-d9de77982550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:52:26 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-86e38d4b-61c5-4912-bcff-81ce5d61bdc7 tempest-ServersNegativeTestJSON-1700185947 None] Volume 9d0ea3ee-c9a3-403d-97cd-e9d290c0bce7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d0ea3ee-c9a3-403d-97cd-e9d290c0bce7', 'volume_size': 1} Jul 30 16:52:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-86e38d4b-61c5-4912-bcff-81ce5d61bdc7 tempest-ServersNegativeTestJSON-1700185947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:52:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-86e38d4b-61c5-4912-bcff-81ce5d61bdc7 tempest-ServersNegativeTestJSON-1700185947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:52:26 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-86e38d4b-61c5-4912-bcff-81ce5d61bdc7 tempest-ServersNegativeTestJSON-1700185947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:52:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2059711999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d0ea3ee-c9a3-403d-97cd-e9d290c0bce7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc06b97201da4465bb2d367bf1c5c8fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:52:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:52:26Z,use_quota=True,user_id='52e0b69914d745dca93a3447612605e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:52:26 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-86e38d4b-61c5-4912-bcff-81ce5d61bdc7 tempest-ServersNegativeTestJSON-1700185947 None] Creating volume 9d0ea3ee-c9a3-403d-97cd-e9d290c0bce7 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:52:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-86e38d4b-61c5-4912-bcff-81ce5d61bdc7 tempest-ServersNegativeTestJSON-1700185947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:52:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-86e38d4b-61c5-4912-bcff-81ce5d61bdc7 tempest-ServersNegativeTestJSON-1700185947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:52:26 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-86e38d4b-61c5-4912-bcff-81ce5d61bdc7 tempest-ServersNegativeTestJSON-1700185947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:52:26 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-86e38d4b-61c5-4912-bcff-81ce5d61bdc7 tempest-ServersNegativeTestJSON-1700185947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:52:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-86e38d4b-61c5-4912-bcff-81ce5d61bdc7 tempest-ServersNegativeTestJSON-1700185947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:52:26 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-86e38d4b-61c5-4912-bcff-81ce5d61bdc7 tempest-ServersNegativeTestJSON-1700185947 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:52:26 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-86e38d4b-61c5-4912-bcff-81ce5d61bdc7 tempest-ServersNegativeTestJSON-1700185947 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 16:52:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-86e38d4b-61c5-4912-bcff-81ce5d61bdc7 tempest-ServersNegativeTestJSON-1700185947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9d0ea3ee-c9a3-403d-97cd-e9d290c0bce7 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:52:26 devstack sudo[92818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9d0ea3ee-c9a3-403d-97cd-e9d290c0bce7 1073741824 Jul 30 16:52:26 devstack sudo[92818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:52:26 devstack sudo[92818]: pam_unix(sudo:session): session closed for user root Jul 30 16:52:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-86e38d4b-61c5-4912-bcff-81ce5d61bdc7 tempest-ServersNegativeTestJSON-1700185947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9d0ea3ee-c9a3-403d-97cd-e9d290c0bce7 1073741824" returned: 0 in 0.752s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:52:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-86e38d4b-61c5-4912-bcff-81ce5d61bdc7 tempest-ServersNegativeTestJSON-1700185947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9d0ea3ee-c9a3-403d-97cd-e9d290c0bce7 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:52:26 devstack sudo[92826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9d0ea3ee-c9a3-403d-97cd-e9d290c0bce7 Jul 30 16:52:26 devstack sudo[92826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:52:27 devstack sudo[92826]: pam_unix(sudo:session): session closed for user root Jul 30 16:52:27 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-86e38d4b-61c5-4912-bcff-81ce5d61bdc7 tempest-ServersNegativeTestJSON-1700185947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9d0ea3ee-c9a3-403d-97cd-e9d290c0bce7" returned: 0 in 0.550s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:52:27 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-86e38d4b-61c5-4912-bcff-81ce5d61bdc7 tempest-ServersNegativeTestJSON-1700185947 None] <== create_volume: return (1367ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:52:27 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-86e38d4b-61c5-4912-bcff-81ce5d61bdc7 tempest-ServersNegativeTestJSON-1700185947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.371s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:52:27 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-86e38d4b-61c5-4912-bcff-81ce5d61bdc7 tempest-ServersNegativeTestJSON-1700185947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a693155d-5986-482e-bc61-d9de77982550) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d0ea3ee-c9a3-403d-97cd-e9d290c0bce7', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:52:27 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-86e38d4b-61c5-4912-bcff-81ce5d61bdc7 tempest-ServersNegativeTestJSON-1700185947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58cefda9-df96-48f7-a9ab-112faf07a4c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:52:27 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-86e38d4b-61c5-4912-bcff-81ce5d61bdc7 tempest-ServersNegativeTestJSON-1700185947 None] Volume volume-9d0ea3ee-c9a3-403d-97cd-e9d290c0bce7 (9d0ea3ee-c9a3-403d-97cd-e9d290c0bce7): created successfully Jul 30 16:52:27 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-86e38d4b-61c5-4912-bcff-81ce5d61bdc7 tempest-ServersNegativeTestJSON-1700185947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58cefda9-df96-48f7-a9ab-112faf07a4c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:52:27 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-86e38d4b-61c5-4912-bcff-81ce5d61bdc7 tempest-ServersNegativeTestJSON-1700185947 None] Flow 'volume_create_manager' (f6044ff9-4c90-4dbf-8fc4-850d49f061c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:52:27 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-86e38d4b-61c5-4912-bcff-81ce5d61bdc7 tempest-ServersNegativeTestJSON-1700185947 None] Created volume successfully. Jul 30 16:52:28 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-f05c4588-af17-4405-beea-44605629c899 tempest-ServersNegativeTestJSON-1700185947 None] Acquiring lock "cinder-9d0ea3ee-c9a3-403d-97cd-e9d290c0bce7-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:52:28 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-f05c4588-af17-4405-beea-44605629c899 tempest-ServersNegativeTestJSON-1700185947 None] Lock "cinder-9d0ea3ee-c9a3-403d-97cd-e9d290c0bce7-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:52:28 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-f05c4588-af17-4405-beea-44605629c899 tempest-ServersNegativeTestJSON-1700185947 None] Acquiring lock "cinder-quobyte-9d0ea3ee-c9a3-403d-97cd-e9d290c0bce7" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:52:28 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-f05c4588-af17-4405-beea-44605629c899 tempest-ServersNegativeTestJSON-1700185947 None] Lock "cinder-quobyte-9d0ea3ee-c9a3-403d-97cd-e9d290c0bce7" acquired by "delete_volume" :: waited 0.015s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:52:28 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[d445befe-f61c-434e-a9b4-bbab6aa93d2b]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:52:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f05c4588-af17-4405-beea-44605629c899 tempest-ServersNegativeTestJSON-1700185947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9d0ea3ee-c9a3-403d-97cd-e9d290c0bce7 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:52:29 devstack sudo[92867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9d0ea3ee-c9a3-403d-97cd-e9d290c0bce7 Jul 30 16:52:29 devstack sudo[92867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:52:29 devstack sudo[92867]: pam_unix(sudo:session): session closed for user root Jul 30 16:52:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f05c4588-af17-4405-beea-44605629c899 tempest-ServersNegativeTestJSON-1700185947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9d0ea3ee-c9a3-403d-97cd-e9d290c0bce7" returned: 0 in 0.499s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:52:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f05c4588-af17-4405-beea-44605629c899 tempest-ServersNegativeTestJSON-1700185947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9d0ea3ee-c9a3-403d-97cd-e9d290c0bce7 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:52:29 devstack sudo[92877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9d0ea3ee-c9a3-403d-97cd-e9d290c0bce7 Jul 30 16:52:29 devstack sudo[92877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:52:29 devstack sudo[92877]: pam_unix(sudo:session): session closed for user root Jul 30 16:52:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f05c4588-af17-4405-beea-44605629c899 tempest-ServersNegativeTestJSON-1700185947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9d0ea3ee-c9a3-403d-97cd-e9d290c0bce7" returned: 0 in 0.434s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:52:29 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-f05c4588-af17-4405-beea-44605629c899 tempest-ServersNegativeTestJSON-1700185947 None] Lock "cinder-quobyte-9d0ea3ee-c9a3-403d-97cd-e9d290c0bce7" released by "delete_volume" :: held 0.993s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:52:29 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-f05c4588-af17-4405-beea-44605629c899 tempest-ServersNegativeTestJSON-1700185947 None] Created reservations ['3a7187b7-d5b7-44cb-941c-6e37c1573a53', 'ccf823f3-917a-4fe1-a300-6383822a107d', '5e997c3b-4665-4702-bd40-91cd20235206', '1a63b0fa-ef3d-447a-af6e-e8dbc95eec1e'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:52:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-f05c4588-af17-4405-beea-44605629c899 tempest-ServersNegativeTestJSON-1700185947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:52:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-f05c4588-af17-4405-beea-44605629c899 tempest-ServersNegativeTestJSON-1700185947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:52:29 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-f05c4588-af17-4405-beea-44605629c899 tempest-ServersNegativeTestJSON-1700185947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:52:29 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-f05c4588-af17-4405-beea-44605629c899 tempest-ServersNegativeTestJSON-1700185947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:52:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-f05c4588-af17-4405-beea-44605629c899 tempest-ServersNegativeTestJSON-1700185947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:52:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f05c4588-af17-4405-beea-44605629c899 tempest-ServersNegativeTestJSON-1700185947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:52:29 devstack sudo[92901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:52:29 devstack sudo[92901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:52:30 devstack sudo[92901]: pam_unix(sudo:session): session closed for user root Jul 30 16:52:30 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f05c4588-af17-4405-beea-44605629c899 tempest-ServersNegativeTestJSON-1700185947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.388s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:52:30 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-f05c4588-af17-4405-beea-44605629c899 tempest-ServersNegativeTestJSON-1700185947 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:52:30 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-f05c4588-af17-4405-beea-44605629c899 tempest-ServersNegativeTestJSON-1700185947 None] Deleted volume successfully. Jul 30 16:52:30 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-f05c4588-af17-4405-beea-44605629c899 tempest-ServersNegativeTestJSON-1700185947 None] Lock "cinder-9d0ea3ee-c9a3-403d-97cd-e9d290c0bce7-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:52:30 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-f79e7bed-99d0-49d3-b13f-ab0c763f96fb tempest-ServersNegativeTestJSON-1700185947 None] Acquiring lock "cinder-fe5552f4-959e-4c4d-b2b1-6e20e101a45a-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:52:30 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-f79e7bed-99d0-49d3-b13f-ab0c763f96fb tempest-ServersNegativeTestJSON-1700185947 None] Lock "cinder-fe5552f4-959e-4c4d-b2b1-6e20e101a45a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:52:31 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-f79e7bed-99d0-49d3-b13f-ab0c763f96fb tempest-ServersNegativeTestJSON-1700185947 None] Acquiring lock "cinder-quobyte-fe5552f4-959e-4c4d-b2b1-6e20e101a45a" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:52:31 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-f79e7bed-99d0-49d3-b13f-ab0c763f96fb tempest-ServersNegativeTestJSON-1700185947 None] Lock "cinder-quobyte-fe5552f4-959e-4c4d-b2b1-6e20e101a45a" acquired by "delete_volume" :: waited 0.019s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:52:31 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e82636-7197-4c88-b7a8-a2097b852675]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:52:31 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f79e7bed-99d0-49d3-b13f-ab0c763f96fb tempest-ServersNegativeTestJSON-1700185947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fe5552f4-959e-4c4d-b2b1-6e20e101a45a {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:52:31 devstack sudo[92907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fe5552f4-959e-4c4d-b2b1-6e20e101a45a Jul 30 16:52:31 devstack sudo[92907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:52:31 devstack sudo[92907]: pam_unix(sudo:session): session closed for user root Jul 30 16:52:31 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f79e7bed-99d0-49d3-b13f-ab0c763f96fb tempest-ServersNegativeTestJSON-1700185947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fe5552f4-959e-4c4d-b2b1-6e20e101a45a" returned: 0 in 0.580s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:52:31 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f79e7bed-99d0-49d3-b13f-ab0c763f96fb tempest-ServersNegativeTestJSON-1700185947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fe5552f4-959e-4c4d-b2b1-6e20e101a45a {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:52:31 devstack sudo[92914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fe5552f4-959e-4c4d-b2b1-6e20e101a45a Jul 30 16:52:31 devstack sudo[92914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:52:31 devstack sudo[92914]: pam_unix(sudo:session): session closed for user root Jul 30 16:52:31 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f79e7bed-99d0-49d3-b13f-ab0c763f96fb tempest-ServersNegativeTestJSON-1700185947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fe5552f4-959e-4c4d-b2b1-6e20e101a45a" returned: 0 in 0.283s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:52:31 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-f79e7bed-99d0-49d3-b13f-ab0c763f96fb tempest-ServersNegativeTestJSON-1700185947 None] Lock "cinder-quobyte-fe5552f4-959e-4c4d-b2b1-6e20e101a45a" released by "delete_volume" :: held 0.920s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:52:32 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-f79e7bed-99d0-49d3-b13f-ab0c763f96fb tempest-ServersNegativeTestJSON-1700185947 None] Created reservations ['1b9b0a26-05e3-490e-aaff-3171f3340d24', '1e47344e-2a44-4a49-b0a0-2a188a653511', '5836bf6c-77c4-4444-8179-7f1ea84b8d0a', '646e08a7-8390-4cab-976a-fa5b2d7bf153'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:52:32 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-f79e7bed-99d0-49d3-b13f-ab0c763f96fb tempest-ServersNegativeTestJSON-1700185947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:52:32 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-f79e7bed-99d0-49d3-b13f-ab0c763f96fb tempest-ServersNegativeTestJSON-1700185947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:52:32 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-f79e7bed-99d0-49d3-b13f-ab0c763f96fb tempest-ServersNegativeTestJSON-1700185947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:52:32 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-f79e7bed-99d0-49d3-b13f-ab0c763f96fb tempest-ServersNegativeTestJSON-1700185947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:52:32 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-f79e7bed-99d0-49d3-b13f-ab0c763f96fb tempest-ServersNegativeTestJSON-1700185947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:52:32 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f79e7bed-99d0-49d3-b13f-ab0c763f96fb tempest-ServersNegativeTestJSON-1700185947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:52:32 devstack sudo[92918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:52:32 devstack sudo[92918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:52:32 devstack sudo[92918]: pam_unix(sudo:session): session closed for user root Jul 30 16:52:32 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f79e7bed-99d0-49d3-b13f-ab0c763f96fb tempest-ServersNegativeTestJSON-1700185947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.392s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:52:32 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-f79e7bed-99d0-49d3-b13f-ab0c763f96fb tempest-ServersNegativeTestJSON-1700185947 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:52:32 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-f79e7bed-99d0-49d3-b13f-ab0c763f96fb tempest-ServersNegativeTestJSON-1700185947 None] Deleted volume successfully. Jul 30 16:52:32 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-f79e7bed-99d0-49d3-b13f-ab0c763f96fb tempest-ServersNegativeTestJSON-1700185947 None] Lock "cinder-fe5552f4-959e-4c4d-b2b1-6e20e101a45a-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:52:36 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-993d4fec-a1d4-4f33-ac91-f58053b549d2 tempest-TaggedAttachmentsTest-385345408 None] Acquiring lock "cinder-a9140023-a73b-41d1-b687-fb56fc17ffd8-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:52:36 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-993d4fec-a1d4-4f33-ac91-f58053b549d2 tempest-TaggedAttachmentsTest-385345408 None] Lock "cinder-a9140023-a73b-41d1-b687-fb56fc17ffd8-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:52:36 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-993d4fec-a1d4-4f33-ac91-f58053b549d2 tempest-TaggedAttachmentsTest-385345408 None] Acquiring lock "cinder-quobyte-a9140023-a73b-41d1-b687-fb56fc17ffd8" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:52:36 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-993d4fec-a1d4-4f33-ac91-f58053b549d2 tempest-TaggedAttachmentsTest-385345408 None] Lock "cinder-quobyte-a9140023-a73b-41d1-b687-fb56fc17ffd8" acquired by "delete_volume" :: waited 0.043s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:52:36 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b950057-ccc6-4d0a-889c-1f09144ecc32]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:52:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-993d4fec-a1d4-4f33-ac91-f58053b549d2 tempest-TaggedAttachmentsTest-385345408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-a9140023-a73b-41d1-b687-fb56fc17ffd8 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:52:36 devstack sudo[92958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-a9140023-a73b-41d1-b687-fb56fc17ffd8 Jul 30 16:52:36 devstack sudo[92958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:52:37 devstack sudo[92958]: pam_unix(sudo:session): session closed for user root Jul 30 16:52:37 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-993d4fec-a1d4-4f33-ac91-f58053b549d2 tempest-TaggedAttachmentsTest-385345408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-a9140023-a73b-41d1-b687-fb56fc17ffd8" returned: 0 in 0.653s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:52:37 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-993d4fec-a1d4-4f33-ac91-f58053b549d2 tempest-TaggedAttachmentsTest-385345408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-a9140023-a73b-41d1-b687-fb56fc17ffd8 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:52:37 devstack sudo[92983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-a9140023-a73b-41d1-b687-fb56fc17ffd8 Jul 30 16:52:37 devstack sudo[92983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:52:37 devstack sudo[92983]: pam_unix(sudo:session): session closed for user root Jul 30 16:52:37 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-993d4fec-a1d4-4f33-ac91-f58053b549d2 tempest-TaggedAttachmentsTest-385345408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-a9140023-a73b-41d1-b687-fb56fc17ffd8" returned: 0 in 0.304s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:52:37 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-993d4fec-a1d4-4f33-ac91-f58053b549d2 tempest-TaggedAttachmentsTest-385345408 None] Lock "cinder-quobyte-a9140023-a73b-41d1-b687-fb56fc17ffd8" released by "delete_volume" :: held 1.028s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:52:37 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-993d4fec-a1d4-4f33-ac91-f58053b549d2 tempest-TaggedAttachmentsTest-385345408 None] Created reservations ['2e500fae-67ea-4c4b-94d6-ac3ced64929d', '2f940bd7-d048-4477-acfb-6ded57b33eed', 'a6348f76-b144-4aba-a951-04004b5dcbcd', 'faf57135-42b8-4921-b34e-a31f6cb696d2'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:52:37 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-993d4fec-a1d4-4f33-ac91-f58053b549d2 tempest-TaggedAttachmentsTest-385345408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:52:37 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-993d4fec-a1d4-4f33-ac91-f58053b549d2 tempest-TaggedAttachmentsTest-385345408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:52:37 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-993d4fec-a1d4-4f33-ac91-f58053b549d2 tempest-TaggedAttachmentsTest-385345408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:52:37 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-993d4fec-a1d4-4f33-ac91-f58053b549d2 tempest-TaggedAttachmentsTest-385345408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:52:37 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-993d4fec-a1d4-4f33-ac91-f58053b549d2 tempest-TaggedAttachmentsTest-385345408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:52:37 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-993d4fec-a1d4-4f33-ac91-f58053b549d2 tempest-TaggedAttachmentsTest-385345408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:52:37 devstack sudo[92987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:52:37 devstack sudo[92987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:52:37 devstack sudo[92987]: pam_unix(sudo:session): session closed for user root Jul 30 16:52:37 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-993d4fec-a1d4-4f33-ac91-f58053b549d2 tempest-TaggedAttachmentsTest-385345408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.282s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:52:37 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-993d4fec-a1d4-4f33-ac91-f58053b549d2 tempest-TaggedAttachmentsTest-385345408 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:52:37 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-993d4fec-a1d4-4f33-ac91-f58053b549d2 tempest-TaggedAttachmentsTest-385345408 None] Deleted volume successfully. Jul 30 16:52:37 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-993d4fec-a1d4-4f33-ac91-f58053b549d2 tempest-TaggedAttachmentsTest-385345408 None] Lock "cinder-a9140023-a73b-41d1-b687-fb56fc17ffd8-delete_volume" released by "delete_volume" :: held 1.623s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:52:47 devstack cinder-volume[88568]: DEBUG dbcounter [-] [88568] Writing DB stats cinder:SELECT=42,cinder:UPDATE=47,cinder:INSERT=11,cinder:DELETE=3 {{(pid=88568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:52:47 devstack cinder-volume[88568]: DEBUG dbcounter [-] [88568] Writing DB stats cinder:SELECT=40,cinder:UPDATE=41,cinder:DELETE=4,cinder:INSERT=8 {{(pid=88568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:52:58 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d0fca11-9ca9-490e-90f5-eb7d2caed523 tempest-VolumesTestJSON-1733511789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:52:58 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1d0fca11-9ca9-490e-90f5-eb7d2caed523 tempest-VolumesTestJSON-1733511789 None] Flow 'volume_create_manager' (171481cd-7c69-4237-a350-bdbb93afbe25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:52:58 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1d0fca11-9ca9-490e-90f5-eb7d2caed523 tempest-VolumesTestJSON-1733511789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c49a895-8354-4d91-935d-c544abb73b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:52:58 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1d0fca11-9ca9-490e-90f5-eb7d2caed523 tempest-VolumesTestJSON-1733511789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c49a895-8354-4d91-935d-c544abb73b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:52:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-810432766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d651129-6ef7-4f1a-aa8c-292915dd2167,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='954ffe29c757418faf951ebac2ab5d8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:52:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:52:58Z,use_quota=True,user_id='6eec1b3f1d524143961e787df2420342',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:52:58 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1d0fca11-9ca9-490e-90f5-eb7d2caed523 tempest-VolumesTestJSON-1733511789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (436384f4-5921-4633-8d0d-708096ec6cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:52:58 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1d0fca11-9ca9-490e-90f5-eb7d2caed523 tempest-VolumesTestJSON-1733511789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (436384f4-5921-4633-8d0d-708096ec6cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:52:58 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1d0fca11-9ca9-490e-90f5-eb7d2caed523 tempest-VolumesTestJSON-1733511789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1db39c66-e31b-4323-bd20-a84ff3da6e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:52:58 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1d0fca11-9ca9-490e-90f5-eb7d2caed523 tempest-VolumesTestJSON-1733511789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1db39c66-e31b-4323-bd20-a84ff3da6e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d651129-6ef7-4f1a-aa8c-292915dd2167', 'volume_name': 'volume-8d651129-6ef7-4f1a-aa8c-292915dd2167', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:52:58 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1d0fca11-9ca9-490e-90f5-eb7d2caed523 tempest-VolumesTestJSON-1733511789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85e37ce8-9b51-4c5e-b754-db5438ed5f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:52:58 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1d0fca11-9ca9-490e-90f5-eb7d2caed523 tempest-VolumesTestJSON-1733511789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85e37ce8-9b51-4c5e-b754-db5438ed5f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:52:58 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1d0fca11-9ca9-490e-90f5-eb7d2caed523 tempest-VolumesTestJSON-1733511789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2923d86f-a360-4fc5-b61f-26c68f7cc1a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:52:58 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-1d0fca11-9ca9-490e-90f5-eb7d2caed523 tempest-VolumesTestJSON-1733511789 None] Volume 8d651129-6ef7-4f1a-aa8c-292915dd2167: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d651129-6ef7-4f1a-aa8c-292915dd2167', 'volume_size': 1} Jul 30 16:52:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-1d0fca11-9ca9-490e-90f5-eb7d2caed523 tempest-VolumesTestJSON-1733511789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:52:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-1d0fca11-9ca9-490e-90f5-eb7d2caed523 tempest-VolumesTestJSON-1733511789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:52:58 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-1d0fca11-9ca9-490e-90f5-eb7d2caed523 tempest-VolumesTestJSON-1733511789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:52:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-810432766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d651129-6ef7-4f1a-aa8c-292915dd2167,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='954ffe29c757418faf951ebac2ab5d8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:52:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:52:58Z,use_quota=True,user_id='6eec1b3f1d524143961e787df2420342',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:52:58 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-1d0fca11-9ca9-490e-90f5-eb7d2caed523 tempest-VolumesTestJSON-1733511789 None] Creating volume 8d651129-6ef7-4f1a-aa8c-292915dd2167 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:52:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-1d0fca11-9ca9-490e-90f5-eb7d2caed523 tempest-VolumesTestJSON-1733511789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:52:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-1d0fca11-9ca9-490e-90f5-eb7d2caed523 tempest-VolumesTestJSON-1733511789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:52:58 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-1d0fca11-9ca9-490e-90f5-eb7d2caed523 tempest-VolumesTestJSON-1733511789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:52:58 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-1d0fca11-9ca9-490e-90f5-eb7d2caed523 tempest-VolumesTestJSON-1733511789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:52:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-1d0fca11-9ca9-490e-90f5-eb7d2caed523 tempest-VolumesTestJSON-1733511789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:52:58 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-1d0fca11-9ca9-490e-90f5-eb7d2caed523 tempest-VolumesTestJSON-1733511789 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:52:58 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-1d0fca11-9ca9-490e-90f5-eb7d2caed523 tempest-VolumesTestJSON-1733511789 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 16:52:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-1d0fca11-9ca9-490e-90f5-eb7d2caed523 tempest-VolumesTestJSON-1733511789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8d651129-6ef7-4f1a-aa8c-292915dd2167 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:52:58 devstack sudo[93062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8d651129-6ef7-4f1a-aa8c-292915dd2167 1073741824 Jul 30 16:52:58 devstack sudo[93062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:52:58 devstack sudo[93062]: pam_unix(sudo:session): session closed for user root Jul 30 16:52:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-1d0fca11-9ca9-490e-90f5-eb7d2caed523 tempest-VolumesTestJSON-1733511789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8d651129-6ef7-4f1a-aa8c-292915dd2167 1073741824" returned: 0 in 0.587s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:52:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-1d0fca11-9ca9-490e-90f5-eb7d2caed523 tempest-VolumesTestJSON-1733511789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8d651129-6ef7-4f1a-aa8c-292915dd2167 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:52:58 devstack sudo[93070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8d651129-6ef7-4f1a-aa8c-292915dd2167 Jul 30 16:52:58 devstack sudo[93070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:52:59 devstack sudo[93070]: pam_unix(sudo:session): session closed for user root Jul 30 16:52:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-1d0fca11-9ca9-490e-90f5-eb7d2caed523 tempest-VolumesTestJSON-1733511789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8d651129-6ef7-4f1a-aa8c-292915dd2167" returned: 0 in 0.395s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:52:59 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-1d0fca11-9ca9-490e-90f5-eb7d2caed523 tempest-VolumesTestJSON-1733511789 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:52:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-1d0fca11-9ca9-490e-90f5-eb7d2caed523 tempest-VolumesTestJSON-1733511789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:52:59 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1d0fca11-9ca9-490e-90f5-eb7d2caed523 tempest-VolumesTestJSON-1733511789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2923d86f-a360-4fc5-b61f-26c68f7cc1a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d651129-6ef7-4f1a-aa8c-292915dd2167', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:52:59 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1d0fca11-9ca9-490e-90f5-eb7d2caed523 tempest-VolumesTestJSON-1733511789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97371872-9de7-4ab3-8ad5-3e675aee2256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:52:59 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-1d0fca11-9ca9-490e-90f5-eb7d2caed523 tempest-VolumesTestJSON-1733511789 None] Volume volume-8d651129-6ef7-4f1a-aa8c-292915dd2167 (8d651129-6ef7-4f1a-aa8c-292915dd2167): created successfully Jul 30 16:52:59 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1d0fca11-9ca9-490e-90f5-eb7d2caed523 tempest-VolumesTestJSON-1733511789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97371872-9de7-4ab3-8ad5-3e675aee2256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:52:59 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1d0fca11-9ca9-490e-90f5-eb7d2caed523 tempest-VolumesTestJSON-1733511789 None] Flow 'volume_create_manager' (171481cd-7c69-4237-a350-bdbb93afbe25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:52:59 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-1d0fca11-9ca9-490e-90f5-eb7d2caed523 tempest-VolumesTestJSON-1733511789 None] Created volume successfully. Jul 30 16:53:03 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-78e9bcda-38f5-4fa1-91b3-bcaf28fad0bc tempest-VolumesTestJSON-1733511789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:53:03 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-78e9bcda-38f5-4fa1-91b3-bcaf28fad0bc tempest-VolumesTestJSON-1733511789 None] Flow 'volume_create_manager' (046dc738-b104-46cc-9bfa-ab62826a443e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:53:03 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-78e9bcda-38f5-4fa1-91b3-bcaf28fad0bc tempest-VolumesTestJSON-1733511789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d5b8114-caa7-4be2-8106-f505e494bb84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:03 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-78e9bcda-38f5-4fa1-91b3-bcaf28fad0bc tempest-VolumesTestJSON-1733511789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d5b8114-caa7-4be2-8106-f505e494bb84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:53:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1259072276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2359e707-eae0-4244-81b1-22c094387d69,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='954ffe29c757418faf951ebac2ab5d8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:53:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:53:03Z,use_quota=True,user_id='6eec1b3f1d524143961e787df2420342',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:03 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-78e9bcda-38f5-4fa1-91b3-bcaf28fad0bc tempest-VolumesTestJSON-1733511789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8df1f580-39a5-49b9-b727-09f0861e8564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:03 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-78e9bcda-38f5-4fa1-91b3-bcaf28fad0bc tempest-VolumesTestJSON-1733511789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8df1f580-39a5-49b9-b727-09f0861e8564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:03 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-78e9bcda-38f5-4fa1-91b3-bcaf28fad0bc tempest-VolumesTestJSON-1733511789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c249e567-ebcd-4d04-80ec-068afd7124b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:03 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-78e9bcda-38f5-4fa1-91b3-bcaf28fad0bc tempest-VolumesTestJSON-1733511789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c249e567-ebcd-4d04-80ec-068afd7124b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2359e707-eae0-4244-81b1-22c094387d69', 'volume_name': 'volume-2359e707-eae0-4244-81b1-22c094387d69', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:03 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-78e9bcda-38f5-4fa1-91b3-bcaf28fad0bc tempest-VolumesTestJSON-1733511789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9f82bfe-1ce3-4de9-b474-a7b67067fc9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:03 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-78e9bcda-38f5-4fa1-91b3-bcaf28fad0bc tempest-VolumesTestJSON-1733511789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9f82bfe-1ce3-4de9-b474-a7b67067fc9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:03 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-78e9bcda-38f5-4fa1-91b3-bcaf28fad0bc tempest-VolumesTestJSON-1733511789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6847ca19-5295-40cc-a46d-6181f98437c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:03 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-78e9bcda-38f5-4fa1-91b3-bcaf28fad0bc tempest-VolumesTestJSON-1733511789 None] Volume 2359e707-eae0-4244-81b1-22c094387d69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2359e707-eae0-4244-81b1-22c094387d69', 'volume_size': 1} Jul 30 16:53:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-78e9bcda-38f5-4fa1-91b3-bcaf28fad0bc tempest-VolumesTestJSON-1733511789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-78e9bcda-38f5-4fa1-91b3-bcaf28fad0bc tempest-VolumesTestJSON-1733511789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:03 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-78e9bcda-38f5-4fa1-91b3-bcaf28fad0bc tempest-VolumesTestJSON-1733511789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:53:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1259072276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2359e707-eae0-4244-81b1-22c094387d69,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='954ffe29c757418faf951ebac2ab5d8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:53:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:53:03Z,use_quota=True,user_id='6eec1b3f1d524143961e787df2420342',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:53:03 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-78e9bcda-38f5-4fa1-91b3-bcaf28fad0bc tempest-VolumesTestJSON-1733511789 None] Creating volume 2359e707-eae0-4244-81b1-22c094387d69 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:53:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-78e9bcda-38f5-4fa1-91b3-bcaf28fad0bc tempest-VolumesTestJSON-1733511789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-78e9bcda-38f5-4fa1-91b3-bcaf28fad0bc tempest-VolumesTestJSON-1733511789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:03 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-78e9bcda-38f5-4fa1-91b3-bcaf28fad0bc tempest-VolumesTestJSON-1733511789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:53:03 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-78e9bcda-38f5-4fa1-91b3-bcaf28fad0bc tempest-VolumesTestJSON-1733511789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:53:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-78e9bcda-38f5-4fa1-91b3-bcaf28fad0bc tempest-VolumesTestJSON-1733511789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.047s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:03 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-78e9bcda-38f5-4fa1-91b3-bcaf28fad0bc tempest-VolumesTestJSON-1733511789 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:53:03 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-78e9bcda-38f5-4fa1-91b3-bcaf28fad0bc tempest-VolumesTestJSON-1733511789 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 16:53:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-78e9bcda-38f5-4fa1-91b3-bcaf28fad0bc tempest-VolumesTestJSON-1733511789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2359e707-eae0-4244-81b1-22c094387d69 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:03 devstack sudo[93099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2359e707-eae0-4244-81b1-22c094387d69 1073741824 Jul 30 16:53:03 devstack sudo[93099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:04 devstack sudo[93099]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-78e9bcda-38f5-4fa1-91b3-bcaf28fad0bc tempest-VolumesTestJSON-1733511789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2359e707-eae0-4244-81b1-22c094387d69 1073741824" returned: 0 in 1.084s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-78e9bcda-38f5-4fa1-91b3-bcaf28fad0bc tempest-VolumesTestJSON-1733511789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2359e707-eae0-4244-81b1-22c094387d69 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:04 devstack sudo[93160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2359e707-eae0-4244-81b1-22c094387d69 Jul 30 16:53:04 devstack sudo[93160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:04 devstack sudo[93160]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-78e9bcda-38f5-4fa1-91b3-bcaf28fad0bc tempest-VolumesTestJSON-1733511789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2359e707-eae0-4244-81b1-22c094387d69" returned: 0 in 0.428s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:04 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-78e9bcda-38f5-4fa1-91b3-bcaf28fad0bc tempest-VolumesTestJSON-1733511789 None] <== create_volume: return (1665ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:53:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-78e9bcda-38f5-4fa1-91b3-bcaf28fad0bc tempest-VolumesTestJSON-1733511789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.674s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:05 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-78e9bcda-38f5-4fa1-91b3-bcaf28fad0bc tempest-VolumesTestJSON-1733511789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6847ca19-5295-40cc-a46d-6181f98437c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2359e707-eae0-4244-81b1-22c094387d69', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:05 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-78e9bcda-38f5-4fa1-91b3-bcaf28fad0bc tempest-VolumesTestJSON-1733511789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9ca4a1d-27e8-456d-a0d0-b75b5202bd4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:05 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-78e9bcda-38f5-4fa1-91b3-bcaf28fad0bc tempest-VolumesTestJSON-1733511789 None] Volume volume-2359e707-eae0-4244-81b1-22c094387d69 (2359e707-eae0-4244-81b1-22c094387d69): created successfully Jul 30 16:53:05 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-78e9bcda-38f5-4fa1-91b3-bcaf28fad0bc tempest-VolumesTestJSON-1733511789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9ca4a1d-27e8-456d-a0d0-b75b5202bd4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:05 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-78e9bcda-38f5-4fa1-91b3-bcaf28fad0bc tempest-VolumesTestJSON-1733511789 None] Flow 'volume_create_manager' (046dc738-b104-46cc-9bfa-ab62826a443e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:53:05 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-78e9bcda-38f5-4fa1-91b3-bcaf28fad0bc tempest-VolumesTestJSON-1733511789 None] Created volume successfully. Jul 30 16:53:06 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-666f496b-4926-4ebf-8f7e-b4a787209b67 tempest-VolumesTestJSON-1733511789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:53:06 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-666f496b-4926-4ebf-8f7e-b4a787209b67 tempest-VolumesTestJSON-1733511789 None] Flow 'volume_create_manager' (9653c4e5-4aff-426b-a050-7a649063d086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:53:06 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-666f496b-4926-4ebf-8f7e-b4a787209b67 tempest-VolumesTestJSON-1733511789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b4dedaa-c35a-4d8c-bc20-c90faaf40f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:06 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-666f496b-4926-4ebf-8f7e-b4a787209b67 tempest-VolumesTestJSON-1733511789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b4dedaa-c35a-4d8c-bc20-c90faaf40f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:53:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-376592171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc2a31ff-3fab-4f46-81a8-30f0e181cb23,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='954ffe29c757418faf951ebac2ab5d8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:53:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:53:06Z,use_quota=True,user_id='6eec1b3f1d524143961e787df2420342',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:06 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-666f496b-4926-4ebf-8f7e-b4a787209b67 tempest-VolumesTestJSON-1733511789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (206f5502-5126-4f00-b16e-cfe2f49ed55a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:06 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-666f496b-4926-4ebf-8f7e-b4a787209b67 tempest-VolumesTestJSON-1733511789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (206f5502-5126-4f00-b16e-cfe2f49ed55a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:06 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-666f496b-4926-4ebf-8f7e-b4a787209b67 tempest-VolumesTestJSON-1733511789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66d55e8d-7b87-4ffb-a021-34ac548dbc75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:06 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-666f496b-4926-4ebf-8f7e-b4a787209b67 tempest-VolumesTestJSON-1733511789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66d55e8d-7b87-4ffb-a021-34ac548dbc75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc2a31ff-3fab-4f46-81a8-30f0e181cb23', 'volume_name': 'volume-cc2a31ff-3fab-4f46-81a8-30f0e181cb23', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:06 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-666f496b-4926-4ebf-8f7e-b4a787209b67 tempest-VolumesTestJSON-1733511789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dc0515d-2b0b-4535-b154-8a2ad7215072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:06 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-666f496b-4926-4ebf-8f7e-b4a787209b67 tempest-VolumesTestJSON-1733511789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dc0515d-2b0b-4535-b154-8a2ad7215072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:06 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-666f496b-4926-4ebf-8f7e-b4a787209b67 tempest-VolumesTestJSON-1733511789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29709a16-6da6-451d-9b39-5ac4b2617216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:06 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-666f496b-4926-4ebf-8f7e-b4a787209b67 tempest-VolumesTestJSON-1733511789 None] Volume cc2a31ff-3fab-4f46-81a8-30f0e181cb23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc2a31ff-3fab-4f46-81a8-30f0e181cb23', 'volume_size': 1} Jul 30 16:53:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-666f496b-4926-4ebf-8f7e-b4a787209b67 tempest-VolumesTestJSON-1733511789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-666f496b-4926-4ebf-8f7e-b4a787209b67 tempest-VolumesTestJSON-1733511789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:06 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-666f496b-4926-4ebf-8f7e-b4a787209b67 tempest-VolumesTestJSON-1733511789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:53:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-376592171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc2a31ff-3fab-4f46-81a8-30f0e181cb23,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='954ffe29c757418faf951ebac2ab5d8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:53:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:53:06Z,use_quota=True,user_id='6eec1b3f1d524143961e787df2420342',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:53:06 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-666f496b-4926-4ebf-8f7e-b4a787209b67 tempest-VolumesTestJSON-1733511789 None] Creating volume cc2a31ff-3fab-4f46-81a8-30f0e181cb23 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:53:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-666f496b-4926-4ebf-8f7e-b4a787209b67 tempest-VolumesTestJSON-1733511789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-666f496b-4926-4ebf-8f7e-b4a787209b67 tempest-VolumesTestJSON-1733511789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:06 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-666f496b-4926-4ebf-8f7e-b4a787209b67 tempest-VolumesTestJSON-1733511789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:53:06 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-666f496b-4926-4ebf-8f7e-b4a787209b67 tempest-VolumesTestJSON-1733511789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:53:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-666f496b-4926-4ebf-8f7e-b4a787209b67 tempest-VolumesTestJSON-1733511789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:06 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-666f496b-4926-4ebf-8f7e-b4a787209b67 tempest-VolumesTestJSON-1733511789 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:53:06 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-666f496b-4926-4ebf-8f7e-b4a787209b67 tempest-VolumesTestJSON-1733511789 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 16:53:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-666f496b-4926-4ebf-8f7e-b4a787209b67 tempest-VolumesTestJSON-1733511789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-cc2a31ff-3fab-4f46-81a8-30f0e181cb23 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:06 devstack sudo[93238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-cc2a31ff-3fab-4f46-81a8-30f0e181cb23 1073741824 Jul 30 16:53:06 devstack sudo[93238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:07 devstack sudo[93238]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:07 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-666f496b-4926-4ebf-8f7e-b4a787209b67 tempest-VolumesTestJSON-1733511789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-cc2a31ff-3fab-4f46-81a8-30f0e181cb23 1073741824" returned: 0 in 0.576s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:07 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-666f496b-4926-4ebf-8f7e-b4a787209b67 tempest-VolumesTestJSON-1733511789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-cc2a31ff-3fab-4f46-81a8-30f0e181cb23 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:07 devstack sudo[93262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-cc2a31ff-3fab-4f46-81a8-30f0e181cb23 Jul 30 16:53:07 devstack sudo[93262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:07 devstack sudo[93262]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:07 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-666f496b-4926-4ebf-8f7e-b4a787209b67 tempest-VolumesTestJSON-1733511789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-cc2a31ff-3fab-4f46-81a8-30f0e181cb23" returned: 0 in 0.565s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:07 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-666f496b-4926-4ebf-8f7e-b4a787209b67 tempest-VolumesTestJSON-1733511789 None] <== create_volume: return (1212ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:53:07 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-666f496b-4926-4ebf-8f7e-b4a787209b67 tempest-VolumesTestJSON-1733511789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.216s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:07 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-666f496b-4926-4ebf-8f7e-b4a787209b67 tempest-VolumesTestJSON-1733511789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29709a16-6da6-451d-9b39-5ac4b2617216) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc2a31ff-3fab-4f46-81a8-30f0e181cb23', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:07 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-666f496b-4926-4ebf-8f7e-b4a787209b67 tempest-VolumesTestJSON-1733511789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6b627ee-ce67-4e61-ae1e-42668e1cd6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:07 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-666f496b-4926-4ebf-8f7e-b4a787209b67 tempest-VolumesTestJSON-1733511789 None] Volume volume-cc2a31ff-3fab-4f46-81a8-30f0e181cb23 (cc2a31ff-3fab-4f46-81a8-30f0e181cb23): created successfully Jul 30 16:53:07 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-666f496b-4926-4ebf-8f7e-b4a787209b67 tempest-VolumesTestJSON-1733511789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6b627ee-ce67-4e61-ae1e-42668e1cd6e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:07 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-666f496b-4926-4ebf-8f7e-b4a787209b67 tempest-VolumesTestJSON-1733511789 None] Flow 'volume_create_manager' (9653c4e5-4aff-426b-a050-7a649063d086) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:53:07 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-666f496b-4926-4ebf-8f7e-b4a787209b67 tempest-VolumesTestJSON-1733511789 None] Created volume successfully. Jul 30 16:53:11 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-977ee903-22dc-41a3-9025-38ea7eefe51d tempest-VolumesTestJSON-1733511789 None] Acquiring lock "cinder-cc2a31ff-3fab-4f46-81a8-30f0e181cb23-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:53:11 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-977ee903-22dc-41a3-9025-38ea7eefe51d tempest-VolumesTestJSON-1733511789 None] Lock "cinder-cc2a31ff-3fab-4f46-81a8-30f0e181cb23-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:53:11 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-977ee903-22dc-41a3-9025-38ea7eefe51d tempest-VolumesTestJSON-1733511789 None] Acquiring lock "cinder-quobyte-cc2a31ff-3fab-4f46-81a8-30f0e181cb23" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:53:11 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-977ee903-22dc-41a3-9025-38ea7eefe51d tempest-VolumesTestJSON-1733511789 None] Lock "cinder-quobyte-cc2a31ff-3fab-4f46-81a8-30f0e181cb23" acquired by "delete_volume" :: waited 0.045s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:53:11 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ef7001-c8de-495d-a4c3-a9386c079c72]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:53:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-977ee903-22dc-41a3-9025-38ea7eefe51d tempest-VolumesTestJSON-1733511789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-cc2a31ff-3fab-4f46-81a8-30f0e181cb23 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:11 devstack sudo[93273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-cc2a31ff-3fab-4f46-81a8-30f0e181cb23 Jul 30 16:53:11 devstack sudo[93273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:12 devstack sudo[93273]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-977ee903-22dc-41a3-9025-38ea7eefe51d tempest-VolumesTestJSON-1733511789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-cc2a31ff-3fab-4f46-81a8-30f0e181cb23" returned: 0 in 0.701s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-977ee903-22dc-41a3-9025-38ea7eefe51d tempest-VolumesTestJSON-1733511789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-cc2a31ff-3fab-4f46-81a8-30f0e181cb23 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:12 devstack sudo[93281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-cc2a31ff-3fab-4f46-81a8-30f0e181cb23 Jul 30 16:53:12 devstack sudo[93281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:12 devstack sudo[93281]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-977ee903-22dc-41a3-9025-38ea7eefe51d tempest-VolumesTestJSON-1733511789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-cc2a31ff-3fab-4f46-81a8-30f0e181cb23" returned: 0 in 0.411s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:12 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-977ee903-22dc-41a3-9025-38ea7eefe51d tempest-VolumesTestJSON-1733511789 None] Lock "cinder-quobyte-cc2a31ff-3fab-4f46-81a8-30f0e181cb23" released by "delete_volume" :: held 1.191s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:53:12 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-977ee903-22dc-41a3-9025-38ea7eefe51d tempest-VolumesTestJSON-1733511789 None] Created reservations ['7a19ca7d-6612-4ea0-bcbe-8cd204df3a9c', 'fed1d9fc-14d4-498b-844e-21729ed8e30f', '63260a87-db63-40d0-a9ba-90878abe9be1', '3c2947ec-6171-4cb2-b80b-a766504b8d53'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:53:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-977ee903-22dc-41a3-9025-38ea7eefe51d tempest-VolumesTestJSON-1733511789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-977ee903-22dc-41a3-9025-38ea7eefe51d tempest-VolumesTestJSON-1733511789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:12 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-977ee903-22dc-41a3-9025-38ea7eefe51d tempest-VolumesTestJSON-1733511789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:53:12 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-977ee903-22dc-41a3-9025-38ea7eefe51d tempest-VolumesTestJSON-1733511789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:53:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-977ee903-22dc-41a3-9025-38ea7eefe51d tempest-VolumesTestJSON-1733511789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-977ee903-22dc-41a3-9025-38ea7eefe51d tempest-VolumesTestJSON-1733511789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:12 devstack sudo[93289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:53:12 devstack sudo[93289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:13 devstack sudo[93289]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-977ee903-22dc-41a3-9025-38ea7eefe51d tempest-VolumesTestJSON-1733511789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.732s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:13 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-977ee903-22dc-41a3-9025-38ea7eefe51d tempest-VolumesTestJSON-1733511789 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:53:13 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-977ee903-22dc-41a3-9025-38ea7eefe51d tempest-VolumesTestJSON-1733511789 None] Deleted volume successfully. Jul 30 16:53:13 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-977ee903-22dc-41a3-9025-38ea7eefe51d tempest-VolumesTestJSON-1733511789 None] Lock "cinder-cc2a31ff-3fab-4f46-81a8-30f0e181cb23-delete_volume" released by "delete_volume" :: held 2.407s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:53:13 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-5ef976f2-51fd-416d-b924-da9edcaa3224 tempest-VolumesTestJSON-1733511789 None] Acquiring lock "cinder-2359e707-eae0-4244-81b1-22c094387d69-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:53:13 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-5ef976f2-51fd-416d-b924-da9edcaa3224 tempest-VolumesTestJSON-1733511789 None] Lock "cinder-2359e707-eae0-4244-81b1-22c094387d69-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:53:13 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-5ef976f2-51fd-416d-b924-da9edcaa3224 tempest-VolumesTestJSON-1733511789 None] Acquiring lock "cinder-quobyte-2359e707-eae0-4244-81b1-22c094387d69" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:53:13 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-5ef976f2-51fd-416d-b924-da9edcaa3224 tempest-VolumesTestJSON-1733511789 None] Lock "cinder-quobyte-2359e707-eae0-4244-81b1-22c094387d69" acquired by "delete_volume" :: waited 0.025s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:53:13 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[d07af9b1-c856-4dc7-ad85-61c87ff2253d]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:53:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-5ef976f2-51fd-416d-b924-da9edcaa3224 tempest-VolumesTestJSON-1733511789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2359e707-eae0-4244-81b1-22c094387d69 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:13 devstack sudo[93295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2359e707-eae0-4244-81b1-22c094387d69 Jul 30 16:53:13 devstack sudo[93295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:14 devstack sudo[93295]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-5ef976f2-51fd-416d-b924-da9edcaa3224 tempest-VolumesTestJSON-1733511789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2359e707-eae0-4244-81b1-22c094387d69" returned: 0 in 0.491s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-5ef976f2-51fd-416d-b924-da9edcaa3224 tempest-VolumesTestJSON-1733511789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2359e707-eae0-4244-81b1-22c094387d69 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:14 devstack sudo[93301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2359e707-eae0-4244-81b1-22c094387d69 Jul 30 16:53:14 devstack sudo[93301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:14 devstack sudo[93301]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-5ef976f2-51fd-416d-b924-da9edcaa3224 tempest-VolumesTestJSON-1733511789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2359e707-eae0-4244-81b1-22c094387d69" returned: 0 in 0.326s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:14 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-5ef976f2-51fd-416d-b924-da9edcaa3224 tempest-VolumesTestJSON-1733511789 None] Lock "cinder-quobyte-2359e707-eae0-4244-81b1-22c094387d69" released by "delete_volume" :: held 0.891s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:53:14 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-5ef976f2-51fd-416d-b924-da9edcaa3224 tempest-VolumesTestJSON-1733511789 None] Created reservations ['95544d7c-37f7-4bab-a675-ffb35f1bea4a', '76bac313-13a3-4c16-bc9f-5dbb21d4e863', '12b3dc86-5c6e-405f-97bc-cfa6c293e83a', '55e32c78-517b-4601-bce6-60e7d890fc40'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:53:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-5ef976f2-51fd-416d-b924-da9edcaa3224 tempest-VolumesTestJSON-1733511789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-5ef976f2-51fd-416d-b924-da9edcaa3224 tempest-VolumesTestJSON-1733511789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:14 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-5ef976f2-51fd-416d-b924-da9edcaa3224 tempest-VolumesTestJSON-1733511789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:53:14 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-5ef976f2-51fd-416d-b924-da9edcaa3224 tempest-VolumesTestJSON-1733511789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:53:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-5ef976f2-51fd-416d-b924-da9edcaa3224 tempest-VolumesTestJSON-1733511789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-5ef976f2-51fd-416d-b924-da9edcaa3224 tempest-VolumesTestJSON-1733511789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:14 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-cd8d8a80-ffb0-49f1-8aed-10ce34b77540 tempest-VolumesTestJSON-1733511789 None] Acquiring lock "cinder-8d651129-6ef7-4f1a-aa8c-292915dd2167-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:53:14 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-cd8d8a80-ffb0-49f1-8aed-10ce34b77540 tempest-VolumesTestJSON-1733511789 None] Lock "cinder-8d651129-6ef7-4f1a-aa8c-292915dd2167-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:53:14 devstack sudo[93305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:53:14 devstack sudo[93305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:15 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-cd8d8a80-ffb0-49f1-8aed-10ce34b77540 tempest-VolumesTestJSON-1733511789 None] Acquiring lock "cinder-quobyte-8d651129-6ef7-4f1a-aa8c-292915dd2167" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:53:15 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-cd8d8a80-ffb0-49f1-8aed-10ce34b77540 tempest-VolumesTestJSON-1733511789 None] Lock "cinder-quobyte-8d651129-6ef7-4f1a-aa8c-292915dd2167" acquired by "delete_volume" :: waited 0.027s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:53:15 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[44cc976b-128c-4eb9-b561-8ecfd7a5a5c2]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:53:15 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-cd8d8a80-ffb0-49f1-8aed-10ce34b77540 tempest-VolumesTestJSON-1733511789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8d651129-6ef7-4f1a-aa8c-292915dd2167 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:15 devstack sudo[93305]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:15 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-5ef976f2-51fd-416d-b924-da9edcaa3224 tempest-VolumesTestJSON-1733511789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.540s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:15 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-5ef976f2-51fd-416d-b924-da9edcaa3224 tempest-VolumesTestJSON-1733511789 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:53:15 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-5ef976f2-51fd-416d-b924-da9edcaa3224 tempest-VolumesTestJSON-1733511789 None] Deleted volume successfully. Jul 30 16:53:15 devstack sudo[93307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8d651129-6ef7-4f1a-aa8c-292915dd2167 Jul 30 16:53:15 devstack sudo[93307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:15 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-5ef976f2-51fd-416d-b924-da9edcaa3224 tempest-VolumesTestJSON-1733511789 None] Lock "cinder-2359e707-eae0-4244-81b1-22c094387d69-delete_volume" released by "delete_volume" :: held 1.872s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:53:16 devstack sudo[93307]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:16 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-cd8d8a80-ffb0-49f1-8aed-10ce34b77540 tempest-VolumesTestJSON-1733511789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8d651129-6ef7-4f1a-aa8c-292915dd2167" returned: 0 in 0.902s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:16 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-cd8d8a80-ffb0-49f1-8aed-10ce34b77540 tempest-VolumesTestJSON-1733511789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8d651129-6ef7-4f1a-aa8c-292915dd2167 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:16 devstack sudo[93313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8d651129-6ef7-4f1a-aa8c-292915dd2167 Jul 30 16:53:16 devstack sudo[93313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:16 devstack sudo[93313]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:16 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-cd8d8a80-ffb0-49f1-8aed-10ce34b77540 tempest-VolumesTestJSON-1733511789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8d651129-6ef7-4f1a-aa8c-292915dd2167" returned: 0 in 0.474s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:16 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-cd8d8a80-ffb0-49f1-8aed-10ce34b77540 tempest-VolumesTestJSON-1733511789 None] Lock "cinder-quobyte-8d651129-6ef7-4f1a-aa8c-292915dd2167" released by "delete_volume" :: held 1.461s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:53:16 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-cd8d8a80-ffb0-49f1-8aed-10ce34b77540 tempest-VolumesTestJSON-1733511789 None] Created reservations ['29488288-6941-4d3c-9f7f-b57e8282a59b', 'f8f3405d-f645-48d8-bf37-9398ed991b62', 'e74ed6a2-9155-47ab-a52e-7f84d879f4fc', '8b808305-8164-4683-946d-b172f2ef3d45'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:53:16 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-cd8d8a80-ffb0-49f1-8aed-10ce34b77540 tempest-VolumesTestJSON-1733511789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:16 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-cd8d8a80-ffb0-49f1-8aed-10ce34b77540 tempest-VolumesTestJSON-1733511789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:16 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-cd8d8a80-ffb0-49f1-8aed-10ce34b77540 tempest-VolumesTestJSON-1733511789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:53:16 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-cd8d8a80-ffb0-49f1-8aed-10ce34b77540 tempest-VolumesTestJSON-1733511789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:53:16 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-cd8d8a80-ffb0-49f1-8aed-10ce34b77540 tempest-VolumesTestJSON-1733511789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:16 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-cd8d8a80-ffb0-49f1-8aed-10ce34b77540 tempest-VolumesTestJSON-1733511789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:16 devstack sudo[93329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:53:16 devstack sudo[93329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:17 devstack sudo[93329]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-cd8d8a80-ffb0-49f1-8aed-10ce34b77540 tempest-VolumesTestJSON-1733511789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.556s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:17 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-cd8d8a80-ffb0-49f1-8aed-10ce34b77540 tempest-VolumesTestJSON-1733511789 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:53:17 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-cd8d8a80-ffb0-49f1-8aed-10ce34b77540 tempest-VolumesTestJSON-1733511789 None] Deleted volume successfully. Jul 30 16:53:17 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-cd8d8a80-ffb0-49f1-8aed-10ce34b77540 tempest-VolumesTestJSON-1733511789 None] Lock "cinder-8d651129-6ef7-4f1a-aa8c-292915dd2167-delete_volume" released by "delete_volume" :: held 2.502s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:53:24 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-fac0500a-961c-4221-8739-462ad9826796 tempest-GroupsV314Test-1354399987 None] Group tempest-GroupsV314Test-Group-911536306: creating Jul 30 16:53:24 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-fac0500a-961c-4221-8739-462ad9826796 tempest-GroupsV314Test-1354399987 None] Group tempest-GroupsV314Test-Group-911536306: created successfully Jul 30 16:53:24 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-fac0500a-961c-4221-8739-462ad9826796 tempest-GroupsV314Test-1354399987 None] Create group completed successfully. Jul 30 16:53:26 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-aeb1c4f1-400f-4f69-b29b-f91fde720784 tempest-GroupsV314Test-1354399987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:53:26 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-aeb1c4f1-400f-4f69-b29b-f91fde720784 tempest-GroupsV314Test-1354399987 None] Flow 'volume_create_manager' (6d6b7f5d-6137-4e73-9835-6fb96470273b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:53:26 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-aeb1c4f1-400f-4f69-b29b-f91fde720784 tempest-GroupsV314Test-1354399987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d985f90-337c-48f4-bd40-0b0d17becd06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:26 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-aeb1c4f1-400f-4f69-b29b-f91fde720784 tempest-GroupsV314Test-1354399987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d985f90-337c-48f4-bd40-0b0d17becd06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:53:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1393185572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e3123135-afe6-483c-9e20-b6e9880fbf8d,host='devstack@QuobyteHD#QuobyteHD',id=8e112a41-4a5a-4d40-94b3-f94ad63e76c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b775149f2fd4b25b6049bc0f1ae16ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:53:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:53:26Z,use_quota=True,user_id='4eb55b1907aa4c47b9e53fe03b4b6306',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(25ae6718-83e4-4783-a0b4-28426bdcb06b),volume_type_id=25ae6718-83e4-4783-a0b4-28426bdcb06b)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:26 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-aeb1c4f1-400f-4f69-b29b-f91fde720784 tempest-GroupsV314Test-1354399987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe418f52-15d0-4106-8c59-a56ba30c8ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:26 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-aeb1c4f1-400f-4f69-b29b-f91fde720784 tempest-GroupsV314Test-1354399987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe418f52-15d0-4106-8c59-a56ba30c8ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:26 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-aeb1c4f1-400f-4f69-b29b-f91fde720784 tempest-GroupsV314Test-1354399987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1947d305-b656-4a3f-a197-fc5ba71b3384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:26 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-aeb1c4f1-400f-4f69-b29b-f91fde720784 tempest-GroupsV314Test-1354399987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1947d305-b656-4a3f-a197-fc5ba71b3384) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e112a41-4a5a-4d40-94b3-f94ad63e76c6', 'volume_name': 'volume-8e112a41-4a5a-4d40-94b3-f94ad63e76c6', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:26 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-aeb1c4f1-400f-4f69-b29b-f91fde720784 tempest-GroupsV314Test-1354399987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1494d551-0b4f-4052-84ca-1503910d3ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:26 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-aeb1c4f1-400f-4f69-b29b-f91fde720784 tempest-GroupsV314Test-1354399987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1494d551-0b4f-4052-84ca-1503910d3ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:26 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-aeb1c4f1-400f-4f69-b29b-f91fde720784 tempest-GroupsV314Test-1354399987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ad3f115-babe-447e-bccd-be622b934747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:26 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-aeb1c4f1-400f-4f69-b29b-f91fde720784 tempest-GroupsV314Test-1354399987 None] Volume 8e112a41-4a5a-4d40-94b3-f94ad63e76c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e112a41-4a5a-4d40-94b3-f94ad63e76c6', 'volume_size': 1} Jul 30 16:53:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-aeb1c4f1-400f-4f69-b29b-f91fde720784 tempest-GroupsV314Test-1354399987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-aeb1c4f1-400f-4f69-b29b-f91fde720784 tempest-GroupsV314Test-1354399987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:26 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-aeb1c4f1-400f-4f69-b29b-f91fde720784 tempest-GroupsV314Test-1354399987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e3123135-afe6-483c-9e20-b6e9880fbf8d,created_at=2026-07-30T14:53:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1393185572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e3123135-afe6-483c-9e20-b6e9880fbf8d,host='devstack@QuobyteHD#QuobyteHD',id=8e112a41-4a5a-4d40-94b3-f94ad63e76c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b775149f2fd4b25b6049bc0f1ae16ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:53:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:53:26Z,use_quota=True,user_id='4eb55b1907aa4c47b9e53fe03b4b6306',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(25ae6718-83e4-4783-a0b4-28426bdcb06b),volume_type_id=25ae6718-83e4-4783-a0b4-28426bdcb06b)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:53:26 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-aeb1c4f1-400f-4f69-b29b-f91fde720784 tempest-GroupsV314Test-1354399987 None] Creating volume 8e112a41-4a5a-4d40-94b3-f94ad63e76c6 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:53:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-aeb1c4f1-400f-4f69-b29b-f91fde720784 tempest-GroupsV314Test-1354399987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-aeb1c4f1-400f-4f69-b29b-f91fde720784 tempest-GroupsV314Test-1354399987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:26 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-aeb1c4f1-400f-4f69-b29b-f91fde720784 tempest-GroupsV314Test-1354399987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:53:26 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-aeb1c4f1-400f-4f69-b29b-f91fde720784 tempest-GroupsV314Test-1354399987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:53:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-aeb1c4f1-400f-4f69-b29b-f91fde720784 tempest-GroupsV314Test-1354399987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:26 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-aeb1c4f1-400f-4f69-b29b-f91fde720784 tempest-GroupsV314Test-1354399987 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:53:26 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-aeb1c4f1-400f-4f69-b29b-f91fde720784 tempest-GroupsV314Test-1354399987 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 16:53:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-aeb1c4f1-400f-4f69-b29b-f91fde720784 tempest-GroupsV314Test-1354399987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8e112a41-4a5a-4d40-94b3-f94ad63e76c6 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:26 devstack sudo[93494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8e112a41-4a5a-4d40-94b3-f94ad63e76c6 1073741824 Jul 30 16:53:26 devstack sudo[93494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:26 devstack sudo[93494]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-aeb1c4f1-400f-4f69-b29b-f91fde720784 tempest-GroupsV314Test-1354399987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8e112a41-4a5a-4d40-94b3-f94ad63e76c6 1073741824" returned: 0 in 0.414s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-aeb1c4f1-400f-4f69-b29b-f91fde720784 tempest-GroupsV314Test-1354399987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8e112a41-4a5a-4d40-94b3-f94ad63e76c6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:26 devstack sudo[93499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8e112a41-4a5a-4d40-94b3-f94ad63e76c6 Jul 30 16:53:26 devstack sudo[93499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:27 devstack sudo[93499]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:27 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-aeb1c4f1-400f-4f69-b29b-f91fde720784 tempest-GroupsV314Test-1354399987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8e112a41-4a5a-4d40-94b3-f94ad63e76c6" returned: 0 in 0.247s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:27 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-aeb1c4f1-400f-4f69-b29b-f91fde720784 tempest-GroupsV314Test-1354399987 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:53:27 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-aeb1c4f1-400f-4f69-b29b-f91fde720784 tempest-GroupsV314Test-1354399987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:27 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-aeb1c4f1-400f-4f69-b29b-f91fde720784 tempest-GroupsV314Test-1354399987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ad3f115-babe-447e-bccd-be622b934747) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e112a41-4a5a-4d40-94b3-f94ad63e76c6', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:27 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-aeb1c4f1-400f-4f69-b29b-f91fde720784 tempest-GroupsV314Test-1354399987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8b69e68-6f27-4c11-afcc-a3db4399f576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:27 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-aeb1c4f1-400f-4f69-b29b-f91fde720784 tempest-GroupsV314Test-1354399987 None] Volume volume-8e112a41-4a5a-4d40-94b3-f94ad63e76c6 (8e112a41-4a5a-4d40-94b3-f94ad63e76c6): created successfully Jul 30 16:53:27 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-aeb1c4f1-400f-4f69-b29b-f91fde720784 tempest-GroupsV314Test-1354399987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8b69e68-6f27-4c11-afcc-a3db4399f576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:27 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-aeb1c4f1-400f-4f69-b29b-f91fde720784 tempest-GroupsV314Test-1354399987 None] Flow 'volume_create_manager' (6d6b7f5d-6137-4e73-9835-6fb96470273b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:53:27 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-aeb1c4f1-400f-4f69-b29b-f91fde720784 tempest-GroupsV314Test-1354399987 None] Created volume successfully. Jul 30 16:53:27 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-d641bfa9-9af7-46d6-a4a5-4c1fea94464b tempest-GroupsV314Test-1354399987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:27 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-d641bfa9-9af7-46d6-a4a5-4c1fea94464b tempest-GroupsV314Test-1354399987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:27 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-d641bfa9-9af7-46d6-a4a5-4c1fea94464b tempest-GroupsV314Test-1354399987 None] Cloning volume 8e112a41-4a5a-4d40-94b3-f94ad63e76c6 to volume 552b2da8-6f17-4aaa-962f-9015066d2fd7 Jul 30 16:53:28 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-d641bfa9-9af7-46d6-a4a5-4c1fea94464b tempest-GroupsV314Test-1354399987 None] Creating offline snapshot 247b0a89-7933-4ed2-a430-b5c68c076973 of volume 8e112a41-4a5a-4d40-94b3-f94ad63e76c6 {{(pid=88568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:53:28 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf05bf3-0e49-43bb-8ba9-798e793b0dad]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:53:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d641bfa9-9af7-46d6-a4a5-4c1fea94464b tempest-GroupsV314Test-1354399987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8e112a41-4a5a-4d40-94b3-f94ad63e76c6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:28 devstack sudo[93502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8e112a41-4a5a-4d40-94b3-f94ad63e76c6 Jul 30 16:53:28 devstack sudo[93502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:28 devstack sudo[93502]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d641bfa9-9af7-46d6-a4a5-4c1fea94464b tempest-GroupsV314Test-1354399987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8e112a41-4a5a-4d40-94b3-f94ad63e76c6" returned: 0 in 0.407s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d641bfa9-9af7-46d6-a4a5-4c1fea94464b tempest-GroupsV314Test-1354399987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8e112a41-4a5a-4d40-94b3-f94ad63e76c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8e112a41-4a5a-4d40-94b3-f94ad63e76c6.247b0a89-7933-4ed2-a430-b5c68c076973 1G {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:28 devstack sudo[93507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8e112a41-4a5a-4d40-94b3-f94ad63e76c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8e112a41-4a5a-4d40-94b3-f94ad63e76c6.247b0a89-7933-4ed2-a430-b5c68c076973 1G Jul 30 16:53:28 devstack sudo[93507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:28 devstack sudo[93507]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d641bfa9-9af7-46d6-a4a5-4c1fea94464b tempest-GroupsV314Test-1354399987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8e112a41-4a5a-4d40-94b3-f94ad63e76c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8e112a41-4a5a-4d40-94b3-f94ad63e76c6.247b0a89-7933-4ed2-a430-b5c68c076973 1G" returned: 0 in 0.421s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d641bfa9-9af7-46d6-a4a5-4c1fea94464b tempest-GroupsV314Test-1354399987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e112a41-4a5a-4d40-94b3-f94ad63e76c6 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8e112a41-4a5a-4d40-94b3-f94ad63e76c6.247b0a89-7933-4ed2-a430-b5c68c076973 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:28 devstack sudo[93512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e112a41-4a5a-4d40-94b3-f94ad63e76c6 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8e112a41-4a5a-4d40-94b3-f94ad63e76c6.247b0a89-7933-4ed2-a430-b5c68c076973 Jul 30 16:53:28 devstack sudo[93512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:29 devstack sudo[93512]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d641bfa9-9af7-46d6-a4a5-4c1fea94464b tempest-GroupsV314Test-1354399987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e112a41-4a5a-4d40-94b3-f94ad63e76c6 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8e112a41-4a5a-4d40-94b3-f94ad63e76c6.247b0a89-7933-4ed2-a430-b5c68c076973" returned: 0 in 0.396s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:29 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-d641bfa9-9af7-46d6-a4a5-4c1fea94464b tempest-GroupsV314Test-1354399987 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8e112a41-4a5a-4d40-94b3-f94ad63e76c6.247b0a89-7933-4ed2-a430-b5c68c076973 is being set with open permissions: ugo+rw: NotImplementedError Jul 30 16:53:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d641bfa9-9af7-46d6-a4a5-4c1fea94464b tempest-GroupsV314Test-1354399987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8e112a41-4a5a-4d40-94b3-f94ad63e76c6.247b0a89-7933-4ed2-a430-b5c68c076973 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:29 devstack sudo[93553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8e112a41-4a5a-4d40-94b3-f94ad63e76c6.247b0a89-7933-4ed2-a430-b5c68c076973 Jul 30 16:53:29 devstack sudo[93553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:29 devstack sudo[93553]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d641bfa9-9af7-46d6-a4a5-4c1fea94464b tempest-GroupsV314Test-1354399987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8e112a41-4a5a-4d40-94b3-f94ad63e76c6.247b0a89-7933-4ed2-a430-b5c68c076973" returned: 0 in 0.340s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d641bfa9-9af7-46d6-a4a5-4c1fea94464b tempest-GroupsV314Test-1354399987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8e112a41-4a5a-4d40-94b3-f94ad63e76c6.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:29 devstack sudo[93557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8e112a41-4a5a-4d40-94b3-f94ad63e76c6.info Jul 30 16:53:29 devstack sudo[93557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:30 devstack sudo[93557]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:30 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d641bfa9-9af7-46d6-a4a5-4c1fea94464b tempest-GroupsV314Test-1354399987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8e112a41-4a5a-4d40-94b3-f94ad63e76c6.info" returned: 0 in 0.312s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:30 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-d641bfa9-9af7-46d6-a4a5-4c1fea94464b tempest-GroupsV314Test-1354399987 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8e112a41-4a5a-4d40-94b3-f94ad63e76c6.info is being set with open permissions: ugo+rw: NotImplementedError Jul 30 16:53:30 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d641bfa9-9af7-46d6-a4a5-4c1fea94464b tempest-GroupsV314Test-1354399987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8e112a41-4a5a-4d40-94b3-f94ad63e76c6.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:30 devstack sudo[93560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8e112a41-4a5a-4d40-94b3-f94ad63e76c6.info Jul 30 16:53:30 devstack sudo[93560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:30 devstack sudo[93560]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:30 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d641bfa9-9af7-46d6-a4a5-4c1fea94464b tempest-GroupsV314Test-1354399987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8e112a41-4a5a-4d40-94b3-f94ad63e76c6.info" returned: 0 in 0.386s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:30 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-d641bfa9-9af7-46d6-a4a5-4c1fea94464b tempest-GroupsV314Test-1354399987 None] Acquiring lock "cinder-quobyte-552b2da8-6f17-4aaa-962f-9015066d2fd7" by "_copy_volume_from_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:53:30 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-d641bfa9-9af7-46d6-a4a5-4c1fea94464b tempest-GroupsV314Test-1354399987 None] Lock "cinder-quobyte-552b2da8-6f17-4aaa-962f-9015066d2fd7" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:53:30 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-d641bfa9-9af7-46d6-a4a5-4c1fea94464b tempest-GroupsV314Test-1354399987 None] snapshot: 247b0a89-7933-4ed2-a430-b5c68c076973, volume: 552b2da8-6f17-4aaa-962f-9015066d2fd7, {{(pid=88568) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 30 16:53:30 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-d641bfa9-9af7-46d6-a4a5-4c1fea94464b tempest-GroupsV314Test-1354399987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:30 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-d641bfa9-9af7-46d6-a4a5-4c1fea94464b tempest-GroupsV314Test-1354399987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:30 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-d641bfa9-9af7-46d6-a4a5-4c1fea94464b tempest-GroupsV314Test-1354399987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:53:30 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-d641bfa9-9af7-46d6-a4a5-4c1fea94464b tempest-GroupsV314Test-1354399987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:53:30 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-d641bfa9-9af7-46d6-a4a5-4c1fea94464b tempest-GroupsV314Test-1354399987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:30 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee95e0b8-e51b-441e-921f-14bbffc3df90]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:53:30 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d641bfa9-9af7-46d6-a4a5-4c1fea94464b tempest-GroupsV314Test-1354399987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8e112a41-4a5a-4d40-94b3-f94ad63e76c6.247b0a89-7933-4ed2-a430-b5c68c076973 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:30 devstack sudo[93563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8e112a41-4a5a-4d40-94b3-f94ad63e76c6.247b0a89-7933-4ed2-a430-b5c68c076973 Jul 30 16:53:30 devstack sudo[93563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:31 devstack sudo[93563]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:31 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d641bfa9-9af7-46d6-a4a5-4c1fea94464b tempest-GroupsV314Test-1354399987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8e112a41-4a5a-4d40-94b3-f94ad63e76c6.247b0a89-7933-4ed2-a430-b5c68c076973" returned: 0 in 0.558s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:31 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-d641bfa9-9af7-46d6-a4a5-4c1fea94464b tempest-GroupsV314Test-1354399987 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e112a41-4a5a-4d40-94b3-f94ad63e76c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:53:31 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[90dd6527-d1fa-413f-92ae-64c743569dc9]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:53:31 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d641bfa9-9af7-46d6-a4a5-4c1fea94464b tempest-GroupsV314Test-1354399987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8e112a41-4a5a-4d40-94b3-f94ad63e76c6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:31 devstack sudo[93568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8e112a41-4a5a-4d40-94b3-f94ad63e76c6 Jul 30 16:53:31 devstack sudo[93568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:31 devstack sudo[93568]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:31 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d641bfa9-9af7-46d6-a4a5-4c1fea94464b tempest-GroupsV314Test-1354399987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8e112a41-4a5a-4d40-94b3-f94ad63e76c6" returned: 0 in 0.419s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:31 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-d641bfa9-9af7-46d6-a4a5-4c1fea94464b tempest-GroupsV314Test-1354399987 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8e112a41-4a5a-4d40-94b3-f94ad63e76c6 {{(pid=88568) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 30 16:53:31 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-d641bfa9-9af7-46d6-a4a5-4c1fea94464b tempest-GroupsV314Test-1354399987 None] Creating direct copy from snapshot {{(pid=88568) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 30 16:53:31 devstack cinder-volume[88568]: DEBUG cinder.utils [None req-d641bfa9-9af7-46d6-a4a5-4c1fea94464b tempest-GroupsV314Test-1354399987 None] Path /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-552b2da8-6f17-4aaa-962f-9015066d2fd7 not found in is_blk_device check {{(pid=88568) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 30 16:53:31 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d641bfa9-9af7-46d6-a4a5-4c1fea94464b tempest-GroupsV314Test-1354399987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8e112a41-4a5a-4d40-94b3-f94ad63e76c6 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-552b2da8-6f17-4aaa-962f-9015066d2fd7 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:31 devstack sudo[93578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8e112a41-4a5a-4d40-94b3-f94ad63e76c6 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-552b2da8-6f17-4aaa-962f-9015066d2fd7 Jul 30 16:53:31 devstack sudo[93578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:32 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9865eb0-9903-4bf5-818d-0e9caaeea049 tempest-AttachVolumeTestJSON-1381673265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:53:32 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f9865eb0-9903-4bf5-818d-0e9caaeea049 tempest-AttachVolumeTestJSON-1381673265 None] Flow 'volume_create_manager' (4fb9fea4-bee8-4f39-a071-840727d9c77e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:53:33 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f9865eb0-9903-4bf5-818d-0e9caaeea049 tempest-AttachVolumeTestJSON-1381673265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a9e610f-6d3a-41d0-8145-b38bdfd898a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:33 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f9865eb0-9903-4bf5-818d-0e9caaeea049 tempest-AttachVolumeTestJSON-1381673265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a9e610f-6d3a-41d0-8145-b38bdfd898a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:53:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1798117260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f74e087-2d4b-4f7c-9797-e0a20c00ffe8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b219135d1cf44e32a38d2e55a15cc768',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:53:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:53:33Z,use_quota=True,user_id='0f5f98258baf41b7980b7f1e7e487bdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:33 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f9865eb0-9903-4bf5-818d-0e9caaeea049 tempest-AttachVolumeTestJSON-1381673265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f2f6197-7ff7-42d3-a6ee-9c47d9d132aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:33 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f9865eb0-9903-4bf5-818d-0e9caaeea049 tempest-AttachVolumeTestJSON-1381673265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f2f6197-7ff7-42d3-a6ee-9c47d9d132aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:33 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f9865eb0-9903-4bf5-818d-0e9caaeea049 tempest-AttachVolumeTestJSON-1381673265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8c58dea-8b6b-4cd3-b82b-3f402c0b1d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:33 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f9865eb0-9903-4bf5-818d-0e9caaeea049 tempest-AttachVolumeTestJSON-1381673265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8c58dea-8b6b-4cd3-b82b-3f402c0b1d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f74e087-2d4b-4f7c-9797-e0a20c00ffe8', 'volume_name': 'volume-6f74e087-2d4b-4f7c-9797-e0a20c00ffe8', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:33 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f9865eb0-9903-4bf5-818d-0e9caaeea049 tempest-AttachVolumeTestJSON-1381673265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9f2ff02-5b71-446c-9ce9-01b7f1ae6369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:33 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f9865eb0-9903-4bf5-818d-0e9caaeea049 tempest-AttachVolumeTestJSON-1381673265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9f2ff02-5b71-446c-9ce9-01b7f1ae6369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:33 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f9865eb0-9903-4bf5-818d-0e9caaeea049 tempest-AttachVolumeTestJSON-1381673265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fea9a6d-fd0d-48d3-acd7-cb007b6dc482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:33 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-f9865eb0-9903-4bf5-818d-0e9caaeea049 tempest-AttachVolumeTestJSON-1381673265 None] Volume 6f74e087-2d4b-4f7c-9797-e0a20c00ffe8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f74e087-2d4b-4f7c-9797-e0a20c00ffe8', 'volume_size': 1} Jul 30 16:53:33 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-f9865eb0-9903-4bf5-818d-0e9caaeea049 tempest-AttachVolumeTestJSON-1381673265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:34 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-68b216d7-bdcc-4961-a5ae-4bac6368847a tempest-ServerActionsTestOtherA-332393488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:53:34 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-68b216d7-bdcc-4961-a5ae-4bac6368847a tempest-ServerActionsTestOtherA-332393488 None] Flow 'volume_create_manager' (5817ee83-70ef-4b39-bf29-46e7c932dc74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:53:34 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-68b216d7-bdcc-4961-a5ae-4bac6368847a tempest-ServerActionsTestOtherA-332393488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e968f8b3-f2df-4257-95f0-4d9540611c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:34 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-68b216d7-bdcc-4961-a5ae-4bac6368847a tempest-ServerActionsTestOtherA-332393488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e968f8b3-f2df-4257-95f0-4d9540611c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:53:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1809633542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60604682-ec4c-4fb2-937a-7cf43dbcc110,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d7af4f33f124748824adfc606cb56a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:53:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:53:34Z,use_quota=True,user_id='9cea3b2ac99346ce81f3e2b30c996066',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:34 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-68b216d7-bdcc-4961-a5ae-4bac6368847a tempest-ServerActionsTestOtherA-332393488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3576ba4-1207-48b6-a613-421ab5d1c379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:34 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-68b216d7-bdcc-4961-a5ae-4bac6368847a tempest-ServerActionsTestOtherA-332393488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3576ba4-1207-48b6-a613-421ab5d1c379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:34 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-68b216d7-bdcc-4961-a5ae-4bac6368847a tempest-ServerActionsTestOtherA-332393488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (892cd7d4-deac-480b-b74d-64786a500e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:34 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-68b216d7-bdcc-4961-a5ae-4bac6368847a tempest-ServerActionsTestOtherA-332393488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (892cd7d4-deac-480b-b74d-64786a500e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60604682-ec4c-4fb2-937a-7cf43dbcc110', 'volume_name': 'volume-60604682-ec4c-4fb2-937a-7cf43dbcc110', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:34 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-68b216d7-bdcc-4961-a5ae-4bac6368847a tempest-ServerActionsTestOtherA-332393488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5f09135-0db6-49cb-8520-ab20a2c36682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:34 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-68b216d7-bdcc-4961-a5ae-4bac6368847a tempest-ServerActionsTestOtherA-332393488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5f09135-0db6-49cb-8520-ab20a2c36682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:34 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-68b216d7-bdcc-4961-a5ae-4bac6368847a tempest-ServerActionsTestOtherA-332393488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (351f6128-d8b5-4bb7-a5ed-c2a6db6c186a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:34 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-68b216d7-bdcc-4961-a5ae-4bac6368847a tempest-ServerActionsTestOtherA-332393488 None] Volume 60604682-ec4c-4fb2-937a-7cf43dbcc110: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60604682-ec4c-4fb2-937a-7cf43dbcc110', 'volume_size': 1} Jul 30 16:53:34 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-68b216d7-bdcc-4961-a5ae-4bac6368847a tempest-ServerActionsTestOtherA-332393488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:38 devstack sudo[93578]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:38 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d641bfa9-9af7-46d6-a4a5-4c1fea94464b tempest-GroupsV314Test-1354399987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8e112a41-4a5a-4d40-94b3-f94ad63e76c6 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-552b2da8-6f17-4aaa-962f-9015066d2fd7" returned: 0 in 6.968s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:38 devstack cinder-volume[88568]: DEBUG cinder.image.image_utils [None req-d641bfa9-9af7-46d6-a4a5-4c1fea94464b tempest-GroupsV314Test-1354399987 None] Image conversion details: src /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8e112a41-4a5a-4d40-94b3-f94ad63e76c6, size 1024.00 MB, duration 6.97 sec, destination /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-552b2da8-6f17-4aaa-962f-9015066d2fd7 {{(pid=88568) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 16:53:38 devstack cinder-volume[88568]: INFO cinder.image.image_utils [None req-d641bfa9-9af7-46d6-a4a5-4c1fea94464b tempest-GroupsV314Test-1354399987 None] Converted 1024.00 MB image at 146.93 MB/s Jul 30 16:53:38 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-d641bfa9-9af7-46d6-a4a5-4c1fea94464b tempest-GroupsV314Test-1354399987 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-552b2da8-6f17-4aaa-962f-9015066d2fd7 is being set with open permissions: ugo+rw: NotImplementedError Jul 30 16:53:38 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d641bfa9-9af7-46d6-a4a5-4c1fea94464b tempest-GroupsV314Test-1354399987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-552b2da8-6f17-4aaa-962f-9015066d2fd7 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:38 devstack sudo[93629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-552b2da8-6f17-4aaa-962f-9015066d2fd7 Jul 30 16:53:38 devstack sudo[93629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:38 devstack sudo[93629]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:38 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d641bfa9-9af7-46d6-a4a5-4c1fea94464b tempest-GroupsV314Test-1354399987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-552b2da8-6f17-4aaa-962f-9015066d2fd7" returned: 0 in 0.269s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:38 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-d641bfa9-9af7-46d6-a4a5-4c1fea94464b tempest-GroupsV314Test-1354399987 None] Lock "cinder-quobyte-552b2da8-6f17-4aaa-962f-9015066d2fd7" released by "_copy_volume_from_snapshot" :: held 8.309s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:53:38 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-d641bfa9-9af7-46d6-a4a5-4c1fea94464b tempest-GroupsV314Test-1354399987 None] Acquiring lock "cinder-quobyte-247b0a89-7933-4ed2-a430-b5c68c076973" by "_delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:53:38 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-d641bfa9-9af7-46d6-a4a5-4c1fea94464b tempest-GroupsV314Test-1354399987 None] Lock "cinder-quobyte-247b0a89-7933-4ed2-a430-b5c68c076973" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:53:38 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-d641bfa9-9af7-46d6-a4a5-4c1fea94464b tempest-GroupsV314Test-1354399987 None] Deleting offline snapshot 247b0a89-7933-4ed2-a430-b5c68c076973 of volume 8e112a41-4a5a-4d40-94b3-f94ad63e76c6 {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:53:38 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-d641bfa9-9af7-46d6-a4a5-4c1fea94464b tempest-GroupsV314Test-1354399987 None] snapshot_file for this snap is: volume-8e112a41-4a5a-4d40-94b3-f94ad63e76c6.247b0a89-7933-4ed2-a430-b5c68c076973 {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:53:38 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b13596-4dcd-43ab-9c9e-dc3cee5ab5a0]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:53:38 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d641bfa9-9af7-46d6-a4a5-4c1fea94464b tempest-GroupsV314Test-1354399987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8e112a41-4a5a-4d40-94b3-f94ad63e76c6.247b0a89-7933-4ed2-a430-b5c68c076973 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:38 devstack sudo[93632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8e112a41-4a5a-4d40-94b3-f94ad63e76c6.247b0a89-7933-4ed2-a430-b5c68c076973 Jul 30 16:53:38 devstack sudo[93632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:39 devstack sudo[93632]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:39 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d641bfa9-9af7-46d6-a4a5-4c1fea94464b tempest-GroupsV314Test-1354399987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8e112a41-4a5a-4d40-94b3-f94ad63e76c6.247b0a89-7933-4ed2-a430-b5c68c076973" returned: 0 in 0.390s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:39 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-d641bfa9-9af7-46d6-a4a5-4c1fea94464b tempest-GroupsV314Test-1354399987 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e112a41-4a5a-4d40-94b3-f94ad63e76c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:53:39 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ba7fca-2c90-450d-ab64-a885945bb1d2]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:53:39 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d641bfa9-9af7-46d6-a4a5-4c1fea94464b tempest-GroupsV314Test-1354399987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8e112a41-4a5a-4d40-94b3-f94ad63e76c6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:39 devstack sudo[93638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8e112a41-4a5a-4d40-94b3-f94ad63e76c6 Jul 30 16:53:39 devstack sudo[93638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:39 devstack sudo[93638]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:39 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d641bfa9-9af7-46d6-a4a5-4c1fea94464b tempest-GroupsV314Test-1354399987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8e112a41-4a5a-4d40-94b3-f94ad63e76c6" returned: 0 in 0.558s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:39 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d641bfa9-9af7-46d6-a4a5-4c1fea94464b tempest-GroupsV314Test-1354399987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8e112a41-4a5a-4d40-94b3-f94ad63e76c6.247b0a89-7933-4ed2-a430-b5c68c076973 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:39 devstack sudo[93644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8e112a41-4a5a-4d40-94b3-f94ad63e76c6.247b0a89-7933-4ed2-a430-b5c68c076973 Jul 30 16:53:39 devstack sudo[93644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:40 devstack sudo[93644]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:40 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d641bfa9-9af7-46d6-a4a5-4c1fea94464b tempest-GroupsV314Test-1354399987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8e112a41-4a5a-4d40-94b3-f94ad63e76c6.247b0a89-7933-4ed2-a430-b5c68c076973" returned: 0 in 0.390s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:40 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d641bfa9-9af7-46d6-a4a5-4c1fea94464b tempest-GroupsV314Test-1354399987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8e112a41-4a5a-4d40-94b3-f94ad63e76c6.247b0a89-7933-4ed2-a430-b5c68c076973 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:40 devstack sudo[93652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8e112a41-4a5a-4d40-94b3-f94ad63e76c6.247b0a89-7933-4ed2-a430-b5c68c076973 Jul 30 16:53:40 devstack sudo[93652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:40 devstack sudo[93652]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:40 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d641bfa9-9af7-46d6-a4a5-4c1fea94464b tempest-GroupsV314Test-1354399987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8e112a41-4a5a-4d40-94b3-f94ad63e76c6.247b0a89-7933-4ed2-a430-b5c68c076973" returned: 0 in 0.262s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:40 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-d641bfa9-9af7-46d6-a4a5-4c1fea94464b tempest-GroupsV314Test-1354399987 None] Lock "cinder-quobyte-247b0a89-7933-4ed2-a430-b5c68c076973" released by "_delete_snapshot" :: held 1.716s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:53:40 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-d641bfa9-9af7-46d6-a4a5-4c1fea94464b tempest-GroupsV314Test-1354399987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.559s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:40 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-f9865eb0-9903-4bf5-818d-0e9caaeea049 tempest-AttachVolumeTestJSON-1381673265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.238s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:40 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-f9865eb0-9903-4bf5-818d-0e9caaeea049 tempest-AttachVolumeTestJSON-1381673265 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:53:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1798117260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f74e087-2d4b-4f7c-9797-e0a20c00ffe8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b219135d1cf44e32a38d2e55a15cc768',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:53:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:53:33Z,use_quota=True,user_id='0f5f98258baf41b7980b7f1e7e487bdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:53:40 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-f9865eb0-9903-4bf5-818d-0e9caaeea049 tempest-AttachVolumeTestJSON-1381673265 None] Creating volume 6f74e087-2d4b-4f7c-9797-e0a20c00ffe8 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:53:40 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-f9865eb0-9903-4bf5-818d-0e9caaeea049 tempest-AttachVolumeTestJSON-1381673265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:40 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-f9865eb0-9903-4bf5-818d-0e9caaeea049 tempest-AttachVolumeTestJSON-1381673265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:40 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-f9865eb0-9903-4bf5-818d-0e9caaeea049 tempest-AttachVolumeTestJSON-1381673265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:53:40 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-f9865eb0-9903-4bf5-818d-0e9caaeea049 tempest-AttachVolumeTestJSON-1381673265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:53:40 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-f9865eb0-9903-4bf5-818d-0e9caaeea049 tempest-AttachVolumeTestJSON-1381673265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:40 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-f9865eb0-9903-4bf5-818d-0e9caaeea049 tempest-AttachVolumeTestJSON-1381673265 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:53:40 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-f9865eb0-9903-4bf5-818d-0e9caaeea049 tempest-AttachVolumeTestJSON-1381673265 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 16:53:40 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f9865eb0-9903-4bf5-818d-0e9caaeea049 tempest-AttachVolumeTestJSON-1381673265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6f74e087-2d4b-4f7c-9797-e0a20c00ffe8 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:40 devstack sudo[93655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6f74e087-2d4b-4f7c-9797-e0a20c00ffe8 1073741824 Jul 30 16:53:40 devstack sudo[93655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:40 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-d641bfa9-9af7-46d6-a4a5-4c1fea94464b tempest-GroupsV314Test-1354399987 None] Create group from source-group-e3123135-afe6-483c-9e20-b6e9880fbf8d completed successfully. Jul 30 16:53:41 devstack sudo[93655]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:41 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f9865eb0-9903-4bf5-818d-0e9caaeea049 tempest-AttachVolumeTestJSON-1381673265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6f74e087-2d4b-4f7c-9797-e0a20c00ffe8 1073741824" returned: 0 in 0.551s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:41 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f9865eb0-9903-4bf5-818d-0e9caaeea049 tempest-AttachVolumeTestJSON-1381673265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6f74e087-2d4b-4f7c-9797-e0a20c00ffe8 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:41 devstack sudo[93662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6f74e087-2d4b-4f7c-9797-e0a20c00ffe8 Jul 30 16:53:41 devstack sudo[93662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:41 devstack sudo[93662]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:41 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f9865eb0-9903-4bf5-818d-0e9caaeea049 tempest-AttachVolumeTestJSON-1381673265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6f74e087-2d4b-4f7c-9797-e0a20c00ffe8" returned: 0 in 0.283s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:41 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-f9865eb0-9903-4bf5-818d-0e9caaeea049 tempest-AttachVolumeTestJSON-1381673265 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:53:41 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-f9865eb0-9903-4bf5-818d-0e9caaeea049 tempest-AttachVolumeTestJSON-1381673265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:41 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-68b216d7-bdcc-4961-a5ae-4bac6368847a tempest-ServerActionsTestOtherA-332393488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.034s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:41 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-68b216d7-bdcc-4961-a5ae-4bac6368847a tempest-ServerActionsTestOtherA-332393488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:53:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1809633542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60604682-ec4c-4fb2-937a-7cf43dbcc110,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d7af4f33f124748824adfc606cb56a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:53:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:53:34Z,use_quota=True,user_id='9cea3b2ac99346ce81f3e2b30c996066',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:53:41 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-68b216d7-bdcc-4961-a5ae-4bac6368847a tempest-ServerActionsTestOtherA-332393488 None] Creating volume 60604682-ec4c-4fb2-937a-7cf43dbcc110 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:53:41 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-68b216d7-bdcc-4961-a5ae-4bac6368847a tempest-ServerActionsTestOtherA-332393488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:41 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-68b216d7-bdcc-4961-a5ae-4bac6368847a tempest-ServerActionsTestOtherA-332393488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:41 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-68b216d7-bdcc-4961-a5ae-4bac6368847a tempest-ServerActionsTestOtherA-332393488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:53:41 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-68b216d7-bdcc-4961-a5ae-4bac6368847a tempest-ServerActionsTestOtherA-332393488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:53:41 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-68b216d7-bdcc-4961-a5ae-4bac6368847a tempest-ServerActionsTestOtherA-332393488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:41 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-68b216d7-bdcc-4961-a5ae-4bac6368847a tempest-ServerActionsTestOtherA-332393488 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:53:41 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-68b216d7-bdcc-4961-a5ae-4bac6368847a tempest-ServerActionsTestOtherA-332393488 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 16:53:41 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-68b216d7-bdcc-4961-a5ae-4bac6368847a tempest-ServerActionsTestOtherA-332393488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-60604682-ec4c-4fb2-937a-7cf43dbcc110 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:41 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f9865eb0-9903-4bf5-818d-0e9caaeea049 tempest-AttachVolumeTestJSON-1381673265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fea9a6d-fd0d-48d3-acd7-cb007b6dc482) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f74e087-2d4b-4f7c-9797-e0a20c00ffe8', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:41 devstack sudo[93665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-60604682-ec4c-4fb2-937a-7cf43dbcc110 1073741824 Jul 30 16:53:41 devstack sudo[93665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:41 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f9865eb0-9903-4bf5-818d-0e9caaeea049 tempest-AttachVolumeTestJSON-1381673265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61fa0ab8-bd19-4bee-8782-28ec35104889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:41 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-f9865eb0-9903-4bf5-818d-0e9caaeea049 tempest-AttachVolumeTestJSON-1381673265 None] Volume volume-6f74e087-2d4b-4f7c-9797-e0a20c00ffe8 (6f74e087-2d4b-4f7c-9797-e0a20c00ffe8): created successfully Jul 30 16:53:41 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f9865eb0-9903-4bf5-818d-0e9caaeea049 tempest-AttachVolumeTestJSON-1381673265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61fa0ab8-bd19-4bee-8782-28ec35104889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:41 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f9865eb0-9903-4bf5-818d-0e9caaeea049 tempest-AttachVolumeTestJSON-1381673265 None] Flow 'volume_create_manager' (4fb9fea4-bee8-4f39-a071-840727d9c77e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:53:41 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-f9865eb0-9903-4bf5-818d-0e9caaeea049 tempest-AttachVolumeTestJSON-1381673265 None] Created volume successfully. Jul 30 16:53:42 devstack sudo[93665]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:42 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-68b216d7-bdcc-4961-a5ae-4bac6368847a tempest-ServerActionsTestOtherA-332393488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-60604682-ec4c-4fb2-937a-7cf43dbcc110 1073741824" returned: 0 in 0.676s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:42 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-68b216d7-bdcc-4961-a5ae-4bac6368847a tempest-ServerActionsTestOtherA-332393488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-60604682-ec4c-4fb2-937a-7cf43dbcc110 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:42 devstack sudo[93678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-60604682-ec4c-4fb2-937a-7cf43dbcc110 Jul 30 16:53:42 devstack sudo[93678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:42 devstack sudo[93678]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:42 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-68b216d7-bdcc-4961-a5ae-4bac6368847a tempest-ServerActionsTestOtherA-332393488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-60604682-ec4c-4fb2-937a-7cf43dbcc110" returned: 0 in 0.598s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:42 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-68b216d7-bdcc-4961-a5ae-4bac6368847a tempest-ServerActionsTestOtherA-332393488 None] <== create_volume: return (1388ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:53:42 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-68b216d7-bdcc-4961-a5ae-4bac6368847a tempest-ServerActionsTestOtherA-332393488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.392s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:42 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-68b216d7-bdcc-4961-a5ae-4bac6368847a tempest-ServerActionsTestOtherA-332393488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (351f6128-d8b5-4bb7-a5ed-c2a6db6c186a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60604682-ec4c-4fb2-937a-7cf43dbcc110', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:42 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-68b216d7-bdcc-4961-a5ae-4bac6368847a tempest-ServerActionsTestOtherA-332393488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a0a1f05-4573-4e74-b835-e11a96609a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:42 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-2271fb0d-417f-4021-82be-ce0ac10a5b1f tempest-GroupsV314Test-1354399987 None] Acquiring lock "cinder-quobyte-552b2da8-6f17-4aaa-962f-9015066d2fd7" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:53:42 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-68b216d7-bdcc-4961-a5ae-4bac6368847a tempest-ServerActionsTestOtherA-332393488 None] Volume volume-60604682-ec4c-4fb2-937a-7cf43dbcc110 (60604682-ec4c-4fb2-937a-7cf43dbcc110): created successfully Jul 30 16:53:43 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-68b216d7-bdcc-4961-a5ae-4bac6368847a tempest-ServerActionsTestOtherA-332393488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a0a1f05-4573-4e74-b835-e11a96609a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:43 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-68b216d7-bdcc-4961-a5ae-4bac6368847a tempest-ServerActionsTestOtherA-332393488 None] Flow 'volume_create_manager' (5817ee83-70ef-4b39-bf29-46e7c932dc74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:53:43 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-68b216d7-bdcc-4961-a5ae-4bac6368847a tempest-ServerActionsTestOtherA-332393488 None] Created volume successfully. Jul 30 16:53:43 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-2271fb0d-417f-4021-82be-ce0ac10a5b1f tempest-GroupsV314Test-1354399987 None] Lock "cinder-quobyte-552b2da8-6f17-4aaa-962f-9015066d2fd7" acquired by "delete_volume" :: waited 0.116s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:53:43 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[b657ecc4-5549-4489-8baf-707466c59ee2]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:53:43 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2271fb0d-417f-4021-82be-ce0ac10a5b1f tempest-GroupsV314Test-1354399987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-552b2da8-6f17-4aaa-962f-9015066d2fd7 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:43 devstack sudo[93695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-552b2da8-6f17-4aaa-962f-9015066d2fd7 Jul 30 16:53:43 devstack sudo[93695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:43 devstack sudo[93695]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:43 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2271fb0d-417f-4021-82be-ce0ac10a5b1f tempest-GroupsV314Test-1354399987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-552b2da8-6f17-4aaa-962f-9015066d2fd7" returned: 0 in 0.560s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:43 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2271fb0d-417f-4021-82be-ce0ac10a5b1f tempest-GroupsV314Test-1354399987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-552b2da8-6f17-4aaa-962f-9015066d2fd7 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:43 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-7bc9944d-22dc-492f-a596-5d11f1b32abd req-5b20e64d-f934-46a6-b42b-ba43bcdebae2 tempest-AttachVolumeTestJSON-1381673265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:43 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-7bc9944d-22dc-492f-a596-5d11f1b32abd req-5b20e64d-f934-46a6-b42b-ba43bcdebae2 tempest-AttachVolumeTestJSON-1381673265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:43 devstack sudo[93708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-552b2da8-6f17-4aaa-962f-9015066d2fd7 Jul 30 16:53:43 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-7bc9944d-22dc-492f-a596-5d11f1b32abd req-5b20e64d-f934-46a6-b42b-ba43bcdebae2 tempest-AttachVolumeTestJSON-1381673265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:43 devstack sudo[93708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:43 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [req-7bc9944d-22dc-492f-a596-5d11f1b32abd req-5b20e64d-f934-46a6-b42b-ba43bcdebae2 tempest-AttachVolumeTestJSON-1381673265 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924', 'name': 'volume-6f74e087-2d4b-4f7c-9797-e0a20c00ffe8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cccb5ba3-5fa2-4dc5-8785-a541dc4d6e33', 'enforce_multipath': True} {{(pid=88568) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 16:53:43 devstack cinder-volume[88568]: INFO cinder.volume.manager [req-7bc9944d-22dc-492f-a596-5d11f1b32abd req-5b20e64d-f934-46a6-b42b-ba43bcdebae2 tempest-AttachVolumeTestJSON-1381673265 None] attachment_update completed successfully. Jul 30 16:53:44 devstack sudo[93708]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:44 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2271fb0d-417f-4021-82be-ce0ac10a5b1f tempest-GroupsV314Test-1354399987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-552b2da8-6f17-4aaa-962f-9015066d2fd7" returned: 0 in 0.497s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:44 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-2271fb0d-417f-4021-82be-ce0ac10a5b1f tempest-GroupsV314Test-1354399987 None] Lock "cinder-quobyte-552b2da8-6f17-4aaa-962f-9015066d2fd7" released by "delete_volume" :: held 1.151s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:53:44 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-2271fb0d-417f-4021-82be-ce0ac10a5b1f tempest-GroupsV314Test-1354399987 None] Created reservations ['8fbfdbdf-b713-423a-aa11-622957ad24c2'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:53:44 devstack cinder-volume[88568]: WARNING cinder.quota [None req-2271fb0d-417f-4021-82be-ce0ac10a5b1f tempest-GroupsV314Test-1354399987 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1602788949 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1602788949, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:53:44 devstack cinder-volume[88568]: WARNING cinder.quota [None req-2271fb0d-417f-4021-82be-ce0ac10a5b1f tempest-GroupsV314Test-1354399987 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1602788949 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1602788949, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:53:44 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-2271fb0d-417f-4021-82be-ce0ac10a5b1f tempest-GroupsV314Test-1354399987 None] Created reservations ['7377a9dc-c565-47e8-9fef-f0e6a136904f', '8ba950f2-1faa-4a11-b22c-295ac9d1821f', '37546eca-df88-4129-a12c-6c1c17c5e1d6', 'cde87cf2-11de-4d69-845a-7066eba5beef'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:53:44 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-2271fb0d-417f-4021-82be-ce0ac10a5b1f tempest-GroupsV314Test-1354399987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:44 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-2271fb0d-417f-4021-82be-ce0ac10a5b1f tempest-GroupsV314Test-1354399987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:44 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-2271fb0d-417f-4021-82be-ce0ac10a5b1f tempest-GroupsV314Test-1354399987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:53:44 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-2271fb0d-417f-4021-82be-ce0ac10a5b1f tempest-GroupsV314Test-1354399987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:53:44 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-2271fb0d-417f-4021-82be-ce0ac10a5b1f tempest-GroupsV314Test-1354399987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:44 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2271fb0d-417f-4021-82be-ce0ac10a5b1f tempest-GroupsV314Test-1354399987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:44 devstack sudo[94097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:53:44 devstack sudo[94097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:45 devstack sudo[94097]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:45 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2271fb0d-417f-4021-82be-ce0ac10a5b1f tempest-GroupsV314Test-1354399987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.348s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:45 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-2271fb0d-417f-4021-82be-ce0ac10a5b1f tempest-GroupsV314Test-1354399987 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:53:45 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-2271fb0d-417f-4021-82be-ce0ac10a5b1f tempest-GroupsV314Test-1354399987 None] Delete group completed successfully. Jul 30 16:53:46 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-10543e77-149c-4327-abc5-4b1d5a1c3bd2 tempest-GroupsV314Test-1354399987 None] Acquiring lock "cinder-quobyte-8e112a41-4a5a-4d40-94b3-f94ad63e76c6" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:53:46 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-7972a9ea-ab9a-43c3-a940-d2ffec00b049 tempest-AttachVolumeShelveTestJSON-608644172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:53:46 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7972a9ea-ab9a-43c3-a940-d2ffec00b049 tempest-AttachVolumeShelveTestJSON-608644172 None] Flow 'volume_create_manager' (0a681dc7-8973-4ab0-986f-63950fd9a9a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:53:46 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7972a9ea-ab9a-43c3-a940-d2ffec00b049 tempest-AttachVolumeShelveTestJSON-608644172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82575fcb-5f5e-4596-adb7-ffac6dd9dda2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:46 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-10543e77-149c-4327-abc5-4b1d5a1c3bd2 tempest-GroupsV314Test-1354399987 None] Lock "cinder-quobyte-8e112a41-4a5a-4d40-94b3-f94ad63e76c6" acquired by "delete_volume" :: waited 0.084s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:53:46 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7972a9ea-ab9a-43c3-a940-d2ffec00b049 tempest-AttachVolumeShelveTestJSON-608644172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82575fcb-5f5e-4596-adb7-ffac6dd9dda2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:53:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-468026733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e852a5a-0736-435c-b969-f892fda5bd95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b14c053c64104294bf8e0edeb25fc9b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:53:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:53:47Z,use_quota=True,user_id='6f9e51c097524fc79ce66e48bd6ebde6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:46 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7972a9ea-ab9a-43c3-a940-d2ffec00b049 tempest-AttachVolumeShelveTestJSON-608644172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ace99465-64f6-422f-acb7-486d4bab0402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:46 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7972a9ea-ab9a-43c3-a940-d2ffec00b049 tempest-AttachVolumeShelveTestJSON-608644172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ace99465-64f6-422f-acb7-486d4bab0402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:46 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7972a9ea-ab9a-43c3-a940-d2ffec00b049 tempest-AttachVolumeShelveTestJSON-608644172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5986a44c-bcc4-4139-8e13-012204ea4df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:46 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7972a9ea-ab9a-43c3-a940-d2ffec00b049 tempest-AttachVolumeShelveTestJSON-608644172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5986a44c-bcc4-4139-8e13-012204ea4df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e852a5a-0736-435c-b969-f892fda5bd95', 'volume_name': 'volume-9e852a5a-0736-435c-b969-f892fda5bd95', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:46 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7972a9ea-ab9a-43c3-a940-d2ffec00b049 tempest-AttachVolumeShelveTestJSON-608644172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0000aaf2-9393-4be1-a9a4-47088f84c750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:46 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7972a9ea-ab9a-43c3-a940-d2ffec00b049 tempest-AttachVolumeShelveTestJSON-608644172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0000aaf2-9393-4be1-a9a4-47088f84c750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:46 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7972a9ea-ab9a-43c3-a940-d2ffec00b049 tempest-AttachVolumeShelveTestJSON-608644172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e9fe032-eff8-476c-aed8-3530e491940c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:46 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-7972a9ea-ab9a-43c3-a940-d2ffec00b049 tempest-AttachVolumeShelveTestJSON-608644172 None] Volume 9e852a5a-0736-435c-b969-f892fda5bd95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e852a5a-0736-435c-b969-f892fda5bd95', 'volume_size': 1} Jul 30 16:53:46 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-7972a9ea-ab9a-43c3-a940-d2ffec00b049 tempest-AttachVolumeShelveTestJSON-608644172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:46 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-7972a9ea-ab9a-43c3-a940-d2ffec00b049 tempest-AttachVolumeShelveTestJSON-608644172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:46 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-7972a9ea-ab9a-43c3-a940-d2ffec00b049 tempest-AttachVolumeShelveTestJSON-608644172 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:53:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-468026733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e852a5a-0736-435c-b969-f892fda5bd95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b14c053c64104294bf8e0edeb25fc9b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:53:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:53:47Z,use_quota=True,user_id='6f9e51c097524fc79ce66e48bd6ebde6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:53:46 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-7972a9ea-ab9a-43c3-a940-d2ffec00b049 tempest-AttachVolumeShelveTestJSON-608644172 None] Creating volume 9e852a5a-0736-435c-b969-f892fda5bd95 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:53:46 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-7972a9ea-ab9a-43c3-a940-d2ffec00b049 tempest-AttachVolumeShelveTestJSON-608644172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:46 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-7972a9ea-ab9a-43c3-a940-d2ffec00b049 tempest-AttachVolumeShelveTestJSON-608644172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:46 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-7972a9ea-ab9a-43c3-a940-d2ffec00b049 tempest-AttachVolumeShelveTestJSON-608644172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:53:46 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-7972a9ea-ab9a-43c3-a940-d2ffec00b049 tempest-AttachVolumeShelveTestJSON-608644172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:53:46 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-7972a9ea-ab9a-43c3-a940-d2ffec00b049 tempest-AttachVolumeShelveTestJSON-608644172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:46 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-7972a9ea-ab9a-43c3-a940-d2ffec00b049 tempest-AttachVolumeShelveTestJSON-608644172 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:53:46 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-7972a9ea-ab9a-43c3-a940-d2ffec00b049 tempest-AttachVolumeShelveTestJSON-608644172 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 16:53:46 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7972a9ea-ab9a-43c3-a940-d2ffec00b049 tempest-AttachVolumeShelveTestJSON-608644172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9e852a5a-0736-435c-b969-f892fda5bd95 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:47 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[045b1a59-fc7e-47cd-acb8-3bf4485e7533]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:53:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-10543e77-149c-4327-abc5-4b1d5a1c3bd2 tempest-GroupsV314Test-1354399987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8e112a41-4a5a-4d40-94b3-f94ad63e76c6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:47 devstack sudo[94137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9e852a5a-0736-435c-b969-f892fda5bd95 1073741824 Jul 30 16:53:47 devstack sudo[94137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:47 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-0238722a-1c24-4487-a4fc-2cb6b6bc9fc0 tempest-AttachVolumeTestJSON-1381673265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:53:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-0238722a-1c24-4487-a4fc-2cb6b6bc9fc0 tempest-AttachVolumeTestJSON-1381673265 None] Flow 'volume_create_manager' (f77d113c-43f3-47c3-9177-d4a26cd4882f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:53:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-0238722a-1c24-4487-a4fc-2cb6b6bc9fc0 tempest-AttachVolumeTestJSON-1381673265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ec23c98-3e29-415e-8131-1e87eee30cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-0238722a-1c24-4487-a4fc-2cb6b6bc9fc0 tempest-AttachVolumeTestJSON-1381673265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ec23c98-3e29-415e-8131-1e87eee30cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:53:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-549428946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94bfee53-2963-4b4c-ab98-7d9cda56974d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b219135d1cf44e32a38d2e55a15cc768',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:53:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:53:47Z,use_quota=True,user_id='0f5f98258baf41b7980b7f1e7e487bdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-0238722a-1c24-4487-a4fc-2cb6b6bc9fc0 tempest-AttachVolumeTestJSON-1381673265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccc899b5-22ae-4d09-839a-25dffb2fc6d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-0238722a-1c24-4487-a4fc-2cb6b6bc9fc0 tempest-AttachVolumeTestJSON-1381673265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccc899b5-22ae-4d09-839a-25dffb2fc6d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-0238722a-1c24-4487-a4fc-2cb6b6bc9fc0 tempest-AttachVolumeTestJSON-1381673265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (764fe927-f159-4e6a-9615-226890a4e284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-0238722a-1c24-4487-a4fc-2cb6b6bc9fc0 tempest-AttachVolumeTestJSON-1381673265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (764fe927-f159-4e6a-9615-226890a4e284) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94bfee53-2963-4b4c-ab98-7d9cda56974d', 'volume_name': 'volume-94bfee53-2963-4b4c-ab98-7d9cda56974d', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-0238722a-1c24-4487-a4fc-2cb6b6bc9fc0 tempest-AttachVolumeTestJSON-1381673265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8bac418-b7b8-4eb6-ba9f-6023b3bf14f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-0238722a-1c24-4487-a4fc-2cb6b6bc9fc0 tempest-AttachVolumeTestJSON-1381673265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8bac418-b7b8-4eb6-ba9f-6023b3bf14f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-0238722a-1c24-4487-a4fc-2cb6b6bc9fc0 tempest-AttachVolumeTestJSON-1381673265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7efac5bc-f392-40ea-9f3a-a25d2a99ca08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:47 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-0238722a-1c24-4487-a4fc-2cb6b6bc9fc0 tempest-AttachVolumeTestJSON-1381673265 None] Volume 94bfee53-2963-4b4c-ab98-7d9cda56974d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94bfee53-2963-4b4c-ab98-7d9cda56974d', 'volume_size': 1} Jul 30 16:53:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-0238722a-1c24-4487-a4fc-2cb6b6bc9fc0 tempest-AttachVolumeTestJSON-1381673265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:47 devstack sudo[94138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8e112a41-4a5a-4d40-94b3-f94ad63e76c6 Jul 30 16:53:47 devstack sudo[94138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:47 devstack sudo[94138]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-10543e77-149c-4327-abc5-4b1d5a1c3bd2 tempest-GroupsV314Test-1354399987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8e112a41-4a5a-4d40-94b3-f94ad63e76c6" returned: 0 in 0.508s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-10543e77-149c-4327-abc5-4b1d5a1c3bd2 tempest-GroupsV314Test-1354399987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8e112a41-4a5a-4d40-94b3-f94ad63e76c6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:47 devstack sudo[94161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8e112a41-4a5a-4d40-94b3-f94ad63e76c6 Jul 30 16:53:47 devstack sudo[94161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:47 devstack sudo[94137]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7972a9ea-ab9a-43c3-a940-d2ffec00b049 tempest-AttachVolumeShelveTestJSON-608644172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9e852a5a-0736-435c-b969-f892fda5bd95 1073741824" returned: 0 in 0.619s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7972a9ea-ab9a-43c3-a940-d2ffec00b049 tempest-AttachVolumeShelveTestJSON-608644172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9e852a5a-0736-435c-b969-f892fda5bd95 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:47 devstack sudo[94168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9e852a5a-0736-435c-b969-f892fda5bd95 Jul 30 16:53:47 devstack sudo[94168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:47 devstack sudo[94161]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-10543e77-149c-4327-abc5-4b1d5a1c3bd2 tempest-GroupsV314Test-1354399987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8e112a41-4a5a-4d40-94b3-f94ad63e76c6" returned: 0 in 0.300s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:47 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-10543e77-149c-4327-abc5-4b1d5a1c3bd2 tempest-GroupsV314Test-1354399987 None] Lock "cinder-quobyte-8e112a41-4a5a-4d40-94b3-f94ad63e76c6" released by "delete_volume" :: held 1.087s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:53:47 devstack cinder-volume[88568]: DEBUG dbcounter [-] [88568] Writing DB stats cinder:SELECT=49,cinder:UPDATE=73,cinder:INSERT=8,cinder:DELETE=7 {{(pid=88568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:53:47 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-10543e77-149c-4327-abc5-4b1d5a1c3bd2 tempest-GroupsV314Test-1354399987 None] Created reservations ['7d1a98d1-64c9-46a6-9fb1-c3561690df8c'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:53:47 devstack sudo[94168]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7972a9ea-ab9a-43c3-a940-d2ffec00b049 tempest-AttachVolumeShelveTestJSON-608644172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9e852a5a-0736-435c-b969-f892fda5bd95" returned: 0 in 0.322s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:47 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-7972a9ea-ab9a-43c3-a940-d2ffec00b049 tempest-AttachVolumeShelveTestJSON-608644172 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:53:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-7972a9ea-ab9a-43c3-a940-d2ffec00b049 tempest-AttachVolumeShelveTestJSON-608644172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-0238722a-1c24-4487-a4fc-2cb6b6bc9fc0 tempest-AttachVolumeTestJSON-1381673265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.768s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:47 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-0238722a-1c24-4487-a4fc-2cb6b6bc9fc0 tempest-AttachVolumeTestJSON-1381673265 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:53:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-549428946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94bfee53-2963-4b4c-ab98-7d9cda56974d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b219135d1cf44e32a38d2e55a15cc768',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:53:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:53:47Z,use_quota=True,user_id='0f5f98258baf41b7980b7f1e7e487bdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:53:47 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-0238722a-1c24-4487-a4fc-2cb6b6bc9fc0 tempest-AttachVolumeTestJSON-1381673265 None] Creating volume 94bfee53-2963-4b4c-ab98-7d9cda56974d {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:53:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-0238722a-1c24-4487-a4fc-2cb6b6bc9fc0 tempest-AttachVolumeTestJSON-1381673265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-0238722a-1c24-4487-a4fc-2cb6b6bc9fc0 tempest-AttachVolumeTestJSON-1381673265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:47 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-0238722a-1c24-4487-a4fc-2cb6b6bc9fc0 tempest-AttachVolumeTestJSON-1381673265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:53:47 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-0238722a-1c24-4487-a4fc-2cb6b6bc9fc0 tempest-AttachVolumeTestJSON-1381673265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:53:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-0238722a-1c24-4487-a4fc-2cb6b6bc9fc0 tempest-AttachVolumeTestJSON-1381673265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:47 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-0238722a-1c24-4487-a4fc-2cb6b6bc9fc0 tempest-AttachVolumeTestJSON-1381673265 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:53:47 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-0238722a-1c24-4487-a4fc-2cb6b6bc9fc0 tempest-AttachVolumeTestJSON-1381673265 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 16:53:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0238722a-1c24-4487-a4fc-2cb6b6bc9fc0 tempest-AttachVolumeTestJSON-1381673265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-94bfee53-2963-4b4c-ab98-7d9cda56974d 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:48 devstack cinder-volume[88568]: DEBUG dbcounter [-] [88568] Writing DB stats cinder:UPDATE=52,cinder:SELECT=64,cinder:INSERT=19,cinder:DELETE=2 {{(pid=88568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:53:48 devstack sudo[94182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-94bfee53-2963-4b4c-ab98-7d9cda56974d 1073741824 Jul 30 16:53:48 devstack sudo[94182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:48 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7972a9ea-ab9a-43c3-a940-d2ffec00b049 tempest-AttachVolumeShelveTestJSON-608644172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e9fe032-eff8-476c-aed8-3530e491940c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e852a5a-0736-435c-b969-f892fda5bd95', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:48 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7972a9ea-ab9a-43c3-a940-d2ffec00b049 tempest-AttachVolumeShelveTestJSON-608644172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62dbcf5a-b6be-4f3c-8c70-1b0bfa4d2009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:48 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-10543e77-149c-4327-abc5-4b1d5a1c3bd2 tempest-GroupsV314Test-1354399987 None] Created reservations ['e1babb6e-b5f1-4b8e-86ca-9534136eb8e3', 'e783993d-3374-4236-9a71-7a6e807130d3', '7535f40e-3c21-45b8-9d27-824ab32b7004', 'bd47ceec-237d-4dbe-9f6b-602bb0ad303e'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:53:48 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-7972a9ea-ab9a-43c3-a940-d2ffec00b049 tempest-AttachVolumeShelveTestJSON-608644172 None] Volume volume-9e852a5a-0736-435c-b969-f892fda5bd95 (9e852a5a-0736-435c-b969-f892fda5bd95): created successfully Jul 30 16:53:48 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7972a9ea-ab9a-43c3-a940-d2ffec00b049 tempest-AttachVolumeShelveTestJSON-608644172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62dbcf5a-b6be-4f3c-8c70-1b0bfa4d2009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:48 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7972a9ea-ab9a-43c3-a940-d2ffec00b049 tempest-AttachVolumeShelveTestJSON-608644172 None] Flow 'volume_create_manager' (0a681dc7-8973-4ab0-986f-63950fd9a9a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:53:48 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-7972a9ea-ab9a-43c3-a940-d2ffec00b049 tempest-AttachVolumeShelveTestJSON-608644172 None] Created volume successfully. Jul 30 16:53:48 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-10543e77-149c-4327-abc5-4b1d5a1c3bd2 tempest-GroupsV314Test-1354399987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:48 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-10543e77-149c-4327-abc5-4b1d5a1c3bd2 tempest-GroupsV314Test-1354399987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:48 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-10543e77-149c-4327-abc5-4b1d5a1c3bd2 tempest-GroupsV314Test-1354399987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:53:48 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-10543e77-149c-4327-abc5-4b1d5a1c3bd2 tempest-GroupsV314Test-1354399987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:53:48 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-10543e77-149c-4327-abc5-4b1d5a1c3bd2 tempest-GroupsV314Test-1354399987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:48 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-10543e77-149c-4327-abc5-4b1d5a1c3bd2 tempest-GroupsV314Test-1354399987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:48 devstack sudo[94185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:53:48 devstack sudo[94185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:48 devstack sudo[94185]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:48 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-10543e77-149c-4327-abc5-4b1d5a1c3bd2 tempest-GroupsV314Test-1354399987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.287s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:48 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-10543e77-149c-4327-abc5-4b1d5a1c3bd2 tempest-GroupsV314Test-1354399987 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:53:48 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-10543e77-149c-4327-abc5-4b1d5a1c3bd2 tempest-GroupsV314Test-1354399987 None] Delete group completed successfully. Jul 30 16:53:48 devstack sudo[94182]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:48 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0238722a-1c24-4487-a4fc-2cb6b6bc9fc0 tempest-AttachVolumeTestJSON-1381673265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-94bfee53-2963-4b4c-ab98-7d9cda56974d 1073741824" returned: 0 in 0.572s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:48 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0238722a-1c24-4487-a4fc-2cb6b6bc9fc0 tempest-AttachVolumeTestJSON-1381673265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-94bfee53-2963-4b4c-ab98-7d9cda56974d {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:48 devstack sudo[94190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-94bfee53-2963-4b4c-ab98-7d9cda56974d Jul 30 16:53:48 devstack sudo[94190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:48 devstack sudo[94190]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:48 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0238722a-1c24-4487-a4fc-2cb6b6bc9fc0 tempest-AttachVolumeTestJSON-1381673265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-94bfee53-2963-4b4c-ab98-7d9cda56974d" returned: 0 in 0.293s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:48 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-0238722a-1c24-4487-a4fc-2cb6b6bc9fc0 tempest-AttachVolumeTestJSON-1381673265 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:53:48 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-0238722a-1c24-4487-a4fc-2cb6b6bc9fc0 tempest-AttachVolumeTestJSON-1381673265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:48 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-0238722a-1c24-4487-a4fc-2cb6b6bc9fc0 tempest-AttachVolumeTestJSON-1381673265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7efac5bc-f392-40ea-9f3a-a25d2a99ca08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94bfee53-2963-4b4c-ab98-7d9cda56974d', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:48 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-0238722a-1c24-4487-a4fc-2cb6b6bc9fc0 tempest-AttachVolumeTestJSON-1381673265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3178083-5b0c-491e-8568-1beecd6a96e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:48 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-0238722a-1c24-4487-a4fc-2cb6b6bc9fc0 tempest-AttachVolumeTestJSON-1381673265 None] Volume volume-94bfee53-2963-4b4c-ab98-7d9cda56974d (94bfee53-2963-4b4c-ab98-7d9cda56974d): created successfully Jul 30 16:53:48 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-0238722a-1c24-4487-a4fc-2cb6b6bc9fc0 tempest-AttachVolumeTestJSON-1381673265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3178083-5b0c-491e-8568-1beecd6a96e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:48 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-0238722a-1c24-4487-a4fc-2cb6b6bc9fc0 tempest-AttachVolumeTestJSON-1381673265 None] Flow 'volume_create_manager' (f77d113c-43f3-47c3-9177-d4a26cd4882f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:53:48 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-0238722a-1c24-4487-a4fc-2cb6b6bc9fc0 tempest-AttachVolumeTestJSON-1381673265 None] Created volume successfully. Jul 30 16:53:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-58f0b825-7d97-4af3-9182-85c96104277c req-066741b4-3bda-4daa-a436-a5652cf40f38 tempest-AttachVolumeTestJSON-1381673265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-58f0b825-7d97-4af3-9182-85c96104277c req-066741b4-3bda-4daa-a436-a5652cf40f38 tempest-AttachVolumeTestJSON-1381673265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-58f0b825-7d97-4af3-9182-85c96104277c req-066741b4-3bda-4daa-a436-a5652cf40f38 tempest-AttachVolumeTestJSON-1381673265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:50 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [req-58f0b825-7d97-4af3-9182-85c96104277c req-066741b4-3bda-4daa-a436-a5652cf40f38 tempest-AttachVolumeTestJSON-1381673265 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924', 'name': 'volume-94bfee53-2963-4b4c-ab98-7d9cda56974d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '45689dd0-7632-40e8-a639-51811ffbd63b', 'enforce_multipath': True} {{(pid=88568) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 16:53:50 devstack cinder-volume[88568]: INFO cinder.volume.manager [req-58f0b825-7d97-4af3-9182-85c96104277c req-066741b4-3bda-4daa-a436-a5652cf40f38 tempest-AttachVolumeTestJSON-1381673265 None] attachment_update completed successfully. Jul 30 16:53:52 devstack cinder-volume[88568]: DEBUG oslo_service.periodic_task [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:53:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:52 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:53:52 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:53:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:52 devstack sudo[94255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:53:52 devstack sudo[94255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:53 devstack sudo[94255]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:53 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.496s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:53 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:53:53 devstack cinder-volume[88568]: DEBUG oslo_service.periodic_task [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Running periodic task VolumeManager._thread_info {{(pid=88568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:53:53 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] thread count: 8 {{(pid=88568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:53:53 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] thread info: [<_MainThread(MainThread, started 127406866608256)>, , , , , , , ] {{(pid=88568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:53:55 devstack cinder-volume[88568]: INFO cinder.volume.manager [req-76c51dfb-cef3-4008-a3d6-a6bcad33cafc req-20749429-73b4-4e82-b771-e72f47c16a64 tempest-AttachVolumeTestJSON-1381673265 None] Terminate volume connection completed successfully. Jul 30 16:53:55 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [req-76c51dfb-cef3-4008-a3d6-a6bcad33cafc req-20749429-73b4-4e82-b771-e72f47c16a64 tempest-AttachVolumeTestJSON-1381673265 None] Deleting attachment cccb5ba3-5fa2-4dc5-8785-a541dc4d6e33. {{(pid=88568) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 16:53:56 devstack cinder-volume[88568]: INFO cinder.volume.manager [req-6346e812-e9f8-46ab-9fb7-ab15f53cc914 req-6dea4b2e-ed40-4659-9669-41ce5431f872 tempest-AttachVolumeTestJSON-1381673265 None] Terminate volume connection completed successfully. Jul 30 16:53:56 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [req-6346e812-e9f8-46ab-9fb7-ab15f53cc914 req-6dea4b2e-ed40-4659-9669-41ce5431f872 tempest-AttachVolumeTestJSON-1381673265 None] Deleting attachment 45689dd0-7632-40e8-a639-51811ffbd63b. {{(pid=88568) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 16:54:00 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-22c1ca71-49f3-470f-ba08-7f65ed1065f6 tempest-SnapshotsActionsTest-151668605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:54:00 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-22c1ca71-49f3-470f-ba08-7f65ed1065f6 tempest-SnapshotsActionsTest-151668605 None] Flow 'volume_create_manager' (74fa402a-4202-46c3-a906-3c98f6af781b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:54:00 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-22c1ca71-49f3-470f-ba08-7f65ed1065f6 tempest-SnapshotsActionsTest-151668605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce9fde6f-6f39-4ab0-ba3e-015bb932ef20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:00 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-22c1ca71-49f3-470f-ba08-7f65ed1065f6 tempest-SnapshotsActionsTest-151668605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce9fde6f-6f39-4ab0-ba3e-015bb932ef20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:54:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1766321652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22763b2b-8aa4-4016-8896-91249c91d08e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='facb145d21c740528e245e81d2bea925',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:54:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:54:00Z,use_quota=True,user_id='333668818cb04185a6fe336c6d374874',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:00 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-22c1ca71-49f3-470f-ba08-7f65ed1065f6 tempest-SnapshotsActionsTest-151668605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57cb95a5-171b-420e-b350-d4b9ef817a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:00 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-22c1ca71-49f3-470f-ba08-7f65ed1065f6 tempest-SnapshotsActionsTest-151668605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57cb95a5-171b-420e-b350-d4b9ef817a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:00 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-22c1ca71-49f3-470f-ba08-7f65ed1065f6 tempest-SnapshotsActionsTest-151668605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2ff2d7b-98ba-4127-9d21-f4eda659c054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:00 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-22c1ca71-49f3-470f-ba08-7f65ed1065f6 tempest-SnapshotsActionsTest-151668605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2ff2d7b-98ba-4127-9d21-f4eda659c054) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22763b2b-8aa4-4016-8896-91249c91d08e', 'volume_name': 'volume-22763b2b-8aa4-4016-8896-91249c91d08e', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:00 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-22c1ca71-49f3-470f-ba08-7f65ed1065f6 tempest-SnapshotsActionsTest-151668605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38afe1e1-1b92-48e4-a817-605b1bf066f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:00 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-22c1ca71-49f3-470f-ba08-7f65ed1065f6 tempest-SnapshotsActionsTest-151668605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38afe1e1-1b92-48e4-a817-605b1bf066f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:00 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-22c1ca71-49f3-470f-ba08-7f65ed1065f6 tempest-SnapshotsActionsTest-151668605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93aa5475-2129-4bac-9c7c-7424cedd21a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:00 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-22c1ca71-49f3-470f-ba08-7f65ed1065f6 tempest-SnapshotsActionsTest-151668605 None] Volume 22763b2b-8aa4-4016-8896-91249c91d08e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22763b2b-8aa4-4016-8896-91249c91d08e', 'volume_size': 1} Jul 30 16:54:00 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-22c1ca71-49f3-470f-ba08-7f65ed1065f6 tempest-SnapshotsActionsTest-151668605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:00 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-22c1ca71-49f3-470f-ba08-7f65ed1065f6 tempest-SnapshotsActionsTest-151668605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:00 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-22c1ca71-49f3-470f-ba08-7f65ed1065f6 tempest-SnapshotsActionsTest-151668605 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:54:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1766321652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22763b2b-8aa4-4016-8896-91249c91d08e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='facb145d21c740528e245e81d2bea925',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:54:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:54:00Z,use_quota=True,user_id='333668818cb04185a6fe336c6d374874',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:54:00 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-22c1ca71-49f3-470f-ba08-7f65ed1065f6 tempest-SnapshotsActionsTest-151668605 None] Creating volume 22763b2b-8aa4-4016-8896-91249c91d08e {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:54:00 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-22c1ca71-49f3-470f-ba08-7f65ed1065f6 tempest-SnapshotsActionsTest-151668605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:00 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-22c1ca71-49f3-470f-ba08-7f65ed1065f6 tempest-SnapshotsActionsTest-151668605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:00 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-22c1ca71-49f3-470f-ba08-7f65ed1065f6 tempest-SnapshotsActionsTest-151668605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:00 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-22c1ca71-49f3-470f-ba08-7f65ed1065f6 tempest-SnapshotsActionsTest-151668605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:00 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-22c1ca71-49f3-470f-ba08-7f65ed1065f6 tempest-SnapshotsActionsTest-151668605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:00 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-22c1ca71-49f3-470f-ba08-7f65ed1065f6 tempest-SnapshotsActionsTest-151668605 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:54:00 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-22c1ca71-49f3-470f-ba08-7f65ed1065f6 tempest-SnapshotsActionsTest-151668605 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 16:54:00 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-22c1ca71-49f3-470f-ba08-7f65ed1065f6 tempest-SnapshotsActionsTest-151668605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:00 devstack sudo[94339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e 1073741824 Jul 30 16:54:00 devstack sudo[94339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:01 devstack sudo[94339]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-22c1ca71-49f3-470f-ba08-7f65ed1065f6 tempest-SnapshotsActionsTest-151668605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e 1073741824" returned: 0 in 0.600s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-22c1ca71-49f3-470f-ba08-7f65ed1065f6 tempest-SnapshotsActionsTest-151668605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:01 devstack sudo[94348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e Jul 30 16:54:01 devstack sudo[94348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:01 devstack sudo[94348]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-22c1ca71-49f3-470f-ba08-7f65ed1065f6 tempest-SnapshotsActionsTest-151668605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e" returned: 0 in 0.590s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:01 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-22c1ca71-49f3-470f-ba08-7f65ed1065f6 tempest-SnapshotsActionsTest-151668605 None] <== create_volume: return (1247ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:54:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-22c1ca71-49f3-470f-ba08-7f65ed1065f6 tempest-SnapshotsActionsTest-151668605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.249s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:01 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-22c1ca71-49f3-470f-ba08-7f65ed1065f6 tempest-SnapshotsActionsTest-151668605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93aa5475-2129-4bac-9c7c-7424cedd21a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22763b2b-8aa4-4016-8896-91249c91d08e', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:01 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-22c1ca71-49f3-470f-ba08-7f65ed1065f6 tempest-SnapshotsActionsTest-151668605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b554a94f-dd4e-4d9e-b63e-2ae49792f4de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:01 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-22c1ca71-49f3-470f-ba08-7f65ed1065f6 tempest-SnapshotsActionsTest-151668605 None] Volume volume-22763b2b-8aa4-4016-8896-91249c91d08e (22763b2b-8aa4-4016-8896-91249c91d08e): created successfully Jul 30 16:54:01 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-22c1ca71-49f3-470f-ba08-7f65ed1065f6 tempest-SnapshotsActionsTest-151668605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b554a94f-dd4e-4d9e-b63e-2ae49792f4de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:01 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-22c1ca71-49f3-470f-ba08-7f65ed1065f6 tempest-SnapshotsActionsTest-151668605 None] Flow 'volume_create_manager' (74fa402a-4202-46c3-a906-3c98f6af781b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:54:01 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-22c1ca71-49f3-470f-ba08-7f65ed1065f6 tempest-SnapshotsActionsTest-151668605 None] Created volume successfully. Jul 30 16:54:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-0c89ebdd-70fe-46fa-916e-03599e16a40d tempest-SnapshotsActionsTest-151668605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-0c89ebdd-70fe-46fa-916e-03599e16a40d tempest-SnapshotsActionsTest-151668605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:02 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-0c89ebdd-70fe-46fa-916e-03599e16a40d tempest-SnapshotsActionsTest-151668605 None] Creating offline snapshot d24fa2ac-ce70-4dfc-b918-d137c25ef760 of volume 22763b2b-8aa4-4016-8896-91249c91d08e {{(pid=88568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:54:02 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39252e3-57f1-49cb-9ce4-61a2631f5fac]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0c89ebdd-70fe-46fa-916e-03599e16a40d tempest-SnapshotsActionsTest-151668605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:02 devstack sudo[94379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e Jul 30 16:54:02 devstack sudo[94379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:03 devstack sudo[94379]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0c89ebdd-70fe-46fa-916e-03599e16a40d tempest-SnapshotsActionsTest-151668605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e" returned: 0 in 0.418s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0c89ebdd-70fe-46fa-916e-03599e16a40d tempest-SnapshotsActionsTest-151668605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.d24fa2ac-ce70-4dfc-b918-d137c25ef760 1G {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:03 devstack sudo[94384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.d24fa2ac-ce70-4dfc-b918-d137c25ef760 1G Jul 30 16:54:03 devstack sudo[94384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:03 devstack sudo[94384]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0c89ebdd-70fe-46fa-916e-03599e16a40d tempest-SnapshotsActionsTest-151668605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.d24fa2ac-ce70-4dfc-b918-d137c25ef760 1G" returned: 0 in 0.543s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0c89ebdd-70fe-46fa-916e-03599e16a40d tempest-SnapshotsActionsTest-151668605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22763b2b-8aa4-4016-8896-91249c91d08e -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.d24fa2ac-ce70-4dfc-b918-d137c25ef760 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:03 devstack sudo[94390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22763b2b-8aa4-4016-8896-91249c91d08e -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.d24fa2ac-ce70-4dfc-b918-d137c25ef760 Jul 30 16:54:03 devstack sudo[94390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:03 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [req-2871ba79-5123-4880-a0e6-0f8b403b765e req-67248e25-5e80-4c41-a6a0-454e27e4b8fe tempest-AttachVolumeShelveTestJSON-608644172 None] No connector for attachment ce7b8c98-c113-4b04-a7d8-fe49f983d1de; skipping storage backend terminate_connection call. {{(pid=88568) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 30 16:54:03 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [req-2871ba79-5123-4880-a0e6-0f8b403b765e req-67248e25-5e80-4c41-a6a0-454e27e4b8fe tempest-AttachVolumeShelveTestJSON-608644172 None] Deleting attachment ce7b8c98-c113-4b04-a7d8-fe49f983d1de. {{(pid=88568) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 16:54:03 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-5fa42423-425a-4509-b7b4-17e67a7cddc8 tempest-AttachVolumeTestJSON-1381673265 None] Acquiring lock "cinder-94bfee53-2963-4b4c-ab98-7d9cda56974d-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:03 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-5fa42423-425a-4509-b7b4-17e67a7cddc8 tempest-AttachVolumeTestJSON-1381673265 None] Lock "cinder-94bfee53-2963-4b4c-ab98-7d9cda56974d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:04 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-5fa42423-425a-4509-b7b4-17e67a7cddc8 tempest-AttachVolumeTestJSON-1381673265 None] Acquiring lock "cinder-quobyte-94bfee53-2963-4b4c-ab98-7d9cda56974d" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:04 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-5fa42423-425a-4509-b7b4-17e67a7cddc8 tempest-AttachVolumeTestJSON-1381673265 None] Lock "cinder-quobyte-94bfee53-2963-4b4c-ab98-7d9cda56974d" acquired by "delete_volume" :: waited 0.020s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:04 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[b22e19a6-b621-46d4-ad84-1c4bfac1a46d]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-5fa42423-425a-4509-b7b4-17e67a7cddc8 tempest-AttachVolumeTestJSON-1381673265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-94bfee53-2963-4b4c-ab98-7d9cda56974d {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:04 devstack sudo[94390]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0c89ebdd-70fe-46fa-916e-03599e16a40d tempest-SnapshotsActionsTest-151668605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22763b2b-8aa4-4016-8896-91249c91d08e -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.d24fa2ac-ce70-4dfc-b918-d137c25ef760" returned: 0 in 0.389s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:04 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-0c89ebdd-70fe-46fa-916e-03599e16a40d tempest-SnapshotsActionsTest-151668605 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.d24fa2ac-ce70-4dfc-b918-d137c25ef760 is being set with open permissions: ugo+rw Jul 30 16:54:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0c89ebdd-70fe-46fa-916e-03599e16a40d tempest-SnapshotsActionsTest-151668605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.d24fa2ac-ce70-4dfc-b918-d137c25ef760 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:04 devstack sudo[94396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.d24fa2ac-ce70-4dfc-b918-d137c25ef760 Jul 30 16:54:04 devstack sudo[94396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:04 devstack sudo[94395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-94bfee53-2963-4b4c-ab98-7d9cda56974d Jul 30 16:54:04 devstack sudo[94395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:04 devstack sudo[94396]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0c89ebdd-70fe-46fa-916e-03599e16a40d tempest-SnapshotsActionsTest-151668605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.d24fa2ac-ce70-4dfc-b918-d137c25ef760" returned: 0 in 0.304s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0c89ebdd-70fe-46fa-916e-03599e16a40d tempest-SnapshotsActionsTest-151668605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:04 devstack sudo[94404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.info Jul 30 16:54:04 devstack sudo[94404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:04 devstack sudo[94395]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-5fa42423-425a-4509-b7b4-17e67a7cddc8 tempest-AttachVolumeTestJSON-1381673265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-94bfee53-2963-4b4c-ab98-7d9cda56974d" returned: 0 in 0.468s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-5fa42423-425a-4509-b7b4-17e67a7cddc8 tempest-AttachVolumeTestJSON-1381673265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-94bfee53-2963-4b4c-ab98-7d9cda56974d {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:04 devstack sudo[94408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-94bfee53-2963-4b4c-ab98-7d9cda56974d Jul 30 16:54:04 devstack sudo[94408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:04 devstack sudo[94404]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0c89ebdd-70fe-46fa-916e-03599e16a40d tempest-SnapshotsActionsTest-151668605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.info" returned: 0 in 0.302s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:04 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-0c89ebdd-70fe-46fa-916e-03599e16a40d tempest-SnapshotsActionsTest-151668605 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.info is being set with open permissions: ugo+rw Jul 30 16:54:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0c89ebdd-70fe-46fa-916e-03599e16a40d tempest-SnapshotsActionsTest-151668605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:04 devstack sudo[94411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.info Jul 30 16:54:04 devstack sudo[94411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:04 devstack sudo[94408]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-5fa42423-425a-4509-b7b4-17e67a7cddc8 tempest-AttachVolumeTestJSON-1381673265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-94bfee53-2963-4b4c-ab98-7d9cda56974d" returned: 0 in 0.294s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:04 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-5fa42423-425a-4509-b7b4-17e67a7cddc8 tempest-AttachVolumeTestJSON-1381673265 None] Lock "cinder-quobyte-94bfee53-2963-4b4c-ab98-7d9cda56974d" released by "delete_volume" :: held 0.805s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:04 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-5fa42423-425a-4509-b7b4-17e67a7cddc8 tempest-AttachVolumeTestJSON-1381673265 None] Created reservations ['b7d4e60d-a555-43f2-8c28-cfcb6df78e34', '5dcff06f-31c5-49d4-afd5-6fc3df8f7013', '72f0ac5b-2d83-4c4c-8734-37876097323a', '9bd9b2be-fc9f-4c21-819f-cedb5e42868f'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:54:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-5fa42423-425a-4509-b7b4-17e67a7cddc8 tempest-AttachVolumeTestJSON-1381673265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-5fa42423-425a-4509-b7b4-17e67a7cddc8 tempest-AttachVolumeTestJSON-1381673265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:04 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-5fa42423-425a-4509-b7b4-17e67a7cddc8 tempest-AttachVolumeTestJSON-1381673265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:04 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-5fa42423-425a-4509-b7b4-17e67a7cddc8 tempest-AttachVolumeTestJSON-1381673265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-5fa42423-425a-4509-b7b4-17e67a7cddc8 tempest-AttachVolumeTestJSON-1381673265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-5fa42423-425a-4509-b7b4-17e67a7cddc8 tempest-AttachVolumeTestJSON-1381673265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:05 devstack sudo[94415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:54:05 devstack sudo[94415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:05 devstack sudo[94411]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:05 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0c89ebdd-70fe-46fa-916e-03599e16a40d tempest-SnapshotsActionsTest-151668605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.info" returned: 0 in 0.286s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:05 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-0c89ebdd-70fe-46fa-916e-03599e16a40d tempest-SnapshotsActionsTest-151668605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.379s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:05 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-0c89ebdd-70fe-46fa-916e-03599e16a40d tempest-SnapshotsActionsTest-151668605 None] Create snapshot completed successfully Jul 30 16:54:05 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-5aa7dc14-293e-4568-b002-5a6362a134c1 tempest-AttachVolumeTestJSON-1381673265 None] Acquiring lock "cinder-6f74e087-2d4b-4f7c-9797-e0a20c00ffe8-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:05 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-5aa7dc14-293e-4568-b002-5a6362a134c1 tempest-AttachVolumeTestJSON-1381673265 None] Lock "cinder-6f74e087-2d4b-4f7c-9797-e0a20c00ffe8-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:05 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-5aa7dc14-293e-4568-b002-5a6362a134c1 tempest-AttachVolumeTestJSON-1381673265 None] Acquiring lock "cinder-quobyte-6f74e087-2d4b-4f7c-9797-e0a20c00ffe8" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:05 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-5aa7dc14-293e-4568-b002-5a6362a134c1 tempest-AttachVolumeTestJSON-1381673265 None] Lock "cinder-quobyte-6f74e087-2d4b-4f7c-9797-e0a20c00ffe8" acquired by "delete_volume" :: waited 0.028s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:05 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[04696895-efa2-4804-99d9-d9aefdaf127c]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:05 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-5aa7dc14-293e-4568-b002-5a6362a134c1 tempest-AttachVolumeTestJSON-1381673265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6f74e087-2d4b-4f7c-9797-e0a20c00ffe8 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:05 devstack sudo[94415]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:05 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-5fa42423-425a-4509-b7b4-17e67a7cddc8 tempest-AttachVolumeTestJSON-1381673265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.334s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:05 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-5fa42423-425a-4509-b7b4-17e67a7cddc8 tempest-AttachVolumeTestJSON-1381673265 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:54:05 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-5fa42423-425a-4509-b7b4-17e67a7cddc8 tempest-AttachVolumeTestJSON-1381673265 None] Deleted volume successfully. Jul 30 16:54:05 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-5fa42423-425a-4509-b7b4-17e67a7cddc8 tempest-AttachVolumeTestJSON-1381673265 None] Lock "cinder-94bfee53-2963-4b4c-ab98-7d9cda56974d-delete_volume" released by "delete_volume" :: held 1.374s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:05 devstack sudo[94420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6f74e087-2d4b-4f7c-9797-e0a20c00ffe8 Jul 30 16:54:05 devstack sudo[94420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:05 devstack sudo[94420]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:05 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-5aa7dc14-293e-4568-b002-5a6362a134c1 tempest-AttachVolumeTestJSON-1381673265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6f74e087-2d4b-4f7c-9797-e0a20c00ffe8" returned: 0 in 0.404s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:05 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-5aa7dc14-293e-4568-b002-5a6362a134c1 tempest-AttachVolumeTestJSON-1381673265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6f74e087-2d4b-4f7c-9797-e0a20c00ffe8 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:05 devstack sudo[94425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6f74e087-2d4b-4f7c-9797-e0a20c00ffe8 Jul 30 16:54:05 devstack sudo[94425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:06 devstack sudo[94425]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-5aa7dc14-293e-4568-b002-5a6362a134c1 tempest-AttachVolumeTestJSON-1381673265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6f74e087-2d4b-4f7c-9797-e0a20c00ffe8" returned: 0 in 0.365s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:06 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-5aa7dc14-293e-4568-b002-5a6362a134c1 tempest-AttachVolumeTestJSON-1381673265 None] Lock "cinder-quobyte-6f74e087-2d4b-4f7c-9797-e0a20c00ffe8" released by "delete_volume" :: held 0.820s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:06 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-5aa7dc14-293e-4568-b002-5a6362a134c1 tempest-AttachVolumeTestJSON-1381673265 None] Created reservations ['1b8b16e3-226b-49d3-baab-1b02ec760558', '1228e940-cfa0-44cd-b4e8-a008d5b21635', '13c0490d-9075-45e8-ac28-479d9753ee9e', '0ff8cd2d-8dfa-48ec-9b92-d97c414b1a38'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:54:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-5aa7dc14-293e-4568-b002-5a6362a134c1 tempest-AttachVolumeTestJSON-1381673265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-5aa7dc14-293e-4568-b002-5a6362a134c1 tempest-AttachVolumeTestJSON-1381673265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:06 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-5aa7dc14-293e-4568-b002-5a6362a134c1 tempest-AttachVolumeTestJSON-1381673265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:06 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-5aa7dc14-293e-4568-b002-5a6362a134c1 tempest-AttachVolumeTestJSON-1381673265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-5aa7dc14-293e-4568-b002-5a6362a134c1 tempest-AttachVolumeTestJSON-1381673265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-5aa7dc14-293e-4568-b002-5a6362a134c1 tempest-AttachVolumeTestJSON-1381673265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:06 devstack sudo[94429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:54:06 devstack sudo[94429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-ac328276-25a1-4a79-abc7-8e3ef3983fc8 tempest-SnapshotsActionsTest-151668605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-ac328276-25a1-4a79-abc7-8e3ef3983fc8 tempest-SnapshotsActionsTest-151668605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:06 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-ac328276-25a1-4a79-abc7-8e3ef3983fc8 tempest-SnapshotsActionsTest-151668605 None] Creating offline snapshot f38c6b11-2c61-4a5d-846e-c42c85fc841e of volume 22763b2b-8aa4-4016-8896-91249c91d08e {{(pid=88568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:54:06 devstack sudo[94429]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:06 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-06100aee-74dd-4f06-86b2-6c0e341d0afe tempest-AttachVolumeTestJSON-1381673265 None] Acquiring lock "cinder-2c3eee41-cff8-4afb-9fca-332790f73f54-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-5aa7dc14-293e-4568-b002-5a6362a134c1 tempest-AttachVolumeTestJSON-1381673265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.328s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:06 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-5aa7dc14-293e-4568-b002-5a6362a134c1 tempest-AttachVolumeTestJSON-1381673265 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:54:06 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-5aa7dc14-293e-4568-b002-5a6362a134c1 tempest-AttachVolumeTestJSON-1381673265 None] Deleted volume successfully. Jul 30 16:54:06 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[05797f58-2100-46bf-9634-432a74b5ce93]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-ac328276-25a1-4a79-abc7-8e3ef3983fc8 tempest-SnapshotsActionsTest-151668605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.d24fa2ac-ce70-4dfc-b918-d137c25ef760 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:06 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-06100aee-74dd-4f06-86b2-6c0e341d0afe tempest-AttachVolumeTestJSON-1381673265 None] Lock "cinder-2c3eee41-cff8-4afb-9fca-332790f73f54-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:06 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-5aa7dc14-293e-4568-b002-5a6362a134c1 tempest-AttachVolumeTestJSON-1381673265 None] Lock "cinder-6f74e087-2d4b-4f7c-9797-e0a20c00ffe8-delete_volume" released by "delete_volume" :: held 1.437s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:06 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-06100aee-74dd-4f06-86b2-6c0e341d0afe tempest-AttachVolumeTestJSON-1381673265 None] Acquiring lock "cinder-quobyte-2c3eee41-cff8-4afb-9fca-332790f73f54" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:06 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-06100aee-74dd-4f06-86b2-6c0e341d0afe tempest-AttachVolumeTestJSON-1381673265 None] Lock "cinder-quobyte-2c3eee41-cff8-4afb-9fca-332790f73f54" acquired by "delete_volume" :: waited 0.015s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:06 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62aaa67-994d-4377-893e-abf454e94019]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-06100aee-74dd-4f06-86b2-6c0e341d0afe tempest-AttachVolumeTestJSON-1381673265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2c3eee41-cff8-4afb-9fca-332790f73f54 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:06 devstack sudo[94432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.d24fa2ac-ce70-4dfc-b918-d137c25ef760 Jul 30 16:54:06 devstack sudo[94432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:06 devstack sudo[94433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2c3eee41-cff8-4afb-9fca-332790f73f54 Jul 30 16:54:06 devstack sudo[94433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:07 devstack sudo[94432]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:07 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-ac328276-25a1-4a79-abc7-8e3ef3983fc8 tempest-SnapshotsActionsTest-151668605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.d24fa2ac-ce70-4dfc-b918-d137c25ef760" returned: 0 in 0.435s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:07 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-ac328276-25a1-4a79-abc7-8e3ef3983fc8 tempest-SnapshotsActionsTest-151668605 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22763b2b-8aa4-4016-8896-91249c91d08e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:54:07 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-ac328276-25a1-4a79-abc7-8e3ef3983fc8 tempest-SnapshotsActionsTest-151668605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.d24fa2ac-ce70-4dfc-b918-d137c25ef760,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.f38c6b11-2c61-4a5d-846e-c42c85fc841e 1G {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:07 devstack sudo[94441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.d24fa2ac-ce70-4dfc-b918-d137c25ef760,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.f38c6b11-2c61-4a5d-846e-c42c85fc841e 1G Jul 30 16:54:07 devstack sudo[94441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:07 devstack sudo[94433]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:07 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-06100aee-74dd-4f06-86b2-6c0e341d0afe tempest-AttachVolumeTestJSON-1381673265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2c3eee41-cff8-4afb-9fca-332790f73f54" returned: 0 in 0.451s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:07 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-06100aee-74dd-4f06-86b2-6c0e341d0afe tempest-AttachVolumeTestJSON-1381673265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2c3eee41-cff8-4afb-9fca-332790f73f54 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:07 devstack sudo[94444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2c3eee41-cff8-4afb-9fca-332790f73f54 Jul 30 16:54:07 devstack sudo[94444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:07 devstack sudo[94444]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:07 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-06100aee-74dd-4f06-86b2-6c0e341d0afe tempest-AttachVolumeTestJSON-1381673265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2c3eee41-cff8-4afb-9fca-332790f73f54" returned: 0 in 0.325s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:07 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-06100aee-74dd-4f06-86b2-6c0e341d0afe tempest-AttachVolumeTestJSON-1381673265 None] Lock "cinder-quobyte-2c3eee41-cff8-4afb-9fca-332790f73f54" released by "delete_volume" :: held 0.827s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:07 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-06100aee-74dd-4f06-86b2-6c0e341d0afe tempest-AttachVolumeTestJSON-1381673265 None] Created reservations ['dc869787-de10-4fda-b48d-610391bd2608', '123a9b17-36ee-47f3-a301-caf4edd38f9b', '663f79b5-f58b-4e3d-b95f-d30341d0a9bf', '4b0859c3-c5f8-46a0-9066-0b605666afa9'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:54:07 devstack sudo[94441]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:07 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-ac328276-25a1-4a79-abc7-8e3ef3983fc8 tempest-SnapshotsActionsTest-151668605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.d24fa2ac-ce70-4dfc-b918-d137c25ef760,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.f38c6b11-2c61-4a5d-846e-c42c85fc841e 1G" returned: 0 in 0.563s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:07 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-ac328276-25a1-4a79-abc7-8e3ef3983fc8 tempest-SnapshotsActionsTest-151668605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22763b2b-8aa4-4016-8896-91249c91d08e.d24fa2ac-ce70-4dfc-b918-d137c25ef760 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.f38c6b11-2c61-4a5d-846e-c42c85fc841e {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:07 devstack sudo[94451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22763b2b-8aa4-4016-8896-91249c91d08e.d24fa2ac-ce70-4dfc-b918-d137c25ef760 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.f38c6b11-2c61-4a5d-846e-c42c85fc841e Jul 30 16:54:07 devstack sudo[94451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:07 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-06100aee-74dd-4f06-86b2-6c0e341d0afe tempest-AttachVolumeTestJSON-1381673265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:07 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-06100aee-74dd-4f06-86b2-6c0e341d0afe tempest-AttachVolumeTestJSON-1381673265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:07 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-06100aee-74dd-4f06-86b2-6c0e341d0afe tempest-AttachVolumeTestJSON-1381673265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:07 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-06100aee-74dd-4f06-86b2-6c0e341d0afe tempest-AttachVolumeTestJSON-1381673265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:07 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-06100aee-74dd-4f06-86b2-6c0e341d0afe tempest-AttachVolumeTestJSON-1381673265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:07 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-06100aee-74dd-4f06-86b2-6c0e341d0afe tempest-AttachVolumeTestJSON-1381673265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:07 devstack sudo[94453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:54:07 devstack sudo[94453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:07 devstack sudo[94453]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:07 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-06100aee-74dd-4f06-86b2-6c0e341d0afe tempest-AttachVolumeTestJSON-1381673265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.316s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:07 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-06100aee-74dd-4f06-86b2-6c0e341d0afe tempest-AttachVolumeTestJSON-1381673265 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:54:07 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-06100aee-74dd-4f06-86b2-6c0e341d0afe tempest-AttachVolumeTestJSON-1381673265 None] Deleted volume successfully. Jul 30 16:54:07 devstack sudo[94451]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:08 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-ac328276-25a1-4a79-abc7-8e3ef3983fc8 tempest-SnapshotsActionsTest-151668605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22763b2b-8aa4-4016-8896-91249c91d08e.d24fa2ac-ce70-4dfc-b918-d137c25ef760 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.f38c6b11-2c61-4a5d-846e-c42c85fc841e" returned: 0 in 0.412s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:08 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-ac328276-25a1-4a79-abc7-8e3ef3983fc8 tempest-SnapshotsActionsTest-151668605 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.f38c6b11-2c61-4a5d-846e-c42c85fc841e is being set with open permissions: ugo+rw Jul 30 16:54:08 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-ac328276-25a1-4a79-abc7-8e3ef3983fc8 tempest-SnapshotsActionsTest-151668605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.f38c6b11-2c61-4a5d-846e-c42c85fc841e {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:08 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-06100aee-74dd-4f06-86b2-6c0e341d0afe tempest-AttachVolumeTestJSON-1381673265 None] Lock "cinder-2c3eee41-cff8-4afb-9fca-332790f73f54-delete_volume" released by "delete_volume" :: held 1.429s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:08 devstack sudo[94460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.f38c6b11-2c61-4a5d-846e-c42c85fc841e Jul 30 16:54:08 devstack sudo[94460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:08 devstack sudo[94460]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:08 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-ac328276-25a1-4a79-abc7-8e3ef3983fc8 tempest-SnapshotsActionsTest-151668605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.f38c6b11-2c61-4a5d-846e-c42c85fc841e" returned: 0 in 0.292s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:08 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-ac328276-25a1-4a79-abc7-8e3ef3983fc8 tempest-SnapshotsActionsTest-151668605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.854s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:08 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-ac328276-25a1-4a79-abc7-8e3ef3983fc8 tempest-SnapshotsActionsTest-151668605 None] Create snapshot completed successfully Jul 30 16:54:08 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-2cf94b9d-05b5-4097-b758-baad25128789 tempest-SnapshotsActionsTest-350789574 None] Acquiring lock "cinder-f38c6b11-2c61-4a5d-846e-c42c85fc841e-delete_snapshot" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:08 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-2cf94b9d-05b5-4097-b758-baad25128789 tempest-SnapshotsActionsTest-350789574 None] Lock "cinder-f38c6b11-2c61-4a5d-846e-c42c85fc841e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:08 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-2cf94b9d-05b5-4097-b758-baad25128789 tempest-SnapshotsActionsTest-350789574 None] Acquiring lock "cinder-quobyte-22763b2b-8aa4-4016-8896-91249c91d08e" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:09 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-2cf94b9d-05b5-4097-b758-baad25128789 tempest-SnapshotsActionsTest-350789574 None] Lock "cinder-quobyte-22763b2b-8aa4-4016-8896-91249c91d08e" acquired by "delete_snapshot" :: waited 0.038s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:09 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-2cf94b9d-05b5-4097-b758-baad25128789 tempest-SnapshotsActionsTest-350789574 None] Acquiring lock "cinder-quobyte-f38c6b11-2c61-4a5d-846e-c42c85fc841e" by "_delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:09 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-2cf94b9d-05b5-4097-b758-baad25128789 tempest-SnapshotsActionsTest-350789574 None] Lock "cinder-quobyte-f38c6b11-2c61-4a5d-846e-c42c85fc841e" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:09 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-2cf94b9d-05b5-4097-b758-baad25128789 tempest-SnapshotsActionsTest-350789574 None] Deleting offline snapshot f38c6b11-2c61-4a5d-846e-c42c85fc841e of volume 22763b2b-8aa4-4016-8896-91249c91d08e {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:54:09 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-2cf94b9d-05b5-4097-b758-baad25128789 tempest-SnapshotsActionsTest-350789574 None] snapshot_file for this snap is: volume-22763b2b-8aa4-4016-8896-91249c91d08e.f38c6b11-2c61-4a5d-846e-c42c85fc841e {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:54:09 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[24607a97-11f2-40dc-b7d0-138cebf9a0de]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:09 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2cf94b9d-05b5-4097-b758-baad25128789 tempest-SnapshotsActionsTest-350789574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.f38c6b11-2c61-4a5d-846e-c42c85fc841e {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:09 devstack sudo[94464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.f38c6b11-2c61-4a5d-846e-c42c85fc841e Jul 30 16:54:09 devstack sudo[94464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:09 devstack sudo[94464]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:09 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2cf94b9d-05b5-4097-b758-baad25128789 tempest-SnapshotsActionsTest-350789574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.f38c6b11-2c61-4a5d-846e-c42c85fc841e" returned: 0 in 0.549s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:09 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-2cf94b9d-05b5-4097-b758-baad25128789 tempest-SnapshotsActionsTest-350789574 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22763b2b-8aa4-4016-8896-91249c91d08e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:54:09 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[274f9c62-95f7-4753-a739-3d856e4269d6]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:09 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2cf94b9d-05b5-4097-b758-baad25128789 tempest-SnapshotsActionsTest-350789574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.d24fa2ac-ce70-4dfc-b918-d137c25ef760 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:09 devstack sudo[94469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.d24fa2ac-ce70-4dfc-b918-d137c25ef760 Jul 30 16:54:09 devstack sudo[94469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:10 devstack sudo[94469]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:10 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2cf94b9d-05b5-4097-b758-baad25128789 tempest-SnapshotsActionsTest-350789574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.d24fa2ac-ce70-4dfc-b918-d137c25ef760" returned: 0 in 0.535s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:10 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-2cf94b9d-05b5-4097-b758-baad25128789 tempest-SnapshotsActionsTest-350789574 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22763b2b-8aa4-4016-8896-91249c91d08e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:54:10 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2cf94b9d-05b5-4097-b758-baad25128789 tempest-SnapshotsActionsTest-350789574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.f38c6b11-2c61-4a5d-846e-c42c85fc841e {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:10 devstack sudo[94476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.f38c6b11-2c61-4a5d-846e-c42c85fc841e Jul 30 16:54:10 devstack sudo[94476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:10 devstack sudo[94476]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:10 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2cf94b9d-05b5-4097-b758-baad25128789 tempest-SnapshotsActionsTest-350789574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.f38c6b11-2c61-4a5d-846e-c42c85fc841e" returned: 0 in 0.491s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:10 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2cf94b9d-05b5-4097-b758-baad25128789 tempest-SnapshotsActionsTest-350789574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.f38c6b11-2c61-4a5d-846e-c42c85fc841e {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:10 devstack sudo[94483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.f38c6b11-2c61-4a5d-846e-c42c85fc841e Jul 30 16:54:10 devstack sudo[94483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:11 devstack sudo[94483]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2cf94b9d-05b5-4097-b758-baad25128789 tempest-SnapshotsActionsTest-350789574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.f38c6b11-2c61-4a5d-846e-c42c85fc841e" returned: 0 in 0.313s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:11 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-2cf94b9d-05b5-4097-b758-baad25128789 tempest-SnapshotsActionsTest-350789574 None] Lock "cinder-quobyte-f38c6b11-2c61-4a5d-846e-c42c85fc841e" released by "_delete_snapshot" :: held 2.103s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:11 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-2cf94b9d-05b5-4097-b758-baad25128789 tempest-SnapshotsActionsTest-350789574 None] Lock "cinder-quobyte-22763b2b-8aa4-4016-8896-91249c91d08e" released by "delete_snapshot" :: held 2.133s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:11 devstack cinder-volume[88568]: WARNING cinder.quota [None req-2cf94b9d-05b5-4097-b758-baad25128789 tempest-SnapshotsActionsTest-350789574 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:54:11 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-2cf94b9d-05b5-4097-b758-baad25128789 tempest-SnapshotsActionsTest-350789574 None] Created reservations ['619a9a1f-c560-4489-81f1-b5af593a648d', 'e39a41c1-7396-4d49-a92f-c40eaf15ca1c', '21b3c753-1267-44d4-8a95-31843bbf86ef', 'c087cb40-4543-4ce8-9714-335621f4c85f'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:54:11 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-2cf94b9d-05b5-4097-b758-baad25128789 tempest-SnapshotsActionsTest-350789574 None] Delete snapshot completed successfully. Jul 30 16:54:11 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-2cf94b9d-05b5-4097-b758-baad25128789 tempest-SnapshotsActionsTest-350789574 None] Lock "cinder-f38c6b11-2c61-4a5d-846e-c42c85fc841e-delete_snapshot" released by "delete_snapshot" :: held 2.345s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-82067d17-1503-4969-9adb-1b0c1e5b28b2 tempest-SnapshotsActionsTest-151668605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-82067d17-1503-4969-9adb-1b0c1e5b28b2 tempest-SnapshotsActionsTest-151668605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:12 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-82067d17-1503-4969-9adb-1b0c1e5b28b2 tempest-SnapshotsActionsTest-151668605 None] Creating offline snapshot 215b9e49-d418-4e86-8b81-435de8a5cf82 of volume 22763b2b-8aa4-4016-8896-91249c91d08e {{(pid=88568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:54:12 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a0f70b-2f22-4d5a-a1de-1624566fefee]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-82067d17-1503-4969-9adb-1b0c1e5b28b2 tempest-SnapshotsActionsTest-151668605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.d24fa2ac-ce70-4dfc-b918-d137c25ef760 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:12 devstack sudo[94523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.d24fa2ac-ce70-4dfc-b918-d137c25ef760 Jul 30 16:54:12 devstack sudo[94523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:13 devstack sudo[94523]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-82067d17-1503-4969-9adb-1b0c1e5b28b2 tempest-SnapshotsActionsTest-151668605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.d24fa2ac-ce70-4dfc-b918-d137c25ef760" returned: 0 in 0.460s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:13 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-82067d17-1503-4969-9adb-1b0c1e5b28b2 tempest-SnapshotsActionsTest-151668605 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22763b2b-8aa4-4016-8896-91249c91d08e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:54:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-82067d17-1503-4969-9adb-1b0c1e5b28b2 tempest-SnapshotsActionsTest-151668605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.d24fa2ac-ce70-4dfc-b918-d137c25ef760,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.215b9e49-d418-4e86-8b81-435de8a5cf82 1G {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:13 devstack sudo[94528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.d24fa2ac-ce70-4dfc-b918-d137c25ef760,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.215b9e49-d418-4e86-8b81-435de8a5cf82 1G Jul 30 16:54:13 devstack sudo[94528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:14 devstack sudo[94528]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-82067d17-1503-4969-9adb-1b0c1e5b28b2 tempest-SnapshotsActionsTest-151668605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.d24fa2ac-ce70-4dfc-b918-d137c25ef760,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.215b9e49-d418-4e86-8b81-435de8a5cf82 1G" returned: 0 in 0.716s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-82067d17-1503-4969-9adb-1b0c1e5b28b2 tempest-SnapshotsActionsTest-151668605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22763b2b-8aa4-4016-8896-91249c91d08e.d24fa2ac-ce70-4dfc-b918-d137c25ef760 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.215b9e49-d418-4e86-8b81-435de8a5cf82 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:14 devstack sudo[94536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22763b2b-8aa4-4016-8896-91249c91d08e.d24fa2ac-ce70-4dfc-b918-d137c25ef760 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.215b9e49-d418-4e86-8b81-435de8a5cf82 Jul 30 16:54:14 devstack sudo[94536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:14 devstack sudo[94536]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-82067d17-1503-4969-9adb-1b0c1e5b28b2 tempest-SnapshotsActionsTest-151668605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22763b2b-8aa4-4016-8896-91249c91d08e.d24fa2ac-ce70-4dfc-b918-d137c25ef760 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.215b9e49-d418-4e86-8b81-435de8a5cf82" returned: 0 in 0.547s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:14 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-82067d17-1503-4969-9adb-1b0c1e5b28b2 tempest-SnapshotsActionsTest-151668605 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.215b9e49-d418-4e86-8b81-435de8a5cf82 is being set with open permissions: ugo+rw Jul 30 16:54:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-82067d17-1503-4969-9adb-1b0c1e5b28b2 tempest-SnapshotsActionsTest-151668605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.215b9e49-d418-4e86-8b81-435de8a5cf82 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:14 devstack sudo[94578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.215b9e49-d418-4e86-8b81-435de8a5cf82 Jul 30 16:54:14 devstack sudo[94578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:15 devstack sudo[94578]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:15 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-82067d17-1503-4969-9adb-1b0c1e5b28b2 tempest-SnapshotsActionsTest-151668605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.215b9e49-d418-4e86-8b81-435de8a5cf82" returned: 0 in 0.581s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:15 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-82067d17-1503-4969-9adb-1b0c1e5b28b2 tempest-SnapshotsActionsTest-151668605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.462s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:15 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-82067d17-1503-4969-9adb-1b0c1e5b28b2 tempest-SnapshotsActionsTest-151668605 None] Create snapshot completed successfully Jul 30 16:54:16 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-304a5e28-43d9-45f3-bda0-039517e34cd4 tempest-SnapshotsActionsTest-350789574 None] Acquiring lock "cinder-215b9e49-d418-4e86-8b81-435de8a5cf82-delete_snapshot" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:16 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-304a5e28-43d9-45f3-bda0-039517e34cd4 tempest-SnapshotsActionsTest-350789574 None] Lock "cinder-215b9e49-d418-4e86-8b81-435de8a5cf82-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:16 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-304a5e28-43d9-45f3-bda0-039517e34cd4 tempest-SnapshotsActionsTest-350789574 None] Acquiring lock "cinder-quobyte-22763b2b-8aa4-4016-8896-91249c91d08e" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:16 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-5c9873bf-a534-4e0e-acc4-7e7875973914 req-a881c243-5a08-40fd-9167-4541239f0833 tempest-ServerActionsTestOtherA-332393488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:16 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-5c9873bf-a534-4e0e-acc4-7e7875973914 req-a881c243-5a08-40fd-9167-4541239f0833 tempest-ServerActionsTestOtherA-332393488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:16 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-304a5e28-43d9-45f3-bda0-039517e34cd4 tempest-SnapshotsActionsTest-350789574 None] Lock "cinder-quobyte-22763b2b-8aa4-4016-8896-91249c91d08e" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:16 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-304a5e28-43d9-45f3-bda0-039517e34cd4 tempest-SnapshotsActionsTest-350789574 None] Acquiring lock "cinder-quobyte-215b9e49-d418-4e86-8b81-435de8a5cf82" by "_delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:16 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-5c9873bf-a534-4e0e-acc4-7e7875973914 req-a881c243-5a08-40fd-9167-4541239f0833 tempest-ServerActionsTestOtherA-332393488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.055s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:16 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-304a5e28-43d9-45f3-bda0-039517e34cd4 tempest-SnapshotsActionsTest-350789574 None] Lock "cinder-quobyte-215b9e49-d418-4e86-8b81-435de8a5cf82" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:16 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-304a5e28-43d9-45f3-bda0-039517e34cd4 tempest-SnapshotsActionsTest-350789574 None] Deleting offline snapshot 215b9e49-d418-4e86-8b81-435de8a5cf82 of volume 22763b2b-8aa4-4016-8896-91249c91d08e {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:54:16 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-304a5e28-43d9-45f3-bda0-039517e34cd4 tempest-SnapshotsActionsTest-350789574 None] snapshot_file for this snap is: volume-22763b2b-8aa4-4016-8896-91249c91d08e.215b9e49-d418-4e86-8b81-435de8a5cf82 {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:54:16 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[50edc26f-1a4d-416a-9ce1-8008d12a3815]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:16 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-304a5e28-43d9-45f3-bda0-039517e34cd4 tempest-SnapshotsActionsTest-350789574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.215b9e49-d418-4e86-8b81-435de8a5cf82 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:16 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [req-5c9873bf-a534-4e0e-acc4-7e7875973914 req-a881c243-5a08-40fd-9167-4541239f0833 tempest-ServerActionsTestOtherA-332393488 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924', 'name': 'volume-60604682-ec4c-4fb2-937a-7cf43dbcc110', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fca79bce-eae4-4149-b3e5-bbc714e93926', 'enforce_multipath': True} {{(pid=88568) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 16:54:16 devstack cinder-volume[88568]: INFO cinder.volume.manager [req-5c9873bf-a534-4e0e-acc4-7e7875973914 req-a881c243-5a08-40fd-9167-4541239f0833 tempest-ServerActionsTestOtherA-332393488 None] attachment_update completed successfully. Jul 30 16:54:16 devstack sudo[94640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.215b9e49-d418-4e86-8b81-435de8a5cf82 Jul 30 16:54:16 devstack sudo[94640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:16 devstack sudo[94640]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:16 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-304a5e28-43d9-45f3-bda0-039517e34cd4 tempest-SnapshotsActionsTest-350789574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.215b9e49-d418-4e86-8b81-435de8a5cf82" returned: 0 in 0.538s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:16 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-304a5e28-43d9-45f3-bda0-039517e34cd4 tempest-SnapshotsActionsTest-350789574 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22763b2b-8aa4-4016-8896-91249c91d08e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:54:16 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[85fabb42-b47a-477d-bc48-85524e86bd00]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:16 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-304a5e28-43d9-45f3-bda0-039517e34cd4 tempest-SnapshotsActionsTest-350789574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.d24fa2ac-ce70-4dfc-b918-d137c25ef760 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:17 devstack sudo[95030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.d24fa2ac-ce70-4dfc-b918-d137c25ef760 Jul 30 16:54:17 devstack sudo[95030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:17 devstack sudo[95030]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-304a5e28-43d9-45f3-bda0-039517e34cd4 tempest-SnapshotsActionsTest-350789574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.d24fa2ac-ce70-4dfc-b918-d137c25ef760" returned: 0 in 0.880s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:17 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-304a5e28-43d9-45f3-bda0-039517e34cd4 tempest-SnapshotsActionsTest-350789574 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22763b2b-8aa4-4016-8896-91249c91d08e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:54:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-304a5e28-43d9-45f3-bda0-039517e34cd4 tempest-SnapshotsActionsTest-350789574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.215b9e49-d418-4e86-8b81-435de8a5cf82 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:17 devstack sudo[95038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.215b9e49-d418-4e86-8b81-435de8a5cf82 Jul 30 16:54:17 devstack sudo[95038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:17 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [req-a999f6e3-4874-4f5c-b3c1-aca29b6f84d7 req-21607b0b-5365-4b5d-a2c1-03657529ac13 tempest-VolumesGetTestJSON-1449774970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:54:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [req-a999f6e3-4874-4f5c-b3c1-aca29b6f84d7 req-21607b0b-5365-4b5d-a2c1-03657529ac13 tempest-VolumesGetTestJSON-1449774970 None] Flow 'volume_create_manager' (410bd3a0-c75e-4e02-8d01-ee7018277766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:54:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [req-a999f6e3-4874-4f5c-b3c1-aca29b6f84d7 req-21607b0b-5365-4b5d-a2c1-03657529ac13 tempest-VolumesGetTestJSON-1449774970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (406e578e-9950-4fc6-a692-120307cc8108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:18 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [req-a999f6e3-4874-4f5c-b3c1-aca29b6f84d7 req-21607b0b-5365-4b5d-a2c1-03657529ac13 tempest-VolumesGetTestJSON-1449774970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (406e578e-9950-4fc6-a692-120307cc8108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:54:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-649078322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f094d87d-a843-4e27-9b7b-a9b25f4c3c2e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ce3b28474b5c42cc8d42e07bc3f37a82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:54:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:54:18Z,use_quota=True,user_id='40d7c0ee6b6c4c8db566220b08fcca6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:18 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [req-a999f6e3-4874-4f5c-b3c1-aca29b6f84d7 req-21607b0b-5365-4b5d-a2c1-03657529ac13 tempest-VolumesGetTestJSON-1449774970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42b2e81f-f54d-4174-9195-28476dfad0e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:18 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [req-a999f6e3-4874-4f5c-b3c1-aca29b6f84d7 req-21607b0b-5365-4b5d-a2c1-03657529ac13 tempest-VolumesGetTestJSON-1449774970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42b2e81f-f54d-4174-9195-28476dfad0e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:18 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [req-a999f6e3-4874-4f5c-b3c1-aca29b6f84d7 req-21607b0b-5365-4b5d-a2c1-03657529ac13 tempest-VolumesGetTestJSON-1449774970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8c4196f-ec22-402f-b37b-9937e7cf7334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:18 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [req-a999f6e3-4874-4f5c-b3c1-aca29b6f84d7 req-21607b0b-5365-4b5d-a2c1-03657529ac13 tempest-VolumesGetTestJSON-1449774970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8c4196f-ec22-402f-b37b-9937e7cf7334) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f094d87d-a843-4e27-9b7b-a9b25f4c3c2e', 'volume_name': 'volume-f094d87d-a843-4e27-9b7b-a9b25f4c3c2e', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:18 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [req-a999f6e3-4874-4f5c-b3c1-aca29b6f84d7 req-21607b0b-5365-4b5d-a2c1-03657529ac13 tempest-VolumesGetTestJSON-1449774970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3a18b43-81e5-453b-b124-f422f0847015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:18 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [req-a999f6e3-4874-4f5c-b3c1-aca29b6f84d7 req-21607b0b-5365-4b5d-a2c1-03657529ac13 tempest-VolumesGetTestJSON-1449774970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3a18b43-81e5-453b-b124-f422f0847015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:18 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [req-a999f6e3-4874-4f5c-b3c1-aca29b6f84d7 req-21607b0b-5365-4b5d-a2c1-03657529ac13 tempest-VolumesGetTestJSON-1449774970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (459e88c4-0775-4cc8-a99b-cc9708b894f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:18 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [req-a999f6e3-4874-4f5c-b3c1-aca29b6f84d7 req-21607b0b-5365-4b5d-a2c1-03657529ac13 tempest-VolumesGetTestJSON-1449774970 None] Volume f094d87d-a843-4e27-9b7b-a9b25f4c3c2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f094d87d-a843-4e27-9b7b-a9b25f4c3c2e', 'volume_size': 1} Jul 30 16:54:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-a999f6e3-4874-4f5c-b3c1-aca29b6f84d7 req-21607b0b-5365-4b5d-a2c1-03657529ac13 tempest-VolumesGetTestJSON-1449774970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-a999f6e3-4874-4f5c-b3c1-aca29b6f84d7 req-21607b0b-5365-4b5d-a2c1-03657529ac13 tempest-VolumesGetTestJSON-1449774970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:18 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [req-a999f6e3-4874-4f5c-b3c1-aca29b6f84d7 req-21607b0b-5365-4b5d-a2c1-03657529ac13 tempest-VolumesGetTestJSON-1449774970 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:54:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-649078322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f094d87d-a843-4e27-9b7b-a9b25f4c3c2e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ce3b28474b5c42cc8d42e07bc3f37a82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:54:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:54:18Z,use_quota=True,user_id='40d7c0ee6b6c4c8db566220b08fcca6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:54:18 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [req-a999f6e3-4874-4f5c-b3c1-aca29b6f84d7 req-21607b0b-5365-4b5d-a2c1-03657529ac13 tempest-VolumesGetTestJSON-1449774970 None] Creating volume f094d87d-a843-4e27-9b7b-a9b25f4c3c2e {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:54:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-a999f6e3-4874-4f5c-b3c1-aca29b6f84d7 req-21607b0b-5365-4b5d-a2c1-03657529ac13 tempest-VolumesGetTestJSON-1449774970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-a999f6e3-4874-4f5c-b3c1-aca29b6f84d7 req-21607b0b-5365-4b5d-a2c1-03657529ac13 tempest-VolumesGetTestJSON-1449774970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:18 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [req-a999f6e3-4874-4f5c-b3c1-aca29b6f84d7 req-21607b0b-5365-4b5d-a2c1-03657529ac13 tempest-VolumesGetTestJSON-1449774970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:18 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [req-a999f6e3-4874-4f5c-b3c1-aca29b6f84d7 req-21607b0b-5365-4b5d-a2c1-03657529ac13 tempest-VolumesGetTestJSON-1449774970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-a999f6e3-4874-4f5c-b3c1-aca29b6f84d7 req-21607b0b-5365-4b5d-a2c1-03657529ac13 tempest-VolumesGetTestJSON-1449774970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:18 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [req-a999f6e3-4874-4f5c-b3c1-aca29b6f84d7 req-21607b0b-5365-4b5d-a2c1-03657529ac13 tempest-VolumesGetTestJSON-1449774970 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:54:18 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [req-a999f6e3-4874-4f5c-b3c1-aca29b6f84d7 req-21607b0b-5365-4b5d-a2c1-03657529ac13 tempest-VolumesGetTestJSON-1449774970 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 16:54:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [req-a999f6e3-4874-4f5c-b3c1-aca29b6f84d7 req-21607b0b-5365-4b5d-a2c1-03657529ac13 tempest-VolumesGetTestJSON-1449774970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f094d87d-a843-4e27-9b7b-a9b25f4c3c2e 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:18 devstack sudo[95041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f094d87d-a843-4e27-9b7b-a9b25f4c3c2e 1073741824 Jul 30 16:54:18 devstack sudo[95041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:18 devstack sudo[95038]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-304a5e28-43d9-45f3-bda0-039517e34cd4 tempest-SnapshotsActionsTest-350789574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.215b9e49-d418-4e86-8b81-435de8a5cf82" returned: 0 in 0.651s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-304a5e28-43d9-45f3-bda0-039517e34cd4 tempest-SnapshotsActionsTest-350789574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.215b9e49-d418-4e86-8b81-435de8a5cf82 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:18 devstack sudo[95051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.215b9e49-d418-4e86-8b81-435de8a5cf82 Jul 30 16:54:18 devstack sudo[95051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:18 devstack sudo[95041]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [req-a999f6e3-4874-4f5c-b3c1-aca29b6f84d7 req-21607b0b-5365-4b5d-a2c1-03657529ac13 tempest-VolumesGetTestJSON-1449774970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f094d87d-a843-4e27-9b7b-a9b25f4c3c2e 1073741824" returned: 0 in 0.543s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [req-a999f6e3-4874-4f5c-b3c1-aca29b6f84d7 req-21607b0b-5365-4b5d-a2c1-03657529ac13 tempest-VolumesGetTestJSON-1449774970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f094d87d-a843-4e27-9b7b-a9b25f4c3c2e {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:18 devstack sudo[95053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f094d87d-a843-4e27-9b7b-a9b25f4c3c2e Jul 30 16:54:18 devstack sudo[95053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:18 devstack sudo[95051]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-304a5e28-43d9-45f3-bda0-039517e34cd4 tempest-SnapshotsActionsTest-350789574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.215b9e49-d418-4e86-8b81-435de8a5cf82" returned: 0 in 0.299s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:18 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-304a5e28-43d9-45f3-bda0-039517e34cd4 tempest-SnapshotsActionsTest-350789574 None] Lock "cinder-quobyte-215b9e49-d418-4e86-8b81-435de8a5cf82" released by "_delete_snapshot" :: held 2.551s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:18 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-304a5e28-43d9-45f3-bda0-039517e34cd4 tempest-SnapshotsActionsTest-350789574 None] Lock "cinder-quobyte-22763b2b-8aa4-4016-8896-91249c91d08e" released by "delete_snapshot" :: held 2.612s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:18 devstack sudo[95053]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [req-a999f6e3-4874-4f5c-b3c1-aca29b6f84d7 req-21607b0b-5365-4b5d-a2c1-03657529ac13 tempest-VolumesGetTestJSON-1449774970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f094d87d-a843-4e27-9b7b-a9b25f4c3c2e" returned: 0 in 0.261s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:18 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [req-a999f6e3-4874-4f5c-b3c1-aca29b6f84d7 req-21607b0b-5365-4b5d-a2c1-03657529ac13 tempest-VolumesGetTestJSON-1449774970 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:54:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-a999f6e3-4874-4f5c-b3c1-aca29b6f84d7 req-21607b0b-5365-4b5d-a2c1-03657529ac13 tempest-VolumesGetTestJSON-1449774970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:18 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [req-a999f6e3-4874-4f5c-b3c1-aca29b6f84d7 req-21607b0b-5365-4b5d-a2c1-03657529ac13 tempest-VolumesGetTestJSON-1449774970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (459e88c4-0775-4cc8-a99b-cc9708b894f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f094d87d-a843-4e27-9b7b-a9b25f4c3c2e', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:18 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [req-a999f6e3-4874-4f5c-b3c1-aca29b6f84d7 req-21607b0b-5365-4b5d-a2c1-03657529ac13 tempest-VolumesGetTestJSON-1449774970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4080b4b-98df-4a89-b561-fa7d1ea227a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:18 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [req-a999f6e3-4874-4f5c-b3c1-aca29b6f84d7 req-21607b0b-5365-4b5d-a2c1-03657529ac13 tempest-VolumesGetTestJSON-1449774970 None] Volume volume-f094d87d-a843-4e27-9b7b-a9b25f4c3c2e (f094d87d-a843-4e27-9b7b-a9b25f4c3c2e): created successfully Jul 30 16:54:18 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [req-a999f6e3-4874-4f5c-b3c1-aca29b6f84d7 req-21607b0b-5365-4b5d-a2c1-03657529ac13 tempest-VolumesGetTestJSON-1449774970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4080b4b-98df-4a89-b561-fa7d1ea227a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:18 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [req-a999f6e3-4874-4f5c-b3c1-aca29b6f84d7 req-21607b0b-5365-4b5d-a2c1-03657529ac13 tempest-VolumesGetTestJSON-1449774970 None] Flow 'volume_create_manager' (410bd3a0-c75e-4e02-8d01-ee7018277766) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:54:18 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-304a5e28-43d9-45f3-bda0-039517e34cd4 tempest-SnapshotsActionsTest-350789574 None] Created reservations ['15951384-1644-419d-8369-83bada86cded', '198cbb68-2bcb-4663-aab0-e56a71e93055', '6a5a6b1b-b827-4926-a57d-3261808cb055', 'b6a32251-3a83-438f-9d57-a80109721baf'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:54:19 devstack cinder-volume[88568]: INFO cinder.volume.manager [req-a999f6e3-4874-4f5c-b3c1-aca29b6f84d7 req-21607b0b-5365-4b5d-a2c1-03657529ac13 tempest-VolumesGetTestJSON-1449774970 None] Created volume successfully. Jul 30 16:54:19 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-304a5e28-43d9-45f3-bda0-039517e34cd4 tempest-SnapshotsActionsTest-350789574 None] Delete snapshot completed successfully. Jul 30 16:54:19 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-304a5e28-43d9-45f3-bda0-039517e34cd4 tempest-SnapshotsActionsTest-350789574 None] Lock "cinder-215b9e49-d418-4e86-8b81-435de8a5cf82-delete_snapshot" released by "delete_snapshot" :: held 2.867s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:19 devstack cinder-volume[88568]: DEBUG cinder.coordination [req-278db88b-d519-4c9f-82ef-bfcf19474d03 req-c8187ea3-3e11-4632-adc1-624c697565b3 tempest-VolumesGetTestJSON-1449774970 None] Acquiring lock "cinder-f094d87d-a843-4e27-9b7b-a9b25f4c3c2e-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:19 devstack cinder-volume[88568]: DEBUG cinder.coordination [req-278db88b-d519-4c9f-82ef-bfcf19474d03 req-c8187ea3-3e11-4632-adc1-624c697565b3 tempest-VolumesGetTestJSON-1449774970 None] Lock "cinder-f094d87d-a843-4e27-9b7b-a9b25f4c3c2e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:19 devstack cinder-volume[88568]: DEBUG cinder.coordination [req-278db88b-d519-4c9f-82ef-bfcf19474d03 req-c8187ea3-3e11-4632-adc1-624c697565b3 tempest-VolumesGetTestJSON-1449774970 None] Acquiring lock "cinder-quobyte-f094d87d-a843-4e27-9b7b-a9b25f4c3c2e" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:19 devstack cinder-volume[88568]: DEBUG cinder.coordination [req-278db88b-d519-4c9f-82ef-bfcf19474d03 req-c8187ea3-3e11-4632-adc1-624c697565b3 tempest-VolumesGetTestJSON-1449774970 None] Lock "cinder-quobyte-f094d87d-a843-4e27-9b7b-a9b25f4c3c2e" acquired by "delete_volume" :: waited 0.021s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:19 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eea2428-ac4d-4c7a-b59c-e87684d609fc]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:19 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [req-278db88b-d519-4c9f-82ef-bfcf19474d03 req-c8187ea3-3e11-4632-adc1-624c697565b3 tempest-VolumesGetTestJSON-1449774970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f094d87d-a843-4e27-9b7b-a9b25f4c3c2e {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:19 devstack sudo[95057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f094d87d-a843-4e27-9b7b-a9b25f4c3c2e Jul 30 16:54:19 devstack sudo[95057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:19 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-dfd234d5-83d9-4b53-84d3-b049c4c2ab60 tempest-SnapshotsActionsTest-151668605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:19 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-dfd234d5-83d9-4b53-84d3-b049c4c2ab60 tempest-SnapshotsActionsTest-151668605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:19 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-dfd234d5-83d9-4b53-84d3-b049c4c2ab60 tempest-SnapshotsActionsTest-151668605 None] Creating offline snapshot 39c5fbac-e2c3-43ba-899e-359d14157d4e of volume 22763b2b-8aa4-4016-8896-91249c91d08e {{(pid=88568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:54:20 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[f310a490-1ec6-415f-98bb-e1741a2f0756]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-dfd234d5-83d9-4b53-84d3-b049c4c2ab60 tempest-SnapshotsActionsTest-151668605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.d24fa2ac-ce70-4dfc-b918-d137c25ef760 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:20 devstack sudo[95057]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [req-278db88b-d519-4c9f-82ef-bfcf19474d03 req-c8187ea3-3e11-4632-adc1-624c697565b3 tempest-VolumesGetTestJSON-1449774970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f094d87d-a843-4e27-9b7b-a9b25f4c3c2e" returned: 0 in 0.531s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [req-278db88b-d519-4c9f-82ef-bfcf19474d03 req-c8187ea3-3e11-4632-adc1-624c697565b3 tempest-VolumesGetTestJSON-1449774970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f094d87d-a843-4e27-9b7b-a9b25f4c3c2e {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:20 devstack sudo[95063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f094d87d-a843-4e27-9b7b-a9b25f4c3c2e Jul 30 16:54:20 devstack sudo[95063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:20 devstack sudo[95062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.d24fa2ac-ce70-4dfc-b918-d137c25ef760 Jul 30 16:54:20 devstack sudo[95062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:20 devstack sudo[95063]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [req-278db88b-d519-4c9f-82ef-bfcf19474d03 req-c8187ea3-3e11-4632-adc1-624c697565b3 tempest-VolumesGetTestJSON-1449774970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f094d87d-a843-4e27-9b7b-a9b25f4c3c2e" returned: 0 in 0.418s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:20 devstack cinder-volume[88568]: DEBUG cinder.coordination [req-278db88b-d519-4c9f-82ef-bfcf19474d03 req-c8187ea3-3e11-4632-adc1-624c697565b3 tempest-VolumesGetTestJSON-1449774970 None] Lock "cinder-quobyte-f094d87d-a843-4e27-9b7b-a9b25f4c3c2e" released by "delete_volume" :: held 1.011s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:20 devstack cinder-volume[88568]: DEBUG cinder.quota [req-278db88b-d519-4c9f-82ef-bfcf19474d03 req-c8187ea3-3e11-4632-adc1-624c697565b3 tempest-VolumesGetTestJSON-1449774970 None] Created reservations ['e3ced10b-20d9-4a9e-962d-ce447a3fbe2c', '47ec8ca0-973a-4d7c-b919-c102baa28d91', '28bf1b96-6c86-4e4c-868d-8595303c41bd', '8c04e710-d864-4ead-bdba-bc6fa0d16e85'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:54:20 devstack sudo[95062]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-dfd234d5-83d9-4b53-84d3-b049c4c2ab60 tempest-SnapshotsActionsTest-151668605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.d24fa2ac-ce70-4dfc-b918-d137c25ef760" returned: 0 in 0.606s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:20 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-dfd234d5-83d9-4b53-84d3-b049c4c2ab60 tempest-SnapshotsActionsTest-151668605 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22763b2b-8aa4-4016-8896-91249c91d08e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:54:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-dfd234d5-83d9-4b53-84d3-b049c4c2ab60 tempest-SnapshotsActionsTest-151668605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.d24fa2ac-ce70-4dfc-b918-d137c25ef760,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.39c5fbac-e2c3-43ba-899e-359d14157d4e 1G {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:20 devstack sudo[95073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.d24fa2ac-ce70-4dfc-b918-d137c25ef760,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.39c5fbac-e2c3-43ba-899e-359d14157d4e 1G Jul 30 16:54:20 devstack sudo[95073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-278db88b-d519-4c9f-82ef-bfcf19474d03 req-c8187ea3-3e11-4632-adc1-624c697565b3 tempest-VolumesGetTestJSON-1449774970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-278db88b-d519-4c9f-82ef-bfcf19474d03 req-c8187ea3-3e11-4632-adc1-624c697565b3 tempest-VolumesGetTestJSON-1449774970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:20 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [req-278db88b-d519-4c9f-82ef-bfcf19474d03 req-c8187ea3-3e11-4632-adc1-624c697565b3 tempest-VolumesGetTestJSON-1449774970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:20 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [req-278db88b-d519-4c9f-82ef-bfcf19474d03 req-c8187ea3-3e11-4632-adc1-624c697565b3 tempest-VolumesGetTestJSON-1449774970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-278db88b-d519-4c9f-82ef-bfcf19474d03 req-c8187ea3-3e11-4632-adc1-624c697565b3 tempest-VolumesGetTestJSON-1449774970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [req-278db88b-d519-4c9f-82ef-bfcf19474d03 req-c8187ea3-3e11-4632-adc1-624c697565b3 tempest-VolumesGetTestJSON-1449774970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:20 devstack sudo[95075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:54:20 devstack sudo[95075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:21 devstack sudo[95075]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:21 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [req-278db88b-d519-4c9f-82ef-bfcf19474d03 req-c8187ea3-3e11-4632-adc1-624c697565b3 tempest-VolumesGetTestJSON-1449774970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.341s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:21 devstack cinder-volume[88568]: DEBUG cinder.manager [req-278db88b-d519-4c9f-82ef-bfcf19474d03 req-c8187ea3-3e11-4632-adc1-624c697565b3 tempest-VolumesGetTestJSON-1449774970 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:54:21 devstack cinder-volume[88568]: INFO cinder.volume.manager [req-278db88b-d519-4c9f-82ef-bfcf19474d03 req-c8187ea3-3e11-4632-adc1-624c697565b3 tempest-VolumesGetTestJSON-1449774970 None] Deleted volume successfully. Jul 30 16:54:21 devstack cinder-volume[88568]: DEBUG cinder.coordination [req-278db88b-d519-4c9f-82ef-bfcf19474d03 req-c8187ea3-3e11-4632-adc1-624c697565b3 tempest-VolumesGetTestJSON-1449774970 None] Lock "cinder-f094d87d-a843-4e27-9b7b-a9b25f4c3c2e-delete_volume" released by "delete_volume" :: held 1.756s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:21 devstack sudo[95073]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:21 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-dfd234d5-83d9-4b53-84d3-b049c4c2ab60 tempest-SnapshotsActionsTest-151668605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.d24fa2ac-ce70-4dfc-b918-d137c25ef760,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.39c5fbac-e2c3-43ba-899e-359d14157d4e 1G" returned: 0 in 0.589s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:21 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-dfd234d5-83d9-4b53-84d3-b049c4c2ab60 tempest-SnapshotsActionsTest-151668605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22763b2b-8aa4-4016-8896-91249c91d08e.d24fa2ac-ce70-4dfc-b918-d137c25ef760 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.39c5fbac-e2c3-43ba-899e-359d14157d4e {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:21 devstack sudo[95083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22763b2b-8aa4-4016-8896-91249c91d08e.d24fa2ac-ce70-4dfc-b918-d137c25ef760 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.39c5fbac-e2c3-43ba-899e-359d14157d4e Jul 30 16:54:21 devstack sudo[95083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:21 devstack sudo[95083]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:21 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-dfd234d5-83d9-4b53-84d3-b049c4c2ab60 tempest-SnapshotsActionsTest-151668605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22763b2b-8aa4-4016-8896-91249c91d08e.d24fa2ac-ce70-4dfc-b918-d137c25ef760 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.39c5fbac-e2c3-43ba-899e-359d14157d4e" returned: 0 in 0.322s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:21 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-dfd234d5-83d9-4b53-84d3-b049c4c2ab60 tempest-SnapshotsActionsTest-151668605 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.39c5fbac-e2c3-43ba-899e-359d14157d4e is being set with open permissions: ugo+rw Jul 30 16:54:21 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-dfd234d5-83d9-4b53-84d3-b049c4c2ab60 tempest-SnapshotsActionsTest-151668605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.39c5fbac-e2c3-43ba-899e-359d14157d4e {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:21 devstack sudo[95096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.39c5fbac-e2c3-43ba-899e-359d14157d4e Jul 30 16:54:21 devstack sudo[95096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:21 devstack cinder-volume[88568]: INFO cinder.volume.manager [req-281edc78-f2ad-4efb-b70c-dfa92e43e5d9 req-e9231c04-ffbb-48b6-a855-a9cdf1f8a285 tempest-ServerActionsTestOtherA-332393488 None] Terminate volume connection completed successfully. Jul 30 16:54:21 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [req-281edc78-f2ad-4efb-b70c-dfa92e43e5d9 req-e9231c04-ffbb-48b6-a855-a9cdf1f8a285 tempest-ServerActionsTestOtherA-332393488 None] Deleting attachment fca79bce-eae4-4149-b3e5-bbc714e93926. {{(pid=88568) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 16:54:21 devstack sudo[95096]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:21 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-dfd234d5-83d9-4b53-84d3-b049c4c2ab60 tempest-SnapshotsActionsTest-151668605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.39c5fbac-e2c3-43ba-899e-359d14157d4e" returned: 0 in 0.377s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:21 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-dfd234d5-83d9-4b53-84d3-b049c4c2ab60 tempest-SnapshotsActionsTest-151668605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.027s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:22 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-dfd234d5-83d9-4b53-84d3-b049c4c2ab60 tempest-SnapshotsActionsTest-151668605 None] Create snapshot completed successfully Jul 30 16:54:22 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-281edc78-f2ad-4efb-b70c-dfa92e43e5d9 req-1cb00be9-25a3-4cd1-9ef3-32d7c819faa8 tempest-ServerActionsTestOtherA-332393488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:22 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-281edc78-f2ad-4efb-b70c-dfa92e43e5d9 req-1cb00be9-25a3-4cd1-9ef3-32d7c819faa8 tempest-ServerActionsTestOtherA-332393488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:22 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-281edc78-f2ad-4efb-b70c-dfa92e43e5d9 req-1cb00be9-25a3-4cd1-9ef3-32d7c819faa8 tempest-ServerActionsTestOtherA-332393488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:22 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [req-281edc78-f2ad-4efb-b70c-dfa92e43e5d9 req-1cb00be9-25a3-4cd1-9ef3-32d7c819faa8 tempest-ServerActionsTestOtherA-332393488 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924', 'name': 'volume-60604682-ec4c-4fb2-937a-7cf43dbcc110', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8084b072-0f4c-493d-9328-76934dd2ebf1', 'enforce_multipath': True} {{(pid=88568) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 16:54:23 devstack cinder-volume[88568]: INFO cinder.volume.manager [req-281edc78-f2ad-4efb-b70c-dfa92e43e5d9 req-1cb00be9-25a3-4cd1-9ef3-32d7c819faa8 tempest-ServerActionsTestOtherA-332393488 None] attachment_update completed successfully. Jul 30 16:54:23 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-80d634da-4378-45bc-bc4f-42ac0c41f360 tempest-SnapshotsActionsTest-350789574 None] Acquiring lock "cinder-39c5fbac-e2c3-43ba-899e-359d14157d4e-delete_snapshot" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:23 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-80d634da-4378-45bc-bc4f-42ac0c41f360 tempest-SnapshotsActionsTest-350789574 None] Lock "cinder-39c5fbac-e2c3-43ba-899e-359d14157d4e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:23 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-80d634da-4378-45bc-bc4f-42ac0c41f360 tempest-SnapshotsActionsTest-350789574 None] Acquiring lock "cinder-quobyte-22763b2b-8aa4-4016-8896-91249c91d08e" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:23 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-80d634da-4378-45bc-bc4f-42ac0c41f360 tempest-SnapshotsActionsTest-350789574 None] Lock "cinder-quobyte-22763b2b-8aa4-4016-8896-91249c91d08e" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:23 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-80d634da-4378-45bc-bc4f-42ac0c41f360 tempest-SnapshotsActionsTest-350789574 None] Acquiring lock "cinder-quobyte-39c5fbac-e2c3-43ba-899e-359d14157d4e" by "_delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:23 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-80d634da-4378-45bc-bc4f-42ac0c41f360 tempest-SnapshotsActionsTest-350789574 None] Lock "cinder-quobyte-39c5fbac-e2c3-43ba-899e-359d14157d4e" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:23 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-80d634da-4378-45bc-bc4f-42ac0c41f360 tempest-SnapshotsActionsTest-350789574 None] Deleting offline snapshot 39c5fbac-e2c3-43ba-899e-359d14157d4e of volume 22763b2b-8aa4-4016-8896-91249c91d08e {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:54:23 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-80d634da-4378-45bc-bc4f-42ac0c41f360 tempest-SnapshotsActionsTest-350789574 None] snapshot_file for this snap is: volume-22763b2b-8aa4-4016-8896-91249c91d08e.39c5fbac-e2c3-43ba-899e-359d14157d4e {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:54:23 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f39c83-3bdd-48fb-959b-e39acff9ce18]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:23 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-80d634da-4378-45bc-bc4f-42ac0c41f360 tempest-SnapshotsActionsTest-350789574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.39c5fbac-e2c3-43ba-899e-359d14157d4e {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:23 devstack sudo[95153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.39c5fbac-e2c3-43ba-899e-359d14157d4e Jul 30 16:54:23 devstack sudo[95153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:24 devstack sudo[95153]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-80d634da-4378-45bc-bc4f-42ac0c41f360 tempest-SnapshotsActionsTest-350789574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.39c5fbac-e2c3-43ba-899e-359d14157d4e" returned: 0 in 0.669s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:24 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-80d634da-4378-45bc-bc4f-42ac0c41f360 tempest-SnapshotsActionsTest-350789574 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22763b2b-8aa4-4016-8896-91249c91d08e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:54:24 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[27542076-2dba-4b87-82f6-5ec117f0b2be]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-80d634da-4378-45bc-bc4f-42ac0c41f360 tempest-SnapshotsActionsTest-350789574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.d24fa2ac-ce70-4dfc-b918-d137c25ef760 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:24 devstack sudo[95170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.d24fa2ac-ce70-4dfc-b918-d137c25ef760 Jul 30 16:54:24 devstack sudo[95170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:24 devstack sudo[95170]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-80d634da-4378-45bc-bc4f-42ac0c41f360 tempest-SnapshotsActionsTest-350789574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.d24fa2ac-ce70-4dfc-b918-d137c25ef760" returned: 0 in 0.603s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:24 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-80d634da-4378-45bc-bc4f-42ac0c41f360 tempest-SnapshotsActionsTest-350789574 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22763b2b-8aa4-4016-8896-91249c91d08e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:54:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-80d634da-4378-45bc-bc4f-42ac0c41f360 tempest-SnapshotsActionsTest-350789574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.39c5fbac-e2c3-43ba-899e-359d14157d4e {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:24 devstack sudo[95247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.39c5fbac-e2c3-43ba-899e-359d14157d4e Jul 30 16:54:24 devstack sudo[95247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:25 devstack sudo[95247]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:25 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-80d634da-4378-45bc-bc4f-42ac0c41f360 tempest-SnapshotsActionsTest-350789574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.39c5fbac-e2c3-43ba-899e-359d14157d4e" returned: 0 in 0.900s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:25 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-80d634da-4378-45bc-bc4f-42ac0c41f360 tempest-SnapshotsActionsTest-350789574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.39c5fbac-e2c3-43ba-899e-359d14157d4e {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:25 devstack sudo[95589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.39c5fbac-e2c3-43ba-899e-359d14157d4e Jul 30 16:54:25 devstack sudo[95589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:26 devstack sudo[95589]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-80d634da-4378-45bc-bc4f-42ac0c41f360 tempest-SnapshotsActionsTest-350789574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.39c5fbac-e2c3-43ba-899e-359d14157d4e" returned: 0 in 0.432s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:26 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-80d634da-4378-45bc-bc4f-42ac0c41f360 tempest-SnapshotsActionsTest-350789574 None] Lock "cinder-quobyte-39c5fbac-e2c3-43ba-899e-359d14157d4e" released by "_delete_snapshot" :: held 2.797s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:26 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-80d634da-4378-45bc-bc4f-42ac0c41f360 tempest-SnapshotsActionsTest-350789574 None] Lock "cinder-quobyte-22763b2b-8aa4-4016-8896-91249c91d08e" released by "delete_snapshot" :: held 2.831s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:26 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-80d634da-4378-45bc-bc4f-42ac0c41f360 tempest-SnapshotsActionsTest-350789574 None] Created reservations ['517aedf6-e36f-4440-9106-ec1e3a0c9cc7', 'd494a1db-fece-42e4-a5f6-eb81ae7fd379', '1072a1cf-f802-41fa-b5af-4d4b78f922af', '25f2fc85-5ddc-49f5-be87-8406dc72b853'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:54:26 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-80d634da-4378-45bc-bc4f-42ac0c41f360 tempest-SnapshotsActionsTest-350789574 None] Delete snapshot completed successfully. Jul 30 16:54:26 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-80d634da-4378-45bc-bc4f-42ac0c41f360 tempest-SnapshotsActionsTest-350789574 None] Lock "cinder-39c5fbac-e2c3-43ba-899e-359d14157d4e-delete_snapshot" released by "delete_snapshot" :: held 3.121s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:27 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-6a4ff29f-5bd0-4382-8d21-5f3b2710600f tempest-SnapshotsActionsTest-151668605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:27 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-6a4ff29f-5bd0-4382-8d21-5f3b2710600f tempest-SnapshotsActionsTest-151668605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:27 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-6a4ff29f-5bd0-4382-8d21-5f3b2710600f tempest-SnapshotsActionsTest-151668605 None] Creating offline snapshot 966fb2cb-d7b8-43c9-be82-72f8eac31e9c of volume 22763b2b-8aa4-4016-8896-91249c91d08e {{(pid=88568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:54:27 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b7bd8b1-0e69-4507-9eed-d37ac8df1a97]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:27 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-6a4ff29f-5bd0-4382-8d21-5f3b2710600f tempest-SnapshotsActionsTest-151668605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.d24fa2ac-ce70-4dfc-b918-d137c25ef760 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:27 devstack sudo[95622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.d24fa2ac-ce70-4dfc-b918-d137c25ef760 Jul 30 16:54:27 devstack sudo[95622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:27 devstack sudo[95622]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:27 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-6a4ff29f-5bd0-4382-8d21-5f3b2710600f tempest-SnapshotsActionsTest-151668605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.d24fa2ac-ce70-4dfc-b918-d137c25ef760" returned: 0 in 0.453s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:27 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-6a4ff29f-5bd0-4382-8d21-5f3b2710600f tempest-SnapshotsActionsTest-151668605 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22763b2b-8aa4-4016-8896-91249c91d08e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:54:27 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-6a4ff29f-5bd0-4382-8d21-5f3b2710600f tempest-SnapshotsActionsTest-151668605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.d24fa2ac-ce70-4dfc-b918-d137c25ef760,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.966fb2cb-d7b8-43c9-be82-72f8eac31e9c 1G {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:27 devstack sudo[95627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.d24fa2ac-ce70-4dfc-b918-d137c25ef760,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.966fb2cb-d7b8-43c9-be82-72f8eac31e9c 1G Jul 30 16:54:27 devstack sudo[95627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:28 devstack sudo[95627]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-6a4ff29f-5bd0-4382-8d21-5f3b2710600f tempest-SnapshotsActionsTest-151668605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.d24fa2ac-ce70-4dfc-b918-d137c25ef760,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.966fb2cb-d7b8-43c9-be82-72f8eac31e9c 1G" returned: 0 in 0.883s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-6a4ff29f-5bd0-4382-8d21-5f3b2710600f tempest-SnapshotsActionsTest-151668605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22763b2b-8aa4-4016-8896-91249c91d08e.d24fa2ac-ce70-4dfc-b918-d137c25ef760 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.966fb2cb-d7b8-43c9-be82-72f8eac31e9c {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:28 devstack sudo[95636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22763b2b-8aa4-4016-8896-91249c91d08e.d24fa2ac-ce70-4dfc-b918-d137c25ef760 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.966fb2cb-d7b8-43c9-be82-72f8eac31e9c Jul 30 16:54:28 devstack sudo[95636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:29 devstack sudo[95636]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-6a4ff29f-5bd0-4382-8d21-5f3b2710600f tempest-SnapshotsActionsTest-151668605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22763b2b-8aa4-4016-8896-91249c91d08e.d24fa2ac-ce70-4dfc-b918-d137c25ef760 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.966fb2cb-d7b8-43c9-be82-72f8eac31e9c" returned: 0 in 0.497s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:29 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-6a4ff29f-5bd0-4382-8d21-5f3b2710600f tempest-SnapshotsActionsTest-151668605 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.966fb2cb-d7b8-43c9-be82-72f8eac31e9c is being set with open permissions: ugo+rw Jul 30 16:54:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-6a4ff29f-5bd0-4382-8d21-5f3b2710600f tempest-SnapshotsActionsTest-151668605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.966fb2cb-d7b8-43c9-be82-72f8eac31e9c {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:29 devstack sudo[95646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.966fb2cb-d7b8-43c9-be82-72f8eac31e9c Jul 30 16:54:29 devstack sudo[95646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:29 devstack sudo[95646]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-6a4ff29f-5bd0-4382-8d21-5f3b2710600f tempest-SnapshotsActionsTest-151668605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.966fb2cb-d7b8-43c9-be82-72f8eac31e9c" returned: 0 in 0.308s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-6a4ff29f-5bd0-4382-8d21-5f3b2710600f tempest-SnapshotsActionsTest-151668605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.279s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:29 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-6a4ff29f-5bd0-4382-8d21-5f3b2710600f tempest-SnapshotsActionsTest-151668605 None] Create snapshot completed successfully Jul 30 16:54:30 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-e7fb63a6-b1b9-4be1-bcc6-5331a9315b0e tempest-SnapshotsActionsTest-350789574 None] Acquiring lock "cinder-966fb2cb-d7b8-43c9-be82-72f8eac31e9c-delete_snapshot" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:30 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-e7fb63a6-b1b9-4be1-bcc6-5331a9315b0e tempest-SnapshotsActionsTest-350789574 None] Lock "cinder-966fb2cb-d7b8-43c9-be82-72f8eac31e9c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:30 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-e7fb63a6-b1b9-4be1-bcc6-5331a9315b0e tempest-SnapshotsActionsTest-350789574 None] Acquiring lock "cinder-quobyte-22763b2b-8aa4-4016-8896-91249c91d08e" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:30 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-e7fb63a6-b1b9-4be1-bcc6-5331a9315b0e tempest-SnapshotsActionsTest-350789574 None] Lock "cinder-quobyte-22763b2b-8aa4-4016-8896-91249c91d08e" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:30 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-e7fb63a6-b1b9-4be1-bcc6-5331a9315b0e tempest-SnapshotsActionsTest-350789574 None] Acquiring lock "cinder-quobyte-966fb2cb-d7b8-43c9-be82-72f8eac31e9c" by "_delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:30 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-e7fb63a6-b1b9-4be1-bcc6-5331a9315b0e tempest-SnapshotsActionsTest-350789574 None] Lock "cinder-quobyte-966fb2cb-d7b8-43c9-be82-72f8eac31e9c" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:30 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-e7fb63a6-b1b9-4be1-bcc6-5331a9315b0e tempest-SnapshotsActionsTest-350789574 None] Deleting offline snapshot 966fb2cb-d7b8-43c9-be82-72f8eac31e9c of volume 22763b2b-8aa4-4016-8896-91249c91d08e {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:54:30 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-e7fb63a6-b1b9-4be1-bcc6-5331a9315b0e tempest-SnapshotsActionsTest-350789574 None] snapshot_file for this snap is: volume-22763b2b-8aa4-4016-8896-91249c91d08e.966fb2cb-d7b8-43c9-be82-72f8eac31e9c {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:54:30 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[3419329e-3dd0-41ec-877e-9e5722df0f96]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:30 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e7fb63a6-b1b9-4be1-bcc6-5331a9315b0e tempest-SnapshotsActionsTest-350789574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.966fb2cb-d7b8-43c9-be82-72f8eac31e9c {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:31 devstack sudo[95688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.966fb2cb-d7b8-43c9-be82-72f8eac31e9c Jul 30 16:54:31 devstack sudo[95688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:31 devstack sudo[95688]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:31 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e7fb63a6-b1b9-4be1-bcc6-5331a9315b0e tempest-SnapshotsActionsTest-350789574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.966fb2cb-d7b8-43c9-be82-72f8eac31e9c" returned: 0 in 0.455s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:31 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-e7fb63a6-b1b9-4be1-bcc6-5331a9315b0e tempest-SnapshotsActionsTest-350789574 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22763b2b-8aa4-4016-8896-91249c91d08e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:54:31 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ae369f-1e54-40ca-b93c-630ae2d14ff5]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:31 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e7fb63a6-b1b9-4be1-bcc6-5331a9315b0e tempest-SnapshotsActionsTest-350789574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.d24fa2ac-ce70-4dfc-b918-d137c25ef760 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:31 devstack sudo[95693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.d24fa2ac-ce70-4dfc-b918-d137c25ef760 Jul 30 16:54:31 devstack sudo[95693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:31 devstack sudo[95693]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:31 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e7fb63a6-b1b9-4be1-bcc6-5331a9315b0e tempest-SnapshotsActionsTest-350789574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.d24fa2ac-ce70-4dfc-b918-d137c25ef760" returned: 0 in 0.459s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:31 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-e7fb63a6-b1b9-4be1-bcc6-5331a9315b0e tempest-SnapshotsActionsTest-350789574 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22763b2b-8aa4-4016-8896-91249c91d08e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:54:31 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e7fb63a6-b1b9-4be1-bcc6-5331a9315b0e tempest-SnapshotsActionsTest-350789574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.966fb2cb-d7b8-43c9-be82-72f8eac31e9c {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:31 devstack sudo[95698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.966fb2cb-d7b8-43c9-be82-72f8eac31e9c Jul 30 16:54:31 devstack sudo[95698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:32 devstack sudo[95698]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:32 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e7fb63a6-b1b9-4be1-bcc6-5331a9315b0e tempest-SnapshotsActionsTest-350789574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.966fb2cb-d7b8-43c9-be82-72f8eac31e9c" returned: 0 in 0.402s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:32 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e7fb63a6-b1b9-4be1-bcc6-5331a9315b0e tempest-SnapshotsActionsTest-350789574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.966fb2cb-d7b8-43c9-be82-72f8eac31e9c {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:32 devstack sudo[95703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.966fb2cb-d7b8-43c9-be82-72f8eac31e9c Jul 30 16:54:32 devstack sudo[95703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:32 devstack sudo[95703]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:32 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e7fb63a6-b1b9-4be1-bcc6-5331a9315b0e tempest-SnapshotsActionsTest-350789574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.966fb2cb-d7b8-43c9-be82-72f8eac31e9c" returned: 0 in 0.266s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:32 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-e7fb63a6-b1b9-4be1-bcc6-5331a9315b0e tempest-SnapshotsActionsTest-350789574 None] Lock "cinder-quobyte-966fb2cb-d7b8-43c9-be82-72f8eac31e9c" released by "_delete_snapshot" :: held 1.768s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:32 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-e7fb63a6-b1b9-4be1-bcc6-5331a9315b0e tempest-SnapshotsActionsTest-350789574 None] Lock "cinder-quobyte-22763b2b-8aa4-4016-8896-91249c91d08e" released by "delete_snapshot" :: held 1.808s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:32 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-e7fb63a6-b1b9-4be1-bcc6-5331a9315b0e tempest-SnapshotsActionsTest-350789574 None] Created reservations ['5eb5e728-117a-47a6-b864-c34db6268859', 'dc2ac3c1-9e94-4ee9-a760-7c376cc90fa8', '2968ea4f-11d0-47c6-ab7e-13ae21629ccb', '1d605315-72bb-4d7a-878b-47d1dc4771cc'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:54:32 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-e7fb63a6-b1b9-4be1-bcc6-5331a9315b0e tempest-SnapshotsActionsTest-350789574 None] Delete snapshot completed successfully. Jul 30 16:54:32 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-e7fb63a6-b1b9-4be1-bcc6-5331a9315b0e tempest-SnapshotsActionsTest-350789574 None] Lock "cinder-966fb2cb-d7b8-43c9-be82-72f8eac31e9c-delete_snapshot" released by "delete_snapshot" :: held 1.992s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:33 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-7be29168-7211-459b-a4e4-e9479e396c03 tempest-SnapshotsActionsTest-151668605 None] Acquiring lock "cinder-d24fa2ac-ce70-4dfc-b918-d137c25ef760-delete_snapshot" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:33 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-7be29168-7211-459b-a4e4-e9479e396c03 tempest-SnapshotsActionsTest-151668605 None] Lock "cinder-d24fa2ac-ce70-4dfc-b918-d137c25ef760-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:33 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-7be29168-7211-459b-a4e4-e9479e396c03 tempest-SnapshotsActionsTest-151668605 None] Acquiring lock "cinder-quobyte-22763b2b-8aa4-4016-8896-91249c91d08e" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:33 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-7be29168-7211-459b-a4e4-e9479e396c03 tempest-SnapshotsActionsTest-151668605 None] Lock "cinder-quobyte-22763b2b-8aa4-4016-8896-91249c91d08e" acquired by "delete_snapshot" :: waited 0.035s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:33 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-7be29168-7211-459b-a4e4-e9479e396c03 tempest-SnapshotsActionsTest-151668605 None] Acquiring lock "cinder-quobyte-d24fa2ac-ce70-4dfc-b918-d137c25ef760" by "_delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:33 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-7be29168-7211-459b-a4e4-e9479e396c03 tempest-SnapshotsActionsTest-151668605 None] Lock "cinder-quobyte-d24fa2ac-ce70-4dfc-b918-d137c25ef760" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:33 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-7be29168-7211-459b-a4e4-e9479e396c03 tempest-SnapshotsActionsTest-151668605 None] Deleting offline snapshot d24fa2ac-ce70-4dfc-b918-d137c25ef760 of volume 22763b2b-8aa4-4016-8896-91249c91d08e {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:54:33 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-7be29168-7211-459b-a4e4-e9479e396c03 tempest-SnapshotsActionsTest-151668605 None] snapshot_file for this snap is: volume-22763b2b-8aa4-4016-8896-91249c91d08e.d24fa2ac-ce70-4dfc-b918-d137c25ef760 {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:54:33 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[73eb2ff3-d467-406b-8eb1-1d155a2c54b7]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:33 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7be29168-7211-459b-a4e4-e9479e396c03 tempest-SnapshotsActionsTest-151668605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.d24fa2ac-ce70-4dfc-b918-d137c25ef760 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:33 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-76aaa053-8b73-4f5c-bb75-3a13c0d3e0f6 tempest-GroupsTest-311468979 None] Group tempest-Group1-740288884: creating Jul 30 16:54:33 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-76aaa053-8b73-4f5c-bb75-3a13c0d3e0f6 tempest-GroupsTest-311468979 None] Group tempest-Group1-740288884: created successfully Jul 30 16:54:33 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-76aaa053-8b73-4f5c-bb75-3a13c0d3e0f6 tempest-GroupsTest-311468979 None] Create group completed successfully. Jul 30 16:54:33 devstack sudo[95720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.d24fa2ac-ce70-4dfc-b918-d137c25ef760 Jul 30 16:54:33 devstack sudo[95720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:33 devstack sudo[95720]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:33 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7be29168-7211-459b-a4e4-e9479e396c03 tempest-SnapshotsActionsTest-151668605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.d24fa2ac-ce70-4dfc-b918-d137c25ef760" returned: 0 in 0.387s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:33 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-7be29168-7211-459b-a4e4-e9479e396c03 tempest-SnapshotsActionsTest-151668605 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22763b2b-8aa4-4016-8896-91249c91d08e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:54:33 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cfe5270-fac4-4985-b0e6-892431de6ec2]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:33 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7be29168-7211-459b-a4e4-e9479e396c03 tempest-SnapshotsActionsTest-151668605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:34 devstack sudo[95725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e Jul 30 16:54:34 devstack sudo[95725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:34 devstack sudo[95725]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:34 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7be29168-7211-459b-a4e4-e9479e396c03 tempest-SnapshotsActionsTest-151668605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e" returned: 0 in 0.374s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:34 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7be29168-7211-459b-a4e4-e9479e396c03 tempest-SnapshotsActionsTest-151668605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.d24fa2ac-ce70-4dfc-b918-d137c25ef760 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:34 devstack sudo[95731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.d24fa2ac-ce70-4dfc-b918-d137c25ef760 Jul 30 16:54:34 devstack sudo[95731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:34 devstack sudo[95731]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:34 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7be29168-7211-459b-a4e4-e9479e396c03 tempest-SnapshotsActionsTest-151668605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.d24fa2ac-ce70-4dfc-b918-d137c25ef760" returned: 0 in 0.395s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:34 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7be29168-7211-459b-a4e4-e9479e396c03 tempest-SnapshotsActionsTest-151668605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.d24fa2ac-ce70-4dfc-b918-d137c25ef760 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:34 devstack sudo[95736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.d24fa2ac-ce70-4dfc-b918-d137c25ef760 Jul 30 16:54:34 devstack sudo[95736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:34 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-eab7da2a-9e77-49a2-aad1-9ec59730c7cd tempest-GroupsTest-311468979 None] Group tempest-Group2-1536386158: creating Jul 30 16:54:34 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-eab7da2a-9e77-49a2-aad1-9ec59730c7cd tempest-GroupsTest-311468979 None] Group tempest-Group2-1536386158: created successfully Jul 30 16:54:34 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-eab7da2a-9e77-49a2-aad1-9ec59730c7cd tempest-GroupsTest-311468979 None] Create group completed successfully. Jul 30 16:54:35 devstack sudo[95736]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7be29168-7211-459b-a4e4-e9479e396c03 tempest-SnapshotsActionsTest-151668605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e.d24fa2ac-ce70-4dfc-b918-d137c25ef760" returned: 0 in 0.268s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:35 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-7be29168-7211-459b-a4e4-e9479e396c03 tempest-SnapshotsActionsTest-151668605 None] Lock "cinder-quobyte-d24fa2ac-ce70-4dfc-b918-d137c25ef760" released by "_delete_snapshot" :: held 1.555s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:35 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-7be29168-7211-459b-a4e4-e9479e396c03 tempest-SnapshotsActionsTest-151668605 None] Lock "cinder-quobyte-22763b2b-8aa4-4016-8896-91249c91d08e" released by "delete_snapshot" :: held 1.592s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:35 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-7be29168-7211-459b-a4e4-e9479e396c03 tempest-SnapshotsActionsTest-151668605 None] Created reservations ['0f083e8d-6653-4493-8609-4657ccd17d95', 'b67c6d47-37f3-41d9-8bcb-1adbe0a8b1d7', '1caaeb92-7290-41e7-a5c3-be76f076595a', '6808a9b3-394a-49bf-952c-b8b63be9575e'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:54:35 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-7be29168-7211-459b-a4e4-e9479e396c03 tempest-SnapshotsActionsTest-151668605 None] Delete snapshot completed successfully. Jul 30 16:54:35 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-7be29168-7211-459b-a4e4-e9479e396c03 tempest-SnapshotsActionsTest-151668605 None] Lock "cinder-d24fa2ac-ce70-4dfc-b918-d137c25ef760-delete_snapshot" released by "delete_snapshot" :: held 1.755s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:35 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-aa832374-96ed-442f-b75c-f0551ff7d5f4 tempest-SnapshotsActionsTest-151668605 None] Acquiring lock "cinder-22763b2b-8aa4-4016-8896-91249c91d08e-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:35 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-aa832374-96ed-442f-b75c-f0551ff7d5f4 tempest-SnapshotsActionsTest-151668605 None] Lock "cinder-22763b2b-8aa4-4016-8896-91249c91d08e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:35 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-aa832374-96ed-442f-b75c-f0551ff7d5f4 tempest-SnapshotsActionsTest-151668605 None] Acquiring lock "cinder-quobyte-22763b2b-8aa4-4016-8896-91249c91d08e" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:35 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-aa832374-96ed-442f-b75c-f0551ff7d5f4 tempest-SnapshotsActionsTest-151668605 None] Lock "cinder-quobyte-22763b2b-8aa4-4016-8896-91249c91d08e" acquired by "delete_volume" :: waited 0.017s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:35 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca84b22f-ce6d-4d3b-b30c-682b97f000f0]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-aa832374-96ed-442f-b75c-f0551ff7d5f4 tempest-SnapshotsActionsTest-151668605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:35 devstack sudo[95739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e Jul 30 16:54:35 devstack sudo[95739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:36 devstack sudo[95739]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-aa832374-96ed-442f-b75c-f0551ff7d5f4 tempest-SnapshotsActionsTest-151668605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e" returned: 0 in 0.424s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-aa832374-96ed-442f-b75c-f0551ff7d5f4 tempest-SnapshotsActionsTest-151668605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:36 devstack sudo[95744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e Jul 30 16:54:36 devstack sudo[95744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:36 devstack sudo[95744]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-aa832374-96ed-442f-b75c-f0551ff7d5f4 tempest-SnapshotsActionsTest-151668605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-22763b2b-8aa4-4016-8896-91249c91d08e" returned: 0 in 0.288s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:36 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-aa832374-96ed-442f-b75c-f0551ff7d5f4 tempest-SnapshotsActionsTest-151668605 None] Lock "cinder-quobyte-22763b2b-8aa4-4016-8896-91249c91d08e" released by "delete_volume" :: held 0.776s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:36 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-aa832374-96ed-442f-b75c-f0551ff7d5f4 tempest-SnapshotsActionsTest-151668605 None] Created reservations ['85f234a9-28fc-4bc1-92d3-ffeec5530663', 'ede49a1c-dd24-4fe0-92e0-a83248bb6757', '162336ba-0755-439e-a7a8-86b70935439c', 'c880dec2-8ff8-4946-bc35-f06992c33a11'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:54:36 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-3633cfed-a003-48ca-9e9a-e3a585dda102 tempest-GroupsTest-311468979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:54:36 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-3633cfed-a003-48ca-9e9a-e3a585dda102 tempest-GroupsTest-311468979 None] Flow 'volume_create_manager' (d7519c6a-affd-426f-9b4a-88a0732fcc25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:54:36 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-3633cfed-a003-48ca-9e9a-e3a585dda102 tempest-GroupsTest-311468979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3e5f109-699c-4e9a-94b0-9d9debf6fca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:36 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-3633cfed-a003-48ca-9e9a-e3a585dda102 tempest-GroupsTest-311468979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3e5f109-699c-4e9a-94b0-9d9debf6fca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:54:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1350140446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=495aa890-8e17-46c9-aac4-d64d0599527f,host='devstack@QuobyteHD#QuobyteHD',id=e4d4671c-3cf4-47b1-82da-532a47101b98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f41415d5b5c54c12bf01577887db22f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:54:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:54:37Z,use_quota=True,user_id='8533631967054e31ac77b2ca6d25e1a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dffeb128-6516-4864-b3ac-38448dc07dbb),volume_type_id=dffeb128-6516-4864-b3ac-38448dc07dbb)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:36 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-3633cfed-a003-48ca-9e9a-e3a585dda102 tempest-GroupsTest-311468979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (290d5c93-a155-4e86-86ae-cafddec095e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:36 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-3633cfed-a003-48ca-9e9a-e3a585dda102 tempest-GroupsTest-311468979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (290d5c93-a155-4e86-86ae-cafddec095e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:36 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-3633cfed-a003-48ca-9e9a-e3a585dda102 tempest-GroupsTest-311468979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec5b86e6-0e22-4956-ad30-550e6a5b10db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:36 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-3633cfed-a003-48ca-9e9a-e3a585dda102 tempest-GroupsTest-311468979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec5b86e6-0e22-4956-ad30-550e6a5b10db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4d4671c-3cf4-47b1-82da-532a47101b98', 'volume_name': 'volume-e4d4671c-3cf4-47b1-82da-532a47101b98', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:36 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-3633cfed-a003-48ca-9e9a-e3a585dda102 tempest-GroupsTest-311468979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a3142a4-d168-44c7-b40f-1d609e3b38b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:36 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-3633cfed-a003-48ca-9e9a-e3a585dda102 tempest-GroupsTest-311468979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a3142a4-d168-44c7-b40f-1d609e3b38b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:36 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-3633cfed-a003-48ca-9e9a-e3a585dda102 tempest-GroupsTest-311468979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04d71681-7031-4aec-995c-4c0d84bbfedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:36 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-3633cfed-a003-48ca-9e9a-e3a585dda102 tempest-GroupsTest-311468979 None] Volume e4d4671c-3cf4-47b1-82da-532a47101b98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4d4671c-3cf4-47b1-82da-532a47101b98', 'volume_size': 1} Jul 30 16:54:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-3633cfed-a003-48ca-9e9a-e3a585dda102 tempest-GroupsTest-311468979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-3633cfed-a003-48ca-9e9a-e3a585dda102 tempest-GroupsTest-311468979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:36 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-3633cfed-a003-48ca-9e9a-e3a585dda102 tempest-GroupsTest-311468979 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=495aa890-8e17-46c9-aac4-d64d0599527f,created_at=2026-07-30T14:54:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1350140446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=495aa890-8e17-46c9-aac4-d64d0599527f,host='devstack@QuobyteHD#QuobyteHD',id=e4d4671c-3cf4-47b1-82da-532a47101b98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f41415d5b5c54c12bf01577887db22f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:54:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:54:37Z,use_quota=True,user_id='8533631967054e31ac77b2ca6d25e1a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dffeb128-6516-4864-b3ac-38448dc07dbb),volume_type_id=dffeb128-6516-4864-b3ac-38448dc07dbb)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:54:36 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-3633cfed-a003-48ca-9e9a-e3a585dda102 tempest-GroupsTest-311468979 None] Creating volume e4d4671c-3cf4-47b1-82da-532a47101b98 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:54:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-3633cfed-a003-48ca-9e9a-e3a585dda102 tempest-GroupsTest-311468979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-3633cfed-a003-48ca-9e9a-e3a585dda102 tempest-GroupsTest-311468979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:36 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-3633cfed-a003-48ca-9e9a-e3a585dda102 tempest-GroupsTest-311468979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:36 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-3633cfed-a003-48ca-9e9a-e3a585dda102 tempest-GroupsTest-311468979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-3633cfed-a003-48ca-9e9a-e3a585dda102 tempest-GroupsTest-311468979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:36 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-3633cfed-a003-48ca-9e9a-e3a585dda102 tempest-GroupsTest-311468979 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:54:36 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-3633cfed-a003-48ca-9e9a-e3a585dda102 tempest-GroupsTest-311468979 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 16:54:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-3633cfed-a003-48ca-9e9a-e3a585dda102 tempest-GroupsTest-311468979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e4d4671c-3cf4-47b1-82da-532a47101b98 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:36 devstack sudo[95747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e4d4671c-3cf4-47b1-82da-532a47101b98 1073741824 Jul 30 16:54:36 devstack sudo[95747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-aa832374-96ed-442f-b75c-f0551ff7d5f4 tempest-SnapshotsActionsTest-151668605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-aa832374-96ed-442f-b75c-f0551ff7d5f4 tempest-SnapshotsActionsTest-151668605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:36 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-aa832374-96ed-442f-b75c-f0551ff7d5f4 tempest-SnapshotsActionsTest-151668605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:36 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-aa832374-96ed-442f-b75c-f0551ff7d5f4 tempest-SnapshotsActionsTest-151668605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-aa832374-96ed-442f-b75c-f0551ff7d5f4 tempest-SnapshotsActionsTest-151668605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-aa832374-96ed-442f-b75c-f0551ff7d5f4 tempest-SnapshotsActionsTest-151668605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:36 devstack sudo[95749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:54:36 devstack sudo[95749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:37 devstack sudo[95749]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:37 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-aa832374-96ed-442f-b75c-f0551ff7d5f4 tempest-SnapshotsActionsTest-151668605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.415s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:37 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-aa832374-96ed-442f-b75c-f0551ff7d5f4 tempest-SnapshotsActionsTest-151668605 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:54:37 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-aa832374-96ed-442f-b75c-f0551ff7d5f4 tempest-SnapshotsActionsTest-151668605 None] Deleted volume successfully. Jul 30 16:54:37 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-aa832374-96ed-442f-b75c-f0551ff7d5f4 tempest-SnapshotsActionsTest-151668605 None] Lock "cinder-22763b2b-8aa4-4016-8896-91249c91d08e-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:37 devstack sudo[95747]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:37 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-3633cfed-a003-48ca-9e9a-e3a585dda102 tempest-GroupsTest-311468979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e4d4671c-3cf4-47b1-82da-532a47101b98 1073741824" returned: 0 in 0.792s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:37 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-3633cfed-a003-48ca-9e9a-e3a585dda102 tempest-GroupsTest-311468979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e4d4671c-3cf4-47b1-82da-532a47101b98 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:37 devstack sudo[95756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e4d4671c-3cf4-47b1-82da-532a47101b98 Jul 30 16:54:37 devstack sudo[95756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:38 devstack sudo[95756]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:38 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-3633cfed-a003-48ca-9e9a-e3a585dda102 tempest-GroupsTest-311468979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e4d4671c-3cf4-47b1-82da-532a47101b98" returned: 0 in 0.424s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:38 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-3633cfed-a003-48ca-9e9a-e3a585dda102 tempest-GroupsTest-311468979 None] <== create_volume: return (1283ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:54:38 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-3633cfed-a003-48ca-9e9a-e3a585dda102 tempest-GroupsTest-311468979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.287s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:38 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-3633cfed-a003-48ca-9e9a-e3a585dda102 tempest-GroupsTest-311468979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04d71681-7031-4aec-995c-4c0d84bbfedd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4d4671c-3cf4-47b1-82da-532a47101b98', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:38 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-3633cfed-a003-48ca-9e9a-e3a585dda102 tempest-GroupsTest-311468979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83a88711-66e5-4987-9800-4fd09389e871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:38 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-3633cfed-a003-48ca-9e9a-e3a585dda102 tempest-GroupsTest-311468979 None] Volume volume-e4d4671c-3cf4-47b1-82da-532a47101b98 (e4d4671c-3cf4-47b1-82da-532a47101b98): created successfully Jul 30 16:54:38 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-3633cfed-a003-48ca-9e9a-e3a585dda102 tempest-GroupsTest-311468979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83a88711-66e5-4987-9800-4fd09389e871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:38 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-3633cfed-a003-48ca-9e9a-e3a585dda102 tempest-GroupsTest-311468979 None] Flow 'volume_create_manager' (d7519c6a-affd-426f-9b4a-88a0732fcc25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:54:38 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-3633cfed-a003-48ca-9e9a-e3a585dda102 tempest-GroupsTest-311468979 None] Created volume successfully. Jul 30 16:54:40 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-5e1941e5-6c2a-4f0d-86c2-b004ac35e3e6 tempest-GroupsTest-311468979 None] Acquiring lock "cinder-quobyte-e4d4671c-3cf4-47b1-82da-532a47101b98" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:40 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-5e1941e5-6c2a-4f0d-86c2-b004ac35e3e6 tempest-GroupsTest-311468979 None] Lock "cinder-quobyte-e4d4671c-3cf4-47b1-82da-532a47101b98" acquired by "delete_volume" :: waited 0.037s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:40 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[e67dd087-80c0-47c3-9ffe-3fa6a49c93ca]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:40 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-5e1941e5-6c2a-4f0d-86c2-b004ac35e3e6 tempest-GroupsTest-311468979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e4d4671c-3cf4-47b1-82da-532a47101b98 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:40 devstack sudo[95786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e4d4671c-3cf4-47b1-82da-532a47101b98 Jul 30 16:54:40 devstack sudo[95786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:41 devstack sudo[95786]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:41 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-5e1941e5-6c2a-4f0d-86c2-b004ac35e3e6 tempest-GroupsTest-311468979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e4d4671c-3cf4-47b1-82da-532a47101b98" returned: 0 in 0.682s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:41 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-5e1941e5-6c2a-4f0d-86c2-b004ac35e3e6 tempest-GroupsTest-311468979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e4d4671c-3cf4-47b1-82da-532a47101b98 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:41 devstack sudo[95830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e4d4671c-3cf4-47b1-82da-532a47101b98 Jul 30 16:54:41 devstack sudo[95830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:41 devstack sudo[95830]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:41 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-5e1941e5-6c2a-4f0d-86c2-b004ac35e3e6 tempest-GroupsTest-311468979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e4d4671c-3cf4-47b1-82da-532a47101b98" returned: 0 in 0.401s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:41 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-5e1941e5-6c2a-4f0d-86c2-b004ac35e3e6 tempest-GroupsTest-311468979 None] Lock "cinder-quobyte-e4d4671c-3cf4-47b1-82da-532a47101b98" released by "delete_volume" :: held 1.186s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:41 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-5e1941e5-6c2a-4f0d-86c2-b004ac35e3e6 tempest-GroupsTest-311468979 None] Created reservations ['8f1535c5-3be5-4c12-9e42-fc30d07c80ab'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:54:41 devstack cinder-volume[88568]: WARNING cinder.quota [None req-5e1941e5-6c2a-4f0d-86c2-b004ac35e3e6 tempest-GroupsTest-311468979 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2023049006 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2023049006, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:54:41 devstack cinder-volume[88568]: WARNING cinder.quota [None req-5e1941e5-6c2a-4f0d-86c2-b004ac35e3e6 tempest-GroupsTest-311468979 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2023049006 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2023049006, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:54:42 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-5e1941e5-6c2a-4f0d-86c2-b004ac35e3e6 tempest-GroupsTest-311468979 None] Created reservations ['565af7f4-aa1a-4ee9-9ac6-9d2a72b03cb2', '6085787e-9835-41d3-9ffe-8b0bfc52dd80', '029256bf-cb4e-443a-abcd-5de9da3d81f1', '8b490196-d8e2-4442-b5b9-b761e22c70e2'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:54:42 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-5e1941e5-6c2a-4f0d-86c2-b004ac35e3e6 tempest-GroupsTest-311468979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:42 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-5e1941e5-6c2a-4f0d-86c2-b004ac35e3e6 tempest-GroupsTest-311468979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:42 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-5e1941e5-6c2a-4f0d-86c2-b004ac35e3e6 tempest-GroupsTest-311468979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:42 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-5e1941e5-6c2a-4f0d-86c2-b004ac35e3e6 tempest-GroupsTest-311468979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:42 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-5e1941e5-6c2a-4f0d-86c2-b004ac35e3e6 tempest-GroupsTest-311468979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:42 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-5e1941e5-6c2a-4f0d-86c2-b004ac35e3e6 tempest-GroupsTest-311468979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:42 devstack sudo[95834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:54:42 devstack sudo[95834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:42 devstack sudo[95834]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:42 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-5e1941e5-6c2a-4f0d-86c2-b004ac35e3e6 tempest-GroupsTest-311468979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.324s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:42 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-5e1941e5-6c2a-4f0d-86c2-b004ac35e3e6 tempest-GroupsTest-311468979 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:54:42 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-5e1941e5-6c2a-4f0d-86c2-b004ac35e3e6 tempest-GroupsTest-311468979 None] Delete group completed successfully. Jul 30 16:54:43 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-1157ed75-19f1-4619-ade5-fd8d64155ce6 tempest-GroupsTest-311468979 None] Created reservations ['c73bd968-5375-442b-9b54-652c390d3e0d'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:54:43 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-1157ed75-19f1-4619-ade5-fd8d64155ce6 tempest-GroupsTest-311468979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:43 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-1157ed75-19f1-4619-ade5-fd8d64155ce6 tempest-GroupsTest-311468979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:43 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-1157ed75-19f1-4619-ade5-fd8d64155ce6 tempest-GroupsTest-311468979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:43 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-1157ed75-19f1-4619-ade5-fd8d64155ce6 tempest-GroupsTest-311468979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:43 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-1157ed75-19f1-4619-ade5-fd8d64155ce6 tempest-GroupsTest-311468979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:43 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-1157ed75-19f1-4619-ade5-fd8d64155ce6 tempest-GroupsTest-311468979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:43 devstack sudo[95838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:54:43 devstack sudo[95838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:43 devstack sudo[95838]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:43 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-1157ed75-19f1-4619-ade5-fd8d64155ce6 tempest-GroupsTest-311468979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.244s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:43 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-1157ed75-19f1-4619-ade5-fd8d64155ce6 tempest-GroupsTest-311468979 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:54:43 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-1157ed75-19f1-4619-ade5-fd8d64155ce6 tempest-GroupsTest-311468979 None] Delete group completed successfully. Jul 30 16:54:45 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-6cc9dad9-43a4-44ff-bc1e-a75decbca9cc tempest-GroupsTest-311468979 None] Group tempest-GroupsTest-Group-1863318343: creating Jul 30 16:54:45 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-59f5e573-dc25-4135-9a7d-f8622cc5b345 tempest-AttachVolumeShelveTestJSON-608644172 None] Acquiring lock "cinder-9e852a5a-0736-435c-b969-f892fda5bd95-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:45 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-59f5e573-dc25-4135-9a7d-f8622cc5b345 tempest-AttachVolumeShelveTestJSON-608644172 None] Lock "cinder-9e852a5a-0736-435c-b969-f892fda5bd95-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:45 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-6cc9dad9-43a4-44ff-bc1e-a75decbca9cc tempest-GroupsTest-311468979 None] Group tempest-GroupsTest-Group-1863318343: created successfully Jul 30 16:54:45 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-6cc9dad9-43a4-44ff-bc1e-a75decbca9cc tempest-GroupsTest-311468979 None] Create group completed successfully. Jul 30 16:54:45 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-59f5e573-dc25-4135-9a7d-f8622cc5b345 tempest-AttachVolumeShelveTestJSON-608644172 None] Acquiring lock "cinder-quobyte-9e852a5a-0736-435c-b969-f892fda5bd95" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:45 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-59f5e573-dc25-4135-9a7d-f8622cc5b345 tempest-AttachVolumeShelveTestJSON-608644172 None] Lock "cinder-quobyte-9e852a5a-0736-435c-b969-f892fda5bd95" acquired by "delete_volume" :: waited 0.015s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:45 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[debfe5a9-340c-478d-b2d7-6b947b1d02de]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:45 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-59f5e573-dc25-4135-9a7d-f8622cc5b345 tempest-AttachVolumeShelveTestJSON-608644172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9e852a5a-0736-435c-b969-f892fda5bd95 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:45 devstack sudo[95866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9e852a5a-0736-435c-b969-f892fda5bd95 Jul 30 16:54:45 devstack sudo[95866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:45 devstack sudo[95866]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:45 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-59f5e573-dc25-4135-9a7d-f8622cc5b345 tempest-AttachVolumeShelveTestJSON-608644172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9e852a5a-0736-435c-b969-f892fda5bd95" returned: 0 in 0.415s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:45 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-59f5e573-dc25-4135-9a7d-f8622cc5b345 tempest-AttachVolumeShelveTestJSON-608644172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9e852a5a-0736-435c-b969-f892fda5bd95 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:45 devstack sudo[95871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9e852a5a-0736-435c-b969-f892fda5bd95 Jul 30 16:54:45 devstack sudo[95871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:45 devstack sudo[95871]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:45 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-59f5e573-dc25-4135-9a7d-f8622cc5b345 tempest-AttachVolumeShelveTestJSON-608644172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9e852a5a-0736-435c-b969-f892fda5bd95" returned: 0 in 0.280s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:45 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-59f5e573-dc25-4135-9a7d-f8622cc5b345 tempest-AttachVolumeShelveTestJSON-608644172 None] Lock "cinder-quobyte-9e852a5a-0736-435c-b969-f892fda5bd95" released by "delete_volume" :: held 0.750s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:45 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-59f5e573-dc25-4135-9a7d-f8622cc5b345 tempest-AttachVolumeShelveTestJSON-608644172 None] Created reservations ['11b3f08f-5168-4fde-b2bf-8de7add747bf', '7d740164-fdfd-4806-b197-0e633f30590e', '52f163ff-9282-461a-9443-5590f40a2fbf', 'a26080b0-23a0-4a1f-b96a-18684696f005'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:54:46 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-59f5e573-dc25-4135-9a7d-f8622cc5b345 tempest-AttachVolumeShelveTestJSON-608644172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:46 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-59f5e573-dc25-4135-9a7d-f8622cc5b345 tempest-AttachVolumeShelveTestJSON-608644172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:46 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-59f5e573-dc25-4135-9a7d-f8622cc5b345 tempest-AttachVolumeShelveTestJSON-608644172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:46 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-59f5e573-dc25-4135-9a7d-f8622cc5b345 tempest-AttachVolumeShelveTestJSON-608644172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:46 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-59f5e573-dc25-4135-9a7d-f8622cc5b345 tempest-AttachVolumeShelveTestJSON-608644172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:46 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-59f5e573-dc25-4135-9a7d-f8622cc5b345 tempest-AttachVolumeShelveTestJSON-608644172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:46 devstack sudo[95874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:54:46 devstack sudo[95874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:46 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbc3d1ef-ae84-4953-bd36-7b71e144e856 tempest-VolumeQuotasAdminTestJSON-772227809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:54:46 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fbc3d1ef-ae84-4953-bd36-7b71e144e856 tempest-VolumeQuotasAdminTestJSON-772227809 None] Flow 'volume_create_manager' (2e642f71-7e9c-45bc-9637-9b436894d5ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:54:46 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fbc3d1ef-ae84-4953-bd36-7b71e144e856 tempest-VolumeQuotasAdminTestJSON-772227809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65ac2c28-e963-47be-bae5-c27300788858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:46 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fbc3d1ef-ae84-4953-bd36-7b71e144e856 tempest-VolumeQuotasAdminTestJSON-772227809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65ac2c28-e963-47be-bae5-c27300788858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:54:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1621464435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ad3d628-6768-4e7b-966d-90f82e3c277b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f486fcc27af4ae7831011938f0c5429',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:54:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:54:46Z,use_quota=True,user_id='e5dbca9d9f6f410daf07713ba48e7985',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:46 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fbc3d1ef-ae84-4953-bd36-7b71e144e856 tempest-VolumeQuotasAdminTestJSON-772227809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81b41f93-992f-47b2-9dde-1a3215a73392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:46 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fbc3d1ef-ae84-4953-bd36-7b71e144e856 tempest-VolumeQuotasAdminTestJSON-772227809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81b41f93-992f-47b2-9dde-1a3215a73392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:46 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fbc3d1ef-ae84-4953-bd36-7b71e144e856 tempest-VolumeQuotasAdminTestJSON-772227809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07fdd5f7-30c8-46ed-a3c9-8ef29b2e1850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:46 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fbc3d1ef-ae84-4953-bd36-7b71e144e856 tempest-VolumeQuotasAdminTestJSON-772227809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07fdd5f7-30c8-46ed-a3c9-8ef29b2e1850) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ad3d628-6768-4e7b-966d-90f82e3c277b', 'volume_name': 'volume-5ad3d628-6768-4e7b-966d-90f82e3c277b', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:46 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fbc3d1ef-ae84-4953-bd36-7b71e144e856 tempest-VolumeQuotasAdminTestJSON-772227809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8dc3daf-2887-4d81-a261-314533a2eb91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:46 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fbc3d1ef-ae84-4953-bd36-7b71e144e856 tempest-VolumeQuotasAdminTestJSON-772227809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8dc3daf-2887-4d81-a261-314533a2eb91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:46 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fbc3d1ef-ae84-4953-bd36-7b71e144e856 tempest-VolumeQuotasAdminTestJSON-772227809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dc87085-152c-4647-87bc-ea420f5f77e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:46 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-fbc3d1ef-ae84-4953-bd36-7b71e144e856 tempest-VolumeQuotasAdminTestJSON-772227809 None] Volume 5ad3d628-6768-4e7b-966d-90f82e3c277b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ad3d628-6768-4e7b-966d-90f82e3c277b', 'volume_size': 1} Jul 30 16:54:46 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-fbc3d1ef-ae84-4953-bd36-7b71e144e856 tempest-VolumeQuotasAdminTestJSON-772227809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:46 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-fbc3d1ef-ae84-4953-bd36-7b71e144e856 tempest-VolumeQuotasAdminTestJSON-772227809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:46 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-fbc3d1ef-ae84-4953-bd36-7b71e144e856 tempest-VolumeQuotasAdminTestJSON-772227809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:54:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1621464435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ad3d628-6768-4e7b-966d-90f82e3c277b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f486fcc27af4ae7831011938f0c5429',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:54:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:54:46Z,use_quota=True,user_id='e5dbca9d9f6f410daf07713ba48e7985',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:54:46 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-fbc3d1ef-ae84-4953-bd36-7b71e144e856 tempest-VolumeQuotasAdminTestJSON-772227809 None] Creating volume 5ad3d628-6768-4e7b-966d-90f82e3c277b {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:54:46 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-fbc3d1ef-ae84-4953-bd36-7b71e144e856 tempest-VolumeQuotasAdminTestJSON-772227809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:46 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-fbc3d1ef-ae84-4953-bd36-7b71e144e856 tempest-VolumeQuotasAdminTestJSON-772227809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:46 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-fbc3d1ef-ae84-4953-bd36-7b71e144e856 tempest-VolumeQuotasAdminTestJSON-772227809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:46 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-fbc3d1ef-ae84-4953-bd36-7b71e144e856 tempest-VolumeQuotasAdminTestJSON-772227809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:46 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-fbc3d1ef-ae84-4953-bd36-7b71e144e856 tempest-VolumeQuotasAdminTestJSON-772227809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:46 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-fbc3d1ef-ae84-4953-bd36-7b71e144e856 tempest-VolumeQuotasAdminTestJSON-772227809 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:54:46 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-fbc3d1ef-ae84-4953-bd36-7b71e144e856 tempest-VolumeQuotasAdminTestJSON-772227809 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 16:54:46 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fbc3d1ef-ae84-4953-bd36-7b71e144e856 tempest-VolumeQuotasAdminTestJSON-772227809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5ad3d628-6768-4e7b-966d-90f82e3c277b 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:46 devstack sudo[95876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5ad3d628-6768-4e7b-966d-90f82e3c277b 1073741824 Jul 30 16:54:46 devstack sudo[95876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:46 devstack sudo[95874]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:46 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-59f5e573-dc25-4135-9a7d-f8622cc5b345 tempest-AttachVolumeShelveTestJSON-608644172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.299s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:46 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-59f5e573-dc25-4135-9a7d-f8622cc5b345 tempest-AttachVolumeShelveTestJSON-608644172 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:54:46 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-59f5e573-dc25-4135-9a7d-f8622cc5b345 tempest-AttachVolumeShelveTestJSON-608644172 None] Deleted volume successfully. Jul 30 16:54:46 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-59f5e573-dc25-4135-9a7d-f8622cc5b345 tempest-AttachVolumeShelveTestJSON-608644172 None] Lock "cinder-9e852a5a-0736-435c-b969-f892fda5bd95-delete_volume" released by "delete_volume" :: held 1.288s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:46 devstack sudo[95876]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:46 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fbc3d1ef-ae84-4953-bd36-7b71e144e856 tempest-VolumeQuotasAdminTestJSON-772227809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5ad3d628-6768-4e7b-966d-90f82e3c277b 1073741824" returned: 0 in 0.624s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:46 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fbc3d1ef-ae84-4953-bd36-7b71e144e856 tempest-VolumeQuotasAdminTestJSON-772227809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5ad3d628-6768-4e7b-966d-90f82e3c277b {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:46 devstack sudo[95889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5ad3d628-6768-4e7b-966d-90f82e3c277b Jul 30 16:54:46 devstack sudo[95889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:46 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-f925bbd3-70c3-4fa2-b3e3-d9da28455eef tempest-GroupsTest-311468979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:54:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f925bbd3-70c3-4fa2-b3e3-d9da28455eef tempest-GroupsTest-311468979 None] Flow 'volume_create_manager' (0e695e6f-9c49-4604-a513-c9b848efdfac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:54:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f925bbd3-70c3-4fa2-b3e3-d9da28455eef tempest-GroupsTest-311468979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (660ef4f9-cb00-4c55-a3f3-cb8d77ef2004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f925bbd3-70c3-4fa2-b3e3-d9da28455eef tempest-GroupsTest-311468979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (660ef4f9-cb00-4c55-a3f3-cb8d77ef2004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:54:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1465619352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1b8a2c85-ec2e-4967-83e2-779c19b60d5d,host='devstack@QuobyteHD#QuobyteHD',id=85282911-bb3b-48be-9b09-826db6ea7bb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f41415d5b5c54c12bf01577887db22f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:54:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:54:47Z,use_quota=True,user_id='8533631967054e31ac77b2ca6d25e1a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a8a710f-14f3-45f1-a6a5-01514d9d1593),volume_type_id=9a8a710f-14f3-45f1-a6a5-01514d9d1593)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f925bbd3-70c3-4fa2-b3e3-d9da28455eef tempest-GroupsTest-311468979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55f42fc9-f0c5-45b1-8cc3-452f6e89bb86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f925bbd3-70c3-4fa2-b3e3-d9da28455eef tempest-GroupsTest-311468979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55f42fc9-f0c5-45b1-8cc3-452f6e89bb86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f925bbd3-70c3-4fa2-b3e3-d9da28455eef tempest-GroupsTest-311468979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e45a594-f110-4d0c-a235-b6d24bf80a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f925bbd3-70c3-4fa2-b3e3-d9da28455eef tempest-GroupsTest-311468979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e45a594-f110-4d0c-a235-b6d24bf80a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85282911-bb3b-48be-9b09-826db6ea7bb3', 'volume_name': 'volume-85282911-bb3b-48be-9b09-826db6ea7bb3', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f925bbd3-70c3-4fa2-b3e3-d9da28455eef tempest-GroupsTest-311468979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ecd706c-5db5-40fe-a3db-a1fd2ee1cd23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f925bbd3-70c3-4fa2-b3e3-d9da28455eef tempest-GroupsTest-311468979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ecd706c-5db5-40fe-a3db-a1fd2ee1cd23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f925bbd3-70c3-4fa2-b3e3-d9da28455eef tempest-GroupsTest-311468979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75d52abd-ef0e-476d-94e6-84962a6d1fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:47 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-f925bbd3-70c3-4fa2-b3e3-d9da28455eef tempest-GroupsTest-311468979 None] Volume 85282911-bb3b-48be-9b09-826db6ea7bb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85282911-bb3b-48be-9b09-826db6ea7bb3', 'volume_size': 1} Jul 30 16:54:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-f925bbd3-70c3-4fa2-b3e3-d9da28455eef tempest-GroupsTest-311468979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:47 devstack sudo[95889]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fbc3d1ef-ae84-4953-bd36-7b71e144e856 tempest-VolumeQuotasAdminTestJSON-772227809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5ad3d628-6768-4e7b-966d-90f82e3c277b" returned: 0 in 0.339s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:47 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-fbc3d1ef-ae84-4953-bd36-7b71e144e856 tempest-VolumeQuotasAdminTestJSON-772227809 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:54:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-fbc3d1ef-ae84-4953-bd36-7b71e144e856 tempest-VolumeQuotasAdminTestJSON-772227809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-f925bbd3-70c3-4fa2-b3e3-d9da28455eef tempest-GroupsTest-311468979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.089s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:47 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-f925bbd3-70c3-4fa2-b3e3-d9da28455eef tempest-GroupsTest-311468979 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1b8a2c85-ec2e-4967-83e2-779c19b60d5d,created_at=2026-07-30T14:54:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1465619352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1b8a2c85-ec2e-4967-83e2-779c19b60d5d,host='devstack@QuobyteHD#QuobyteHD',id=85282911-bb3b-48be-9b09-826db6ea7bb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f41415d5b5c54c12bf01577887db22f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:54:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:54:47Z,use_quota=True,user_id='8533631967054e31ac77b2ca6d25e1a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a8a710f-14f3-45f1-a6a5-01514d9d1593),volume_type_id=9a8a710f-14f3-45f1-a6a5-01514d9d1593)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:54:47 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-f925bbd3-70c3-4fa2-b3e3-d9da28455eef tempest-GroupsTest-311468979 None] Creating volume 85282911-bb3b-48be-9b09-826db6ea7bb3 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:54:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-f925bbd3-70c3-4fa2-b3e3-d9da28455eef tempest-GroupsTest-311468979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-f925bbd3-70c3-4fa2-b3e3-d9da28455eef tempest-GroupsTest-311468979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:47 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-f925bbd3-70c3-4fa2-b3e3-d9da28455eef tempest-GroupsTest-311468979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:47 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-f925bbd3-70c3-4fa2-b3e3-d9da28455eef tempest-GroupsTest-311468979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-f925bbd3-70c3-4fa2-b3e3-d9da28455eef tempest-GroupsTest-311468979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:47 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-f925bbd3-70c3-4fa2-b3e3-d9da28455eef tempest-GroupsTest-311468979 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:54:47 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-f925bbd3-70c3-4fa2-b3e3-d9da28455eef tempest-GroupsTest-311468979 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 16:54:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f925bbd3-70c3-4fa2-b3e3-d9da28455eef tempest-GroupsTest-311468979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-85282911-bb3b-48be-9b09-826db6ea7bb3 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fbc3d1ef-ae84-4953-bd36-7b71e144e856 tempest-VolumeQuotasAdminTestJSON-772227809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dc87085-152c-4647-87bc-ea420f5f77e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ad3d628-6768-4e7b-966d-90f82e3c277b', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fbc3d1ef-ae84-4953-bd36-7b71e144e856 tempest-VolumeQuotasAdminTestJSON-772227809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92fd2e87-e6c2-4d31-a1e6-603710cc12ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:47 devstack sudo[95892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-85282911-bb3b-48be-9b09-826db6ea7bb3 1073741824 Jul 30 16:54:47 devstack sudo[95892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:47 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-fbc3d1ef-ae84-4953-bd36-7b71e144e856 tempest-VolumeQuotasAdminTestJSON-772227809 None] Volume volume-5ad3d628-6768-4e7b-966d-90f82e3c277b (5ad3d628-6768-4e7b-966d-90f82e3c277b): created successfully Jul 30 16:54:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fbc3d1ef-ae84-4953-bd36-7b71e144e856 tempest-VolumeQuotasAdminTestJSON-772227809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92fd2e87-e6c2-4d31-a1e6-603710cc12ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fbc3d1ef-ae84-4953-bd36-7b71e144e856 tempest-VolumeQuotasAdminTestJSON-772227809 None] Flow 'volume_create_manager' (2e642f71-7e9c-45bc-9637-9b436894d5ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:54:47 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-fbc3d1ef-ae84-4953-bd36-7b71e144e856 tempest-VolumeQuotasAdminTestJSON-772227809 None] Created volume successfully. Jul 30 16:54:47 devstack sudo[95892]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f925bbd3-70c3-4fa2-b3e3-d9da28455eef tempest-GroupsTest-311468979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-85282911-bb3b-48be-9b09-826db6ea7bb3 1073741824" returned: 0 in 0.614s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f925bbd3-70c3-4fa2-b3e3-d9da28455eef tempest-GroupsTest-311468979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-85282911-bb3b-48be-9b09-826db6ea7bb3 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:47 devstack sudo[95898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-85282911-bb3b-48be-9b09-826db6ea7bb3 Jul 30 16:54:47 devstack sudo[95898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:48 devstack sudo[95898]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:48 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f925bbd3-70c3-4fa2-b3e3-d9da28455eef tempest-GroupsTest-311468979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-85282911-bb3b-48be-9b09-826db6ea7bb3" returned: 0 in 0.327s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:48 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-f925bbd3-70c3-4fa2-b3e3-d9da28455eef tempest-GroupsTest-311468979 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:54:48 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-f925bbd3-70c3-4fa2-b3e3-d9da28455eef tempest-GroupsTest-311468979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:48 devstack cinder-volume[88568]: DEBUG dbcounter [-] [88568] Writing DB stats cinder:SELECT=124,cinder:UPDATE=132,cinder:INSERT=32,cinder:DELETE=9 {{(pid=88568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:54:48 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f925bbd3-70c3-4fa2-b3e3-d9da28455eef tempest-GroupsTest-311468979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75d52abd-ef0e-476d-94e6-84962a6d1fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85282911-bb3b-48be-9b09-826db6ea7bb3', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:48 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f925bbd3-70c3-4fa2-b3e3-d9da28455eef tempest-GroupsTest-311468979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (866e2d4c-5d9a-44e6-bb56-793a3d373f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:48 devstack cinder-volume[88568]: DEBUG dbcounter [-] [88568] Writing DB stats cinder:DELETE=8,cinder:SELECT=126,cinder:UPDATE=127,cinder:INSERT=29 {{(pid=88568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:54:48 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-f925bbd3-70c3-4fa2-b3e3-d9da28455eef tempest-GroupsTest-311468979 None] Volume volume-85282911-bb3b-48be-9b09-826db6ea7bb3 (85282911-bb3b-48be-9b09-826db6ea7bb3): created successfully Jul 30 16:54:48 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f925bbd3-70c3-4fa2-b3e3-d9da28455eef tempest-GroupsTest-311468979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (866e2d4c-5d9a-44e6-bb56-793a3d373f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:48 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f925bbd3-70c3-4fa2-b3e3-d9da28455eef tempest-GroupsTest-311468979 None] Flow 'volume_create_manager' (0e695e6f-9c49-4604-a513-c9b848efdfac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:54:48 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-f925bbd3-70c3-4fa2-b3e3-d9da28455eef tempest-GroupsTest-311468979 None] Created volume successfully. Jul 30 16:54:48 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-b70ff8be-e646-49ab-a337-10d2589d3194 tempest-VolumeQuotasAdminTestJSON-772227809 None] Acquiring lock "cinder-5ad3d628-6768-4e7b-966d-90f82e3c277b-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:48 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-b70ff8be-e646-49ab-a337-10d2589d3194 tempest-VolumeQuotasAdminTestJSON-772227809 None] Lock "cinder-5ad3d628-6768-4e7b-966d-90f82e3c277b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:48 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-b70ff8be-e646-49ab-a337-10d2589d3194 tempest-VolumeQuotasAdminTestJSON-772227809 None] Acquiring lock "cinder-quobyte-5ad3d628-6768-4e7b-966d-90f82e3c277b" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:48 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-b70ff8be-e646-49ab-a337-10d2589d3194 tempest-VolumeQuotasAdminTestJSON-772227809 None] Lock "cinder-quobyte-5ad3d628-6768-4e7b-966d-90f82e3c277b" acquired by "delete_volume" :: waited 0.016s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:48 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a30f91e-48fb-4d2c-b042-3727825ba8ce]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:48 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-b70ff8be-e646-49ab-a337-10d2589d3194 tempest-VolumeQuotasAdminTestJSON-772227809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5ad3d628-6768-4e7b-966d-90f82e3c277b {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:48 devstack sudo[95902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5ad3d628-6768-4e7b-966d-90f82e3c277b Jul 30 16:54:48 devstack sudo[95902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:48 devstack sudo[95902]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:48 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-b70ff8be-e646-49ab-a337-10d2589d3194 tempest-VolumeQuotasAdminTestJSON-772227809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5ad3d628-6768-4e7b-966d-90f82e3c277b" returned: 0 in 0.414s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:48 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-b70ff8be-e646-49ab-a337-10d2589d3194 tempest-VolumeQuotasAdminTestJSON-772227809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5ad3d628-6768-4e7b-966d-90f82e3c277b {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:49 devstack sudo[95907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5ad3d628-6768-4e7b-966d-90f82e3c277b Jul 30 16:54:49 devstack sudo[95907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:49 devstack sudo[95907]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:49 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-b70ff8be-e646-49ab-a337-10d2589d3194 tempest-VolumeQuotasAdminTestJSON-772227809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5ad3d628-6768-4e7b-966d-90f82e3c277b" returned: 0 in 0.294s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:49 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-b70ff8be-e646-49ab-a337-10d2589d3194 tempest-VolumeQuotasAdminTestJSON-772227809 None] Lock "cinder-quobyte-5ad3d628-6768-4e7b-966d-90f82e3c277b" released by "delete_volume" :: held 0.765s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:49 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-b70ff8be-e646-49ab-a337-10d2589d3194 tempest-VolumeQuotasAdminTestJSON-772227809 None] Created reservations ['0eac86b8-c419-40eb-a570-0a8c54e175f9', '17e9bdc1-b065-4df3-96c4-6b6f904aea23', '944e3b05-fe26-4eda-910a-69968aee74a6', 'd614048c-7c57-4925-b56e-a0650a20d9ad'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:54:49 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-b70ff8be-e646-49ab-a337-10d2589d3194 tempest-VolumeQuotasAdminTestJSON-772227809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:49 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-b70ff8be-e646-49ab-a337-10d2589d3194 tempest-VolumeQuotasAdminTestJSON-772227809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:49 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-b70ff8be-e646-49ab-a337-10d2589d3194 tempest-VolumeQuotasAdminTestJSON-772227809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:49 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-b70ff8be-e646-49ab-a337-10d2589d3194 tempest-VolumeQuotasAdminTestJSON-772227809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:49 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-b70ff8be-e646-49ab-a337-10d2589d3194 tempest-VolumeQuotasAdminTestJSON-772227809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:49 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-b70ff8be-e646-49ab-a337-10d2589d3194 tempest-VolumeQuotasAdminTestJSON-772227809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:49 devstack sudo[95910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:54:49 devstack sudo[95910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:49 devstack sudo[95910]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:49 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-b70ff8be-e646-49ab-a337-10d2589d3194 tempest-VolumeQuotasAdminTestJSON-772227809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.331s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:49 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-b70ff8be-e646-49ab-a337-10d2589d3194 tempest-VolumeQuotasAdminTestJSON-772227809 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:54:49 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-b70ff8be-e646-49ab-a337-10d2589d3194 tempest-VolumeQuotasAdminTestJSON-772227809 None] Deleted volume successfully. Jul 30 16:54:49 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-b70ff8be-e646-49ab-a337-10d2589d3194 tempest-VolumeQuotasAdminTestJSON-772227809 None] Lock "cinder-5ad3d628-6768-4e7b-966d-90f82e3c277b-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:50 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-23f0340c-9465-4252-8fc5-07e56dc3c97b tempest-GroupsTest-311468979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:54:50 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-23f0340c-9465-4252-8fc5-07e56dc3c97b tempest-GroupsTest-311468979 None] Flow 'volume_create_manager' (02ecc526-c2dc-4ea1-a576-4932b795988e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:54:50 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-23f0340c-9465-4252-8fc5-07e56dc3c97b tempest-GroupsTest-311468979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4166482-b9c3-4e79-b48c-ea04a327fad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:50 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-23f0340c-9465-4252-8fc5-07e56dc3c97b tempest-GroupsTest-311468979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4166482-b9c3-4e79-b48c-ea04a327fad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:54:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1171870977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1b8a2c85-ec2e-4967-83e2-779c19b60d5d,host='devstack@QuobyteHD#QuobyteHD',id=471a9f42-cc36-42a0-beab-cca107a64278,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f41415d5b5c54c12bf01577887db22f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:54:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:54:50Z,use_quota=True,user_id='8533631967054e31ac77b2ca6d25e1a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a8a710f-14f3-45f1-a6a5-01514d9d1593),volume_type_id=9a8a710f-14f3-45f1-a6a5-01514d9d1593)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:50 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-23f0340c-9465-4252-8fc5-07e56dc3c97b tempest-GroupsTest-311468979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ce926a9-98b6-4ed4-8db9-ffaac6f6e85a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:50 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-23f0340c-9465-4252-8fc5-07e56dc3c97b tempest-GroupsTest-311468979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ce926a9-98b6-4ed4-8db9-ffaac6f6e85a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:50 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-23f0340c-9465-4252-8fc5-07e56dc3c97b tempest-GroupsTest-311468979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dca34a1b-34ae-4673-a2f4-459d73f31b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:50 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-23f0340c-9465-4252-8fc5-07e56dc3c97b tempest-GroupsTest-311468979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dca34a1b-34ae-4673-a2f4-459d73f31b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '471a9f42-cc36-42a0-beab-cca107a64278', 'volume_name': 'volume-471a9f42-cc36-42a0-beab-cca107a64278', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:50 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-23f0340c-9465-4252-8fc5-07e56dc3c97b tempest-GroupsTest-311468979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c117851-3252-413a-8865-1bfd69536c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:50 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-23f0340c-9465-4252-8fc5-07e56dc3c97b tempest-GroupsTest-311468979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c117851-3252-413a-8865-1bfd69536c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:50 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-23f0340c-9465-4252-8fc5-07e56dc3c97b tempest-GroupsTest-311468979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9905c70-525b-43d6-8af3-e4baf0f9103b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:50 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-23f0340c-9465-4252-8fc5-07e56dc3c97b tempest-GroupsTest-311468979 None] Volume 471a9f42-cc36-42a0-beab-cca107a64278: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-471a9f42-cc36-42a0-beab-cca107a64278', 'volume_size': 1} Jul 30 16:54:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-23f0340c-9465-4252-8fc5-07e56dc3c97b tempest-GroupsTest-311468979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-23f0340c-9465-4252-8fc5-07e56dc3c97b tempest-GroupsTest-311468979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:50 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-23f0340c-9465-4252-8fc5-07e56dc3c97b tempest-GroupsTest-311468979 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1b8a2c85-ec2e-4967-83e2-779c19b60d5d,created_at=2026-07-30T14:54:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1171870977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1b8a2c85-ec2e-4967-83e2-779c19b60d5d,host='devstack@QuobyteHD#QuobyteHD',id=471a9f42-cc36-42a0-beab-cca107a64278,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f41415d5b5c54c12bf01577887db22f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:54:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:54:50Z,use_quota=True,user_id='8533631967054e31ac77b2ca6d25e1a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a8a710f-14f3-45f1-a6a5-01514d9d1593),volume_type_id=9a8a710f-14f3-45f1-a6a5-01514d9d1593)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:54:50 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-23f0340c-9465-4252-8fc5-07e56dc3c97b tempest-GroupsTest-311468979 None] Creating volume 471a9f42-cc36-42a0-beab-cca107a64278 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:54:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-23f0340c-9465-4252-8fc5-07e56dc3c97b tempest-GroupsTest-311468979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-23f0340c-9465-4252-8fc5-07e56dc3c97b tempest-GroupsTest-311468979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:50 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-23f0340c-9465-4252-8fc5-07e56dc3c97b tempest-GroupsTest-311468979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:50 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-23f0340c-9465-4252-8fc5-07e56dc3c97b tempest-GroupsTest-311468979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-23f0340c-9465-4252-8fc5-07e56dc3c97b tempest-GroupsTest-311468979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:50 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-23f0340c-9465-4252-8fc5-07e56dc3c97b tempest-GroupsTest-311468979 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:54:50 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-23f0340c-9465-4252-8fc5-07e56dc3c97b tempest-GroupsTest-311468979 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 16:54:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-23f0340c-9465-4252-8fc5-07e56dc3c97b tempest-GroupsTest-311468979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-471a9f42-cc36-42a0-beab-cca107a64278 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:50 devstack sudo[95917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-471a9f42-cc36-42a0-beab-cca107a64278 1073741824 Jul 30 16:54:50 devstack sudo[95917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:50 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef167b6b-3c8d-464a-8e89-0159fd17b478 tempest-VolumeQuotasAdminTestJSON-772227809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:54:50 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ef167b6b-3c8d-464a-8e89-0159fd17b478 tempest-VolumeQuotasAdminTestJSON-772227809 None] Flow 'volume_create_manager' (21193862-534d-4ab1-81ce-300e16d6fa1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:54:50 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ef167b6b-3c8d-464a-8e89-0159fd17b478 tempest-VolumeQuotasAdminTestJSON-772227809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c81fb8ce-ef3c-473d-9ba1-a8460088ce2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:50 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ef167b6b-3c8d-464a-8e89-0159fd17b478 tempest-VolumeQuotasAdminTestJSON-772227809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c81fb8ce-ef3c-473d-9ba1-a8460088ce2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:54:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1220085243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b15598bc-e1b2-4ace-af8f-22add7a3dcf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f486fcc27af4ae7831011938f0c5429',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:54:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:54:51Z,use_quota=True,user_id='e5dbca9d9f6f410daf07713ba48e7985',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:50 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ef167b6b-3c8d-464a-8e89-0159fd17b478 tempest-VolumeQuotasAdminTestJSON-772227809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d83d1e46-c254-44a6-973a-3de24186e140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:50 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ef167b6b-3c8d-464a-8e89-0159fd17b478 tempest-VolumeQuotasAdminTestJSON-772227809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d83d1e46-c254-44a6-973a-3de24186e140) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:50 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ef167b6b-3c8d-464a-8e89-0159fd17b478 tempest-VolumeQuotasAdminTestJSON-772227809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbac54f1-06ba-4acb-8ce0-d5d2d1a56090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:50 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ef167b6b-3c8d-464a-8e89-0159fd17b478 tempest-VolumeQuotasAdminTestJSON-772227809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbac54f1-06ba-4acb-8ce0-d5d2d1a56090) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b15598bc-e1b2-4ace-af8f-22add7a3dcf2', 'volume_name': 'volume-b15598bc-e1b2-4ace-af8f-22add7a3dcf2', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:50 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ef167b6b-3c8d-464a-8e89-0159fd17b478 tempest-VolumeQuotasAdminTestJSON-772227809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5c0226d-a64f-4236-a48d-d1287f9963e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:50 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ef167b6b-3c8d-464a-8e89-0159fd17b478 tempest-VolumeQuotasAdminTestJSON-772227809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5c0226d-a64f-4236-a48d-d1287f9963e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:50 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ef167b6b-3c8d-464a-8e89-0159fd17b478 tempest-VolumeQuotasAdminTestJSON-772227809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb8c6f5d-545d-4414-bc38-be5fcf4bf96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:50 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-ef167b6b-3c8d-464a-8e89-0159fd17b478 tempest-VolumeQuotasAdminTestJSON-772227809 None] Volume b15598bc-e1b2-4ace-af8f-22add7a3dcf2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b15598bc-e1b2-4ace-af8f-22add7a3dcf2', 'volume_size': 1} Jul 30 16:54:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-ef167b6b-3c8d-464a-8e89-0159fd17b478 tempest-VolumeQuotasAdminTestJSON-772227809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:51 devstack sudo[95917]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-23f0340c-9465-4252-8fc5-07e56dc3c97b tempest-GroupsTest-311468979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-471a9f42-cc36-42a0-beab-cca107a64278 1073741824" returned: 0 in 0.574s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-23f0340c-9465-4252-8fc5-07e56dc3c97b tempest-GroupsTest-311468979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-471a9f42-cc36-42a0-beab-cca107a64278 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:51 devstack sudo[95925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-471a9f42-cc36-42a0-beab-cca107a64278 Jul 30 16:54:51 devstack sudo[95925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:51 devstack sudo[95925]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-23f0340c-9465-4252-8fc5-07e56dc3c97b tempest-GroupsTest-311468979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-471a9f42-cc36-42a0-beab-cca107a64278" returned: 0 in 0.298s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:51 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-23f0340c-9465-4252-8fc5-07e56dc3c97b tempest-GroupsTest-311468979 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:54:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-23f0340c-9465-4252-8fc5-07e56dc3c97b tempest-GroupsTest-311468979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-ef167b6b-3c8d-464a-8e89-0159fd17b478 tempest-VolumeQuotasAdminTestJSON-772227809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.814s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:51 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-ef167b6b-3c8d-464a-8e89-0159fd17b478 tempest-VolumeQuotasAdminTestJSON-772227809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:54:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1220085243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b15598bc-e1b2-4ace-af8f-22add7a3dcf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f486fcc27af4ae7831011938f0c5429',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:54:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:54:51Z,use_quota=True,user_id='e5dbca9d9f6f410daf07713ba48e7985',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:54:51 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-ef167b6b-3c8d-464a-8e89-0159fd17b478 tempest-VolumeQuotasAdminTestJSON-772227809 None] Creating volume b15598bc-e1b2-4ace-af8f-22add7a3dcf2 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:54:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-ef167b6b-3c8d-464a-8e89-0159fd17b478 tempest-VolumeQuotasAdminTestJSON-772227809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-ef167b6b-3c8d-464a-8e89-0159fd17b478 tempest-VolumeQuotasAdminTestJSON-772227809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:51 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-ef167b6b-3c8d-464a-8e89-0159fd17b478 tempest-VolumeQuotasAdminTestJSON-772227809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:51 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-ef167b6b-3c8d-464a-8e89-0159fd17b478 tempest-VolumeQuotasAdminTestJSON-772227809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-ef167b6b-3c8d-464a-8e89-0159fd17b478 tempest-VolumeQuotasAdminTestJSON-772227809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:51 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-ef167b6b-3c8d-464a-8e89-0159fd17b478 tempest-VolumeQuotasAdminTestJSON-772227809 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:54:51 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-ef167b6b-3c8d-464a-8e89-0159fd17b478 tempest-VolumeQuotasAdminTestJSON-772227809 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 16:54:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-ef167b6b-3c8d-464a-8e89-0159fd17b478 tempest-VolumeQuotasAdminTestJSON-772227809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b15598bc-e1b2-4ace-af8f-22add7a3dcf2 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:51 devstack sudo[95930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b15598bc-e1b2-4ace-af8f-22add7a3dcf2 1073741824 Jul 30 16:54:51 devstack sudo[95930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:51 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-23f0340c-9465-4252-8fc5-07e56dc3c97b tempest-GroupsTest-311468979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9905c70-525b-43d6-8af3-e4baf0f9103b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-471a9f42-cc36-42a0-beab-cca107a64278', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:51 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-23f0340c-9465-4252-8fc5-07e56dc3c97b tempest-GroupsTest-311468979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (077432db-ea1e-4da5-bbdf-5a3020688c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:51 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-23f0340c-9465-4252-8fc5-07e56dc3c97b tempest-GroupsTest-311468979 None] Volume volume-471a9f42-cc36-42a0-beab-cca107a64278 (471a9f42-cc36-42a0-beab-cca107a64278): created successfully Jul 30 16:54:51 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-23f0340c-9465-4252-8fc5-07e56dc3c97b tempest-GroupsTest-311468979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (077432db-ea1e-4da5-bbdf-5a3020688c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:51 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-23f0340c-9465-4252-8fc5-07e56dc3c97b tempest-GroupsTest-311468979 None] Flow 'volume_create_manager' (02ecc526-c2dc-4ea1-a576-4932b795988e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:54:51 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-23f0340c-9465-4252-8fc5-07e56dc3c97b tempest-GroupsTest-311468979 None] Created volume successfully. Jul 30 16:54:51 devstack cinder-volume[88568]: INFO cinder.volume.manager [req-2d26988e-d454-4586-b7fd-57bb957937d7 req-1ae6e339-0bbd-4aae-bd9e-dafea9ac2a0d tempest-ServerActionsTestOtherA-332393488 None] Terminate volume connection completed successfully. Jul 30 16:54:51 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [req-2d26988e-d454-4586-b7fd-57bb957937d7 req-1ae6e339-0bbd-4aae-bd9e-dafea9ac2a0d tempest-ServerActionsTestOtherA-332393488 None] Deleting attachment 8084b072-0f4c-493d-9328-76934dd2ebf1. {{(pid=88568) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 16:54:52 devstack sudo[95930]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-ef167b6b-3c8d-464a-8e89-0159fd17b478 tempest-VolumeQuotasAdminTestJSON-772227809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b15598bc-e1b2-4ace-af8f-22add7a3dcf2 1073741824" returned: 0 in 0.548s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-ef167b6b-3c8d-464a-8e89-0159fd17b478 tempest-VolumeQuotasAdminTestJSON-772227809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b15598bc-e1b2-4ace-af8f-22add7a3dcf2 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:52 devstack sudo[95942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b15598bc-e1b2-4ace-af8f-22add7a3dcf2 Jul 30 16:54:52 devstack sudo[95942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:52 devstack cinder-volume[88568]: DEBUG oslo_service.periodic_task [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:54:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:52 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:52 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:52 devstack sudo[95942]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-ef167b6b-3c8d-464a-8e89-0159fd17b478 tempest-VolumeQuotasAdminTestJSON-772227809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b15598bc-e1b2-4ace-af8f-22add7a3dcf2" returned: 0 in 0.350s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:52 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-ef167b6b-3c8d-464a-8e89-0159fd17b478 tempest-VolumeQuotasAdminTestJSON-772227809 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:54:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-ef167b6b-3c8d-464a-8e89-0159fd17b478 tempest-VolumeQuotasAdminTestJSON-772227809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:52 devstack sudo[95948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:54:52 devstack sudo[95948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:52 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ef167b6b-3c8d-464a-8e89-0159fd17b478 tempest-VolumeQuotasAdminTestJSON-772227809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb8c6f5d-545d-4414-bc38-be5fcf4bf96e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b15598bc-e1b2-4ace-af8f-22add7a3dcf2', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:52 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ef167b6b-3c8d-464a-8e89-0159fd17b478 tempest-VolumeQuotasAdminTestJSON-772227809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0410a913-7bf0-4691-86fe-353faed1e67d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:52 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-ef167b6b-3c8d-464a-8e89-0159fd17b478 tempest-VolumeQuotasAdminTestJSON-772227809 None] Volume volume-b15598bc-e1b2-4ace-af8f-22add7a3dcf2 (b15598bc-e1b2-4ace-af8f-22add7a3dcf2): created successfully Jul 30 16:54:52 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ef167b6b-3c8d-464a-8e89-0159fd17b478 tempest-VolumeQuotasAdminTestJSON-772227809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0410a913-7bf0-4691-86fe-353faed1e67d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:52 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ef167b6b-3c8d-464a-8e89-0159fd17b478 tempest-VolumeQuotasAdminTestJSON-772227809 None] Flow 'volume_create_manager' (21193862-534d-4ab1-81ce-300e16d6fa1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:54:52 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-ef167b6b-3c8d-464a-8e89-0159fd17b478 tempest-VolumeQuotasAdminTestJSON-772227809 None] Created volume successfully. Jul 30 16:54:52 devstack sudo[95948]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.351s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:52 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:54:52 devstack cinder-volume[88568]: DEBUG oslo_service.periodic_task [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Running periodic task VolumeManager._thread_info {{(pid=88568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:54:52 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] thread count: 8 {{(pid=88568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:54:52 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] thread info: [<_MainThread(MainThread, started 127406866608256)>, , , , , , , ] {{(pid=88568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:54:53 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-b890c59d-0ff0-4ad0-842a-8591092a4b6d tempest-GroupsTest-311468979 None] Update group completed successfully. Jul 30 16:54:54 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-fbd1d347-0787-4c02-988c-1bb5f578dbe3 tempest-GroupsTest-311468979 None] Update group completed successfully. Jul 30 16:54:54 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-eb72d614-ce32-4b9f-8d1f-fc7f1b545665 tempest-VolumeQuotasAdminTestJSON-428731474 None] Transfer volume completed successfully. Jul 30 16:54:55 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-03828751-8cc2-4e6f-8b6d-78a812ff6fef tempest-VolumeQuotasAdminTestJSON-1660255531 None] Acquiring lock "cinder-b15598bc-e1b2-4ace-af8f-22add7a3dcf2-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:55 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-03828751-8cc2-4e6f-8b6d-78a812ff6fef tempest-VolumeQuotasAdminTestJSON-1660255531 None] Lock "cinder-b15598bc-e1b2-4ace-af8f-22add7a3dcf2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:55 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-03828751-8cc2-4e6f-8b6d-78a812ff6fef tempest-VolumeQuotasAdminTestJSON-1660255531 None] Acquiring lock "cinder-quobyte-b15598bc-e1b2-4ace-af8f-22add7a3dcf2" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:55 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-03828751-8cc2-4e6f-8b6d-78a812ff6fef tempest-VolumeQuotasAdminTestJSON-1660255531 None] Lock "cinder-quobyte-b15598bc-e1b2-4ace-af8f-22add7a3dcf2" acquired by "delete_volume" :: waited 0.019s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:55 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d5f0b3c-e91c-477c-95fd-895d5190c156]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-03828751-8cc2-4e6f-8b6d-78a812ff6fef tempest-VolumeQuotasAdminTestJSON-1660255531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b15598bc-e1b2-4ace-af8f-22add7a3dcf2 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:55 devstack sudo[95996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b15598bc-e1b2-4ace-af8f-22add7a3dcf2 Jul 30 16:54:55 devstack sudo[95996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:56 devstack sudo[95996]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-03828751-8cc2-4e6f-8b6d-78a812ff6fef tempest-VolumeQuotasAdminTestJSON-1660255531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b15598bc-e1b2-4ace-af8f-22add7a3dcf2" returned: 0 in 0.493s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-03828751-8cc2-4e6f-8b6d-78a812ff6fef tempest-VolumeQuotasAdminTestJSON-1660255531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b15598bc-e1b2-4ace-af8f-22add7a3dcf2 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:56 devstack sudo[96001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b15598bc-e1b2-4ace-af8f-22add7a3dcf2 Jul 30 16:54:56 devstack sudo[96001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:56 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [req-5ed3c4fb-ab0c-4821-8684-078a0c605291 req-aadf51ab-6a70-4de9-ba6d-836481e99ce2 tempest-VolumesSnapshotsTestJSON-1548411211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:54:56 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [req-5ed3c4fb-ab0c-4821-8684-078a0c605291 req-aadf51ab-6a70-4de9-ba6d-836481e99ce2 tempest-VolumesSnapshotsTestJSON-1548411211 None] Flow 'volume_create_manager' (c830ef1b-8351-427f-8641-29adb72c6560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:54:56 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [req-5ed3c4fb-ab0c-4821-8684-078a0c605291 req-aadf51ab-6a70-4de9-ba6d-836481e99ce2 tempest-VolumesSnapshotsTestJSON-1548411211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (287b7ab0-3724-4576-b171-c3fd671127f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:56 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [req-5ed3c4fb-ab0c-4821-8684-078a0c605291 req-aadf51ab-6a70-4de9-ba6d-836481e99ce2 tempest-VolumesSnapshotsTestJSON-1548411211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (287b7ab0-3724-4576-b171-c3fd671127f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:54:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-914459035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=800d6bc4-98f5-4551-8640-100940a09d76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='654ede8bc4c342378dae080b1db6268f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:54:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:54:56Z,use_quota=True,user_id='31bb6c5e8088483fbaa70896e841c06f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:56 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [req-5ed3c4fb-ab0c-4821-8684-078a0c605291 req-aadf51ab-6a70-4de9-ba6d-836481e99ce2 tempest-VolumesSnapshotsTestJSON-1548411211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9449045b-b940-492c-a511-83b4513738bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:56 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [req-5ed3c4fb-ab0c-4821-8684-078a0c605291 req-aadf51ab-6a70-4de9-ba6d-836481e99ce2 tempest-VolumesSnapshotsTestJSON-1548411211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9449045b-b940-492c-a511-83b4513738bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:56 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [req-5ed3c4fb-ab0c-4821-8684-078a0c605291 req-aadf51ab-6a70-4de9-ba6d-836481e99ce2 tempest-VolumesSnapshotsTestJSON-1548411211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d76ca0ec-1f71-4375-a0ff-aae0fc66f88a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:56 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [req-5ed3c4fb-ab0c-4821-8684-078a0c605291 req-aadf51ab-6a70-4de9-ba6d-836481e99ce2 tempest-VolumesSnapshotsTestJSON-1548411211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d76ca0ec-1f71-4375-a0ff-aae0fc66f88a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '800d6bc4-98f5-4551-8640-100940a09d76', 'volume_name': 'volume-800d6bc4-98f5-4551-8640-100940a09d76', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:56 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [req-5ed3c4fb-ab0c-4821-8684-078a0c605291 req-aadf51ab-6a70-4de9-ba6d-836481e99ce2 tempest-VolumesSnapshotsTestJSON-1548411211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49918a77-602c-4508-a4fe-42a1add02d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:56 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [req-5ed3c4fb-ab0c-4821-8684-078a0c605291 req-aadf51ab-6a70-4de9-ba6d-836481e99ce2 tempest-VolumesSnapshotsTestJSON-1548411211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49918a77-602c-4508-a4fe-42a1add02d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:56 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [req-5ed3c4fb-ab0c-4821-8684-078a0c605291 req-aadf51ab-6a70-4de9-ba6d-836481e99ce2 tempest-VolumesSnapshotsTestJSON-1548411211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d81336c8-34f3-4078-af6e-6842aca52d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:56 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [req-5ed3c4fb-ab0c-4821-8684-078a0c605291 req-aadf51ab-6a70-4de9-ba6d-836481e99ce2 tempest-VolumesSnapshotsTestJSON-1548411211 None] Volume 800d6bc4-98f5-4551-8640-100940a09d76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-800d6bc4-98f5-4551-8640-100940a09d76', 'volume_size': 1} Jul 30 16:54:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-5ed3c4fb-ab0c-4821-8684-078a0c605291 req-aadf51ab-6a70-4de9-ba6d-836481e99ce2 tempest-VolumesSnapshotsTestJSON-1548411211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-5ed3c4fb-ab0c-4821-8684-078a0c605291 req-aadf51ab-6a70-4de9-ba6d-836481e99ce2 tempest-VolumesSnapshotsTestJSON-1548411211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:56 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [req-5ed3c4fb-ab0c-4821-8684-078a0c605291 req-aadf51ab-6a70-4de9-ba6d-836481e99ce2 tempest-VolumesSnapshotsTestJSON-1548411211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:54:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-914459035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=800d6bc4-98f5-4551-8640-100940a09d76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='654ede8bc4c342378dae080b1db6268f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:54:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:54:56Z,use_quota=True,user_id='31bb6c5e8088483fbaa70896e841c06f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:54:56 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [req-5ed3c4fb-ab0c-4821-8684-078a0c605291 req-aadf51ab-6a70-4de9-ba6d-836481e99ce2 tempest-VolumesSnapshotsTestJSON-1548411211 None] Creating volume 800d6bc4-98f5-4551-8640-100940a09d76 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:54:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-5ed3c4fb-ab0c-4821-8684-078a0c605291 req-aadf51ab-6a70-4de9-ba6d-836481e99ce2 tempest-VolumesSnapshotsTestJSON-1548411211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-5ed3c4fb-ab0c-4821-8684-078a0c605291 req-aadf51ab-6a70-4de9-ba6d-836481e99ce2 tempest-VolumesSnapshotsTestJSON-1548411211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:56 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [req-5ed3c4fb-ab0c-4821-8684-078a0c605291 req-aadf51ab-6a70-4de9-ba6d-836481e99ce2 tempest-VolumesSnapshotsTestJSON-1548411211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:56 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [req-5ed3c4fb-ab0c-4821-8684-078a0c605291 req-aadf51ab-6a70-4de9-ba6d-836481e99ce2 tempest-VolumesSnapshotsTestJSON-1548411211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-5ed3c4fb-ab0c-4821-8684-078a0c605291 req-aadf51ab-6a70-4de9-ba6d-836481e99ce2 tempest-VolumesSnapshotsTestJSON-1548411211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:56 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [req-5ed3c4fb-ab0c-4821-8684-078a0c605291 req-aadf51ab-6a70-4de9-ba6d-836481e99ce2 tempest-VolumesSnapshotsTestJSON-1548411211 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:54:56 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [req-5ed3c4fb-ab0c-4821-8684-078a0c605291 req-aadf51ab-6a70-4de9-ba6d-836481e99ce2 tempest-VolumesSnapshotsTestJSON-1548411211 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 16:54:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [req-5ed3c4fb-ab0c-4821-8684-078a0c605291 req-aadf51ab-6a70-4de9-ba6d-836481e99ce2 tempest-VolumesSnapshotsTestJSON-1548411211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-800d6bc4-98f5-4551-8640-100940a09d76 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:56 devstack sudo[96003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-800d6bc4-98f5-4551-8640-100940a09d76 1073741824 Jul 30 16:54:56 devstack sudo[96003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:56 devstack sudo[96001]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-03828751-8cc2-4e6f-8b6d-78a812ff6fef tempest-VolumeQuotasAdminTestJSON-1660255531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b15598bc-e1b2-4ace-af8f-22add7a3dcf2" returned: 0 in 0.283s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:56 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-03828751-8cc2-4e6f-8b6d-78a812ff6fef tempest-VolumeQuotasAdminTestJSON-1660255531 None] Lock "cinder-quobyte-b15598bc-e1b2-4ace-af8f-22add7a3dcf2" released by "delete_volume" :: held 0.846s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:56 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-03828751-8cc2-4e6f-8b6d-78a812ff6fef tempest-VolumeQuotasAdminTestJSON-1660255531 None] Created reservations ['d76d863d-3366-4cd7-88db-b64614c2eeca', '85e6be88-9060-4e73-8046-4545dee70eb3', '2f8d134e-eeff-4e24-a525-db07a247481d', 'b81fc410-b25d-4ff9-99d0-f4d74919873a'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:54:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-03828751-8cc2-4e6f-8b6d-78a812ff6fef tempest-VolumeQuotasAdminTestJSON-1660255531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-03828751-8cc2-4e6f-8b6d-78a812ff6fef tempest-VolumeQuotasAdminTestJSON-1660255531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:56 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-03828751-8cc2-4e6f-8b6d-78a812ff6fef tempest-VolumeQuotasAdminTestJSON-1660255531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:56 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-03828751-8cc2-4e6f-8b6d-78a812ff6fef tempest-VolumeQuotasAdminTestJSON-1660255531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-03828751-8cc2-4e6f-8b6d-78a812ff6fef tempest-VolumeQuotasAdminTestJSON-1660255531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-03828751-8cc2-4e6f-8b6d-78a812ff6fef tempest-VolumeQuotasAdminTestJSON-1660255531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:56 devstack sudo[96006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:54:56 devstack sudo[96006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:56 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-44af1290-7027-49bf-8771-3d0b8606da65 tempest-GroupsTest-311468979 None] Acquiring lock "cinder-quobyte-471a9f42-cc36-42a0-beab-cca107a64278" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:56 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-44af1290-7027-49bf-8771-3d0b8606da65 tempest-GroupsTest-311468979 None] Lock "cinder-quobyte-471a9f42-cc36-42a0-beab-cca107a64278" acquired by "delete_volume" :: waited 0.030s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:56 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da23d05-e9fc-4a23-b85e-21ac264a75f3]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-44af1290-7027-49bf-8771-3d0b8606da65 tempest-GroupsTest-311468979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-471a9f42-cc36-42a0-beab-cca107a64278 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:56 devstack sudo[96011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-471a9f42-cc36-42a0-beab-cca107a64278 Jul 30 16:54:56 devstack sudo[96011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:56 devstack sudo[96003]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:56 devstack sudo[96006]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [req-5ed3c4fb-ab0c-4821-8684-078a0c605291 req-aadf51ab-6a70-4de9-ba6d-836481e99ce2 tempest-VolumesSnapshotsTestJSON-1548411211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-800d6bc4-98f5-4551-8640-100940a09d76 1073741824" returned: 0 in 0.591s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-03828751-8cc2-4e6f-8b6d-78a812ff6fef tempest-VolumeQuotasAdminTestJSON-1660255531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.361s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:56 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-03828751-8cc2-4e6f-8b6d-78a812ff6fef tempest-VolumeQuotasAdminTestJSON-1660255531 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:54:56 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-03828751-8cc2-4e6f-8b6d-78a812ff6fef tempest-VolumeQuotasAdminTestJSON-1660255531 None] Deleted volume successfully. Jul 30 16:54:56 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-03828751-8cc2-4e6f-8b6d-78a812ff6fef tempest-VolumeQuotasAdminTestJSON-1660255531 None] Lock "cinder-b15598bc-e1b2-4ace-af8f-22add7a3dcf2-delete_volume" released by "delete_volume" :: held 1.468s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [req-5ed3c4fb-ab0c-4821-8684-078a0c605291 req-aadf51ab-6a70-4de9-ba6d-836481e99ce2 tempest-VolumesSnapshotsTestJSON-1548411211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-800d6bc4-98f5-4551-8640-100940a09d76 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:56 devstack sudo[96015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-800d6bc4-98f5-4551-8640-100940a09d76 Jul 30 16:54:56 devstack sudo[96015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:57 devstack sudo[96011]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-44af1290-7027-49bf-8771-3d0b8606da65 tempest-GroupsTest-311468979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-471a9f42-cc36-42a0-beab-cca107a64278" returned: 0 in 0.447s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-44af1290-7027-49bf-8771-3d0b8606da65 tempest-GroupsTest-311468979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-471a9f42-cc36-42a0-beab-cca107a64278 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:57 devstack sudo[96020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-471a9f42-cc36-42a0-beab-cca107a64278 Jul 30 16:54:57 devstack sudo[96020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:57 devstack sudo[96015]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [req-5ed3c4fb-ab0c-4821-8684-078a0c605291 req-aadf51ab-6a70-4de9-ba6d-836481e99ce2 tempest-VolumesSnapshotsTestJSON-1548411211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-800d6bc4-98f5-4551-8640-100940a09d76" returned: 0 in 0.351s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:57 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [req-5ed3c4fb-ab0c-4821-8684-078a0c605291 req-aadf51ab-6a70-4de9-ba6d-836481e99ce2 tempest-VolumesSnapshotsTestJSON-1548411211 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:54:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-5ed3c4fb-ab0c-4821-8684-078a0c605291 req-aadf51ab-6a70-4de9-ba6d-836481e99ce2 tempest-VolumesSnapshotsTestJSON-1548411211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:57 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [req-5ed3c4fb-ab0c-4821-8684-078a0c605291 req-aadf51ab-6a70-4de9-ba6d-836481e99ce2 tempest-VolumesSnapshotsTestJSON-1548411211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d81336c8-34f3-4078-af6e-6842aca52d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-800d6bc4-98f5-4551-8640-100940a09d76', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:57 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [req-5ed3c4fb-ab0c-4821-8684-078a0c605291 req-aadf51ab-6a70-4de9-ba6d-836481e99ce2 tempest-VolumesSnapshotsTestJSON-1548411211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2b13d34-8bba-4a4f-b1fa-1f5af709078c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:57 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [req-5ed3c4fb-ab0c-4821-8684-078a0c605291 req-aadf51ab-6a70-4de9-ba6d-836481e99ce2 tempest-VolumesSnapshotsTestJSON-1548411211 None] Volume volume-800d6bc4-98f5-4551-8640-100940a09d76 (800d6bc4-98f5-4551-8640-100940a09d76): created successfully Jul 30 16:54:57 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [req-5ed3c4fb-ab0c-4821-8684-078a0c605291 req-aadf51ab-6a70-4de9-ba6d-836481e99ce2 tempest-VolumesSnapshotsTestJSON-1548411211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2b13d34-8bba-4a4f-b1fa-1f5af709078c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:57 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [req-5ed3c4fb-ab0c-4821-8684-078a0c605291 req-aadf51ab-6a70-4de9-ba6d-836481e99ce2 tempest-VolumesSnapshotsTestJSON-1548411211 None] Flow 'volume_create_manager' (c830ef1b-8351-427f-8641-29adb72c6560) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:54:57 devstack cinder-volume[88568]: INFO cinder.volume.manager [req-5ed3c4fb-ab0c-4821-8684-078a0c605291 req-aadf51ab-6a70-4de9-ba6d-836481e99ce2 tempest-VolumesSnapshotsTestJSON-1548411211 None] Created volume successfully. Jul 30 16:54:57 devstack sudo[96020]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-44af1290-7027-49bf-8771-3d0b8606da65 tempest-GroupsTest-311468979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-471a9f42-cc36-42a0-beab-cca107a64278" returned: 0 in 0.380s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:57 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-44af1290-7027-49bf-8771-3d0b8606da65 tempest-GroupsTest-311468979 None] Lock "cinder-quobyte-471a9f42-cc36-42a0-beab-cca107a64278" released by "delete_volume" :: held 0.878s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:57 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-44af1290-7027-49bf-8771-3d0b8606da65 tempest-GroupsTest-311468979 None] Acquiring lock "cinder-quobyte-85282911-bb3b-48be-9b09-826db6ea7bb3" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:57 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-44af1290-7027-49bf-8771-3d0b8606da65 tempest-GroupsTest-311468979 None] Lock "cinder-quobyte-85282911-bb3b-48be-9b09-826db6ea7bb3" acquired by "delete_volume" :: waited 0.016s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:57 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[7623717d-7156-47e8-9be3-f5143c53acd0]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-44af1290-7027-49bf-8771-3d0b8606da65 tempest-GroupsTest-311468979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-85282911-bb3b-48be-9b09-826db6ea7bb3 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:57 devstack sudo[96024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-85282911-bb3b-48be-9b09-826db6ea7bb3 Jul 30 16:54:57 devstack sudo[96024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:57 devstack sudo[96024]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-44af1290-7027-49bf-8771-3d0b8606da65 tempest-GroupsTest-311468979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-85282911-bb3b-48be-9b09-826db6ea7bb3" returned: 0 in 0.420s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-44af1290-7027-49bf-8771-3d0b8606da65 tempest-GroupsTest-311468979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-85282911-bb3b-48be-9b09-826db6ea7bb3 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:57 devstack sudo[96030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-85282911-bb3b-48be-9b09-826db6ea7bb3 Jul 30 16:54:57 devstack sudo[96030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:57 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-86564d54-d475-48c2-ab3e-3f24c9731ab6 tempest-ServerActionsTestOtherA-332393488 None] Acquiring lock "cinder-60604682-ec4c-4fb2-937a-7cf43dbcc110-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:58 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-86564d54-d475-48c2-ab3e-3f24c9731ab6 tempest-ServerActionsTestOtherA-332393488 None] Lock "cinder-60604682-ec4c-4fb2-937a-7cf43dbcc110-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:58 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-86564d54-d475-48c2-ab3e-3f24c9731ab6 tempest-ServerActionsTestOtherA-332393488 None] Acquiring lock "cinder-quobyte-60604682-ec4c-4fb2-937a-7cf43dbcc110" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:58 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-86564d54-d475-48c2-ab3e-3f24c9731ab6 tempest-ServerActionsTestOtherA-332393488 None] Lock "cinder-quobyte-60604682-ec4c-4fb2-937a-7cf43dbcc110" acquired by "delete_volume" :: waited 0.014s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:58 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[9293eab2-acf6-40a3-8f42-f5ab5a41d400]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-86564d54-d475-48c2-ab3e-3f24c9731ab6 tempest-ServerActionsTestOtherA-332393488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-60604682-ec4c-4fb2-937a-7cf43dbcc110 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:58 devstack sudo[96032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-60604682-ec4c-4fb2-937a-7cf43dbcc110 Jul 30 16:54:58 devstack sudo[96032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:58 devstack sudo[96030]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-44af1290-7027-49bf-8771-3d0b8606da65 tempest-GroupsTest-311468979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-85282911-bb3b-48be-9b09-826db6ea7bb3" returned: 0 in 0.318s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:58 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-44af1290-7027-49bf-8771-3d0b8606da65 tempest-GroupsTest-311468979 None] Lock "cinder-quobyte-85282911-bb3b-48be-9b09-826db6ea7bb3" released by "delete_volume" :: held 0.786s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:58 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-44af1290-7027-49bf-8771-3d0b8606da65 tempest-GroupsTest-311468979 None] Created reservations ['ec86caeb-c121-4d8c-991b-0d6fcaf602dd'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:54:58 devstack cinder-volume[88568]: WARNING cinder.quota [None req-44af1290-7027-49bf-8771-3d0b8606da65 tempest-GroupsTest-311468979 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-64020882 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-64020882, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:54:58 devstack cinder-volume[88568]: WARNING cinder.quota [None req-44af1290-7027-49bf-8771-3d0b8606da65 tempest-GroupsTest-311468979 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-64020882 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-64020882, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:54:58 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-44af1290-7027-49bf-8771-3d0b8606da65 tempest-GroupsTest-311468979 None] Created reservations ['936846ec-8380-4f45-9808-6172c445cb03', '1d9b72d5-99de-457d-bbbe-9b703256cda4', '32be51cd-38dc-4207-8283-96649a2d52e2', '8f10d756-0f2a-4358-86c3-3590ff1845b8'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:54:58 devstack sudo[96032]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-86564d54-d475-48c2-ab3e-3f24c9731ab6 tempest-ServerActionsTestOtherA-332393488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-60604682-ec4c-4fb2-937a-7cf43dbcc110" returned: 0 in 0.522s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-86564d54-d475-48c2-ab3e-3f24c9731ab6 tempest-ServerActionsTestOtherA-332393488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-60604682-ec4c-4fb2-937a-7cf43dbcc110 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-a6f0472d-8e22-4e23-8583-feadc14c9930 req-8311700b-e5b4-433b-9c9c-ac7234168a31 tempest-VolumesSnapshotsTestJSON-1548411211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-a6f0472d-8e22-4e23-8583-feadc14c9930 req-8311700b-e5b4-433b-9c9c-ac7234168a31 tempest-VolumesSnapshotsTestJSON-1548411211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:58 devstack sudo[96038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-60604682-ec4c-4fb2-937a-7cf43dbcc110 Jul 30 16:54:58 devstack sudo[96038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:58 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [req-a6f0472d-8e22-4e23-8583-feadc14c9930 req-8311700b-e5b4-433b-9c9c-ac7234168a31 tempest-VolumesSnapshotsTestJSON-1548411211 None] Creating offline snapshot 25cae593-306a-418a-8367-9cac30a456bc of volume 800d6bc4-98f5-4551-8640-100940a09d76 {{(pid=88568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:54:58 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[375237b8-a151-485f-8db3-65f6ded27e1c]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [req-a6f0472d-8e22-4e23-8583-feadc14c9930 req-8311700b-e5b4-433b-9c9c-ac7234168a31 tempest-VolumesSnapshotsTestJSON-1548411211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-800d6bc4-98f5-4551-8640-100940a09d76 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:58 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-44af1290-7027-49bf-8771-3d0b8606da65 tempest-GroupsTest-311468979 None] Created reservations ['4ade5f47-0215-428c-85ec-e65e6bb4da3c', '9aae1ea9-9032-4a49-ae20-aaced5035401', '55a762aa-267d-4f60-8db8-6091d8f1ac5e', 'f5330ca5-1ac0-430f-b6d9-99817d4b972d'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:54:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-44af1290-7027-49bf-8771-3d0b8606da65 tempest-GroupsTest-311468979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-44af1290-7027-49bf-8771-3d0b8606da65 tempest-GroupsTest-311468979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:58 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-44af1290-7027-49bf-8771-3d0b8606da65 tempest-GroupsTest-311468979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:58 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-44af1290-7027-49bf-8771-3d0b8606da65 tempest-GroupsTest-311468979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-44af1290-7027-49bf-8771-3d0b8606da65 tempest-GroupsTest-311468979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-44af1290-7027-49bf-8771-3d0b8606da65 tempest-GroupsTest-311468979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:58 devstack sudo[96040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-800d6bc4-98f5-4551-8640-100940a09d76 Jul 30 16:54:58 devstack sudo[96041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:54:58 devstack sudo[96040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:58 devstack sudo[96041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:58 devstack sudo[96038]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-86564d54-d475-48c2-ab3e-3f24c9731ab6 tempest-ServerActionsTestOtherA-332393488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-60604682-ec4c-4fb2-937a-7cf43dbcc110" returned: 0 in 0.350s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:58 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-86564d54-d475-48c2-ab3e-3f24c9731ab6 tempest-ServerActionsTestOtherA-332393488 None] Lock "cinder-quobyte-60604682-ec4c-4fb2-937a-7cf43dbcc110" released by "delete_volume" :: held 0.935s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:59 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-86564d54-d475-48c2-ab3e-3f24c9731ab6 tempest-ServerActionsTestOtherA-332393488 None] Created reservations ['cc53c8c0-8bad-439b-93a1-2f6b35817f15', 'b93fa874-5910-4e8e-a893-216167fd3a30', 'ca048ac1-7450-4653-8bae-55be35ba07a5', 'b9ddaebc-7e2f-4dea-97fe-7fb72312ae79'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:54:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-86564d54-d475-48c2-ab3e-3f24c9731ab6 tempest-ServerActionsTestOtherA-332393488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-86564d54-d475-48c2-ab3e-3f24c9731ab6 tempest-ServerActionsTestOtherA-332393488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:59 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-86564d54-d475-48c2-ab3e-3f24c9731ab6 tempest-ServerActionsTestOtherA-332393488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:59 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-86564d54-d475-48c2-ab3e-3f24c9731ab6 tempest-ServerActionsTestOtherA-332393488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-86564d54-d475-48c2-ab3e-3f24c9731ab6 tempest-ServerActionsTestOtherA-332393488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-86564d54-d475-48c2-ab3e-3f24c9731ab6 tempest-ServerActionsTestOtherA-332393488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:59 devstack sudo[96045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:54:59 devstack sudo[96045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:59 devstack sudo[96041]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-44af1290-7027-49bf-8771-3d0b8606da65 tempest-GroupsTest-311468979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.538s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:59 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-44af1290-7027-49bf-8771-3d0b8606da65 tempest-GroupsTest-311468979 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:54:59 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-44af1290-7027-49bf-8771-3d0b8606da65 tempest-GroupsTest-311468979 None] Delete group completed successfully. Jul 30 16:54:59 devstack sudo[96040]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [req-a6f0472d-8e22-4e23-8583-feadc14c9930 req-8311700b-e5b4-433b-9c9c-ac7234168a31 tempest-VolumesSnapshotsTestJSON-1548411211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-800d6bc4-98f5-4551-8640-100940a09d76" returned: 0 in 0.831s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [req-a6f0472d-8e22-4e23-8583-feadc14c9930 req-8311700b-e5b4-433b-9c9c-ac7234168a31 tempest-VolumesSnapshotsTestJSON-1548411211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-800d6bc4-98f5-4551-8640-100940a09d76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-800d6bc4-98f5-4551-8640-100940a09d76.25cae593-306a-418a-8367-9cac30a456bc 1G {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:59 devstack sudo[96052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-800d6bc4-98f5-4551-8640-100940a09d76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-800d6bc4-98f5-4551-8640-100940a09d76.25cae593-306a-418a-8367-9cac30a456bc 1G Jul 30 16:54:59 devstack sudo[96052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:59 devstack sudo[96045]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-86564d54-d475-48c2-ab3e-3f24c9731ab6 tempest-ServerActionsTestOtherA-332393488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.502s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:59 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-86564d54-d475-48c2-ab3e-3f24c9731ab6 tempest-ServerActionsTestOtherA-332393488 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:54:59 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-86564d54-d475-48c2-ab3e-3f24c9731ab6 tempest-ServerActionsTestOtherA-332393488 None] Deleted volume successfully. Jul 30 16:54:59 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-86564d54-d475-48c2-ab3e-3f24c9731ab6 tempest-ServerActionsTestOtherA-332393488 None] Lock "cinder-60604682-ec4c-4fb2-937a-7cf43dbcc110-delete_volume" released by "delete_volume" :: held 1.738s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:00 devstack sudo[96052]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:00 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [req-a6f0472d-8e22-4e23-8583-feadc14c9930 req-8311700b-e5b4-433b-9c9c-ac7234168a31 tempest-VolumesSnapshotsTestJSON-1548411211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-800d6bc4-98f5-4551-8640-100940a09d76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-800d6bc4-98f5-4551-8640-100940a09d76.25cae593-306a-418a-8367-9cac30a456bc 1G" returned: 0 in 0.723s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:00 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [req-a6f0472d-8e22-4e23-8583-feadc14c9930 req-8311700b-e5b4-433b-9c9c-ac7234168a31 tempest-VolumesSnapshotsTestJSON-1548411211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-800d6bc4-98f5-4551-8640-100940a09d76 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-800d6bc4-98f5-4551-8640-100940a09d76.25cae593-306a-418a-8367-9cac30a456bc {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:00 devstack sudo[96130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-800d6bc4-98f5-4551-8640-100940a09d76 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-800d6bc4-98f5-4551-8640-100940a09d76.25cae593-306a-418a-8367-9cac30a456bc Jul 30 16:55:00 devstack sudo[96130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:00 devstack sudo[96130]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:00 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [req-a6f0472d-8e22-4e23-8583-feadc14c9930 req-8311700b-e5b4-433b-9c9c-ac7234168a31 tempest-VolumesSnapshotsTestJSON-1548411211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-800d6bc4-98f5-4551-8640-100940a09d76 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-800d6bc4-98f5-4551-8640-100940a09d76.25cae593-306a-418a-8367-9cac30a456bc" returned: 0 in 0.551s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:00 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [req-a6f0472d-8e22-4e23-8583-feadc14c9930 req-8311700b-e5b4-433b-9c9c-ac7234168a31 tempest-VolumesSnapshotsTestJSON-1548411211 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-800d6bc4-98f5-4551-8640-100940a09d76.25cae593-306a-418a-8367-9cac30a456bc is being set with open permissions: ugo+rw Jul 30 16:55:00 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [req-a6f0472d-8e22-4e23-8583-feadc14c9930 req-8311700b-e5b4-433b-9c9c-ac7234168a31 tempest-VolumesSnapshotsTestJSON-1548411211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-800d6bc4-98f5-4551-8640-100940a09d76.25cae593-306a-418a-8367-9cac30a456bc {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:00 devstack sudo[96310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-800d6bc4-98f5-4551-8640-100940a09d76.25cae593-306a-418a-8367-9cac30a456bc Jul 30 16:55:00 devstack sudo[96310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:01 devstack sudo[96310]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [req-a6f0472d-8e22-4e23-8583-feadc14c9930 req-8311700b-e5b4-433b-9c9c-ac7234168a31 tempest-VolumesSnapshotsTestJSON-1548411211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-800d6bc4-98f5-4551-8640-100940a09d76.25cae593-306a-418a-8367-9cac30a456bc" returned: 0 in 0.399s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [req-a6f0472d-8e22-4e23-8583-feadc14c9930 req-8311700b-e5b4-433b-9c9c-ac7234168a31 tempest-VolumesSnapshotsTestJSON-1548411211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-800d6bc4-98f5-4551-8640-100940a09d76.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:01 devstack sudo[96419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-800d6bc4-98f5-4551-8640-100940a09d76.info Jul 30 16:55:01 devstack sudo[96419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:01 devstack sudo[96419]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [req-a6f0472d-8e22-4e23-8583-feadc14c9930 req-8311700b-e5b4-433b-9c9c-ac7234168a31 tempest-VolumesSnapshotsTestJSON-1548411211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-800d6bc4-98f5-4551-8640-100940a09d76.info" returned: 0 in 0.299s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:01 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [req-a6f0472d-8e22-4e23-8583-feadc14c9930 req-8311700b-e5b4-433b-9c9c-ac7234168a31 tempest-VolumesSnapshotsTestJSON-1548411211 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-800d6bc4-98f5-4551-8640-100940a09d76.info is being set with open permissions: ugo+rw Jul 30 16:55:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [req-a6f0472d-8e22-4e23-8583-feadc14c9930 req-8311700b-e5b4-433b-9c9c-ac7234168a31 tempest-VolumesSnapshotsTestJSON-1548411211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-800d6bc4-98f5-4551-8640-100940a09d76.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:01 devstack sudo[96422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-800d6bc4-98f5-4551-8640-100940a09d76.info Jul 30 16:55:01 devstack sudo[96422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:01 devstack sudo[96422]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [req-a6f0472d-8e22-4e23-8583-feadc14c9930 req-8311700b-e5b4-433b-9c9c-ac7234168a31 tempest-VolumesSnapshotsTestJSON-1548411211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-800d6bc4-98f5-4551-8640-100940a09d76.info" returned: 0 in 0.290s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-a6f0472d-8e22-4e23-8583-feadc14c9930 req-8311700b-e5b4-433b-9c9c-ac7234168a31 tempest-VolumesSnapshotsTestJSON-1548411211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.226s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:01 devstack cinder-volume[88568]: INFO cinder.volume.manager [req-a6f0472d-8e22-4e23-8583-feadc14c9930 req-8311700b-e5b4-433b-9c9c-ac7234168a31 tempest-VolumesSnapshotsTestJSON-1548411211 None] Create snapshot completed successfully Jul 30 16:55:02 devstack cinder-volume[88568]: DEBUG cinder.coordination [req-3dd4ee4d-99c8-4d80-a0f6-83ea05eb7e31 req-f5507b77-4e9d-4ba7-b9dd-080f0da0c56e tempest-VolumesSnapshotsTestJSON-1548411211 None] Acquiring lock "cinder-25cae593-306a-418a-8367-9cac30a456bc-delete_snapshot" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:02 devstack cinder-volume[88568]: DEBUG cinder.coordination [req-3dd4ee4d-99c8-4d80-a0f6-83ea05eb7e31 req-f5507b77-4e9d-4ba7-b9dd-080f0da0c56e tempest-VolumesSnapshotsTestJSON-1548411211 None] Lock "cinder-25cae593-306a-418a-8367-9cac30a456bc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:02 devstack cinder-volume[88568]: DEBUG cinder.coordination [req-3dd4ee4d-99c8-4d80-a0f6-83ea05eb7e31 req-f5507b77-4e9d-4ba7-b9dd-080f0da0c56e tempest-VolumesSnapshotsTestJSON-1548411211 None] Acquiring lock "cinder-quobyte-800d6bc4-98f5-4551-8640-100940a09d76" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:02 devstack cinder-volume[88568]: DEBUG cinder.coordination [req-3dd4ee4d-99c8-4d80-a0f6-83ea05eb7e31 req-f5507b77-4e9d-4ba7-b9dd-080f0da0c56e tempest-VolumesSnapshotsTestJSON-1548411211 None] Lock "cinder-quobyte-800d6bc4-98f5-4551-8640-100940a09d76" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:02 devstack cinder-volume[88568]: DEBUG cinder.coordination [req-3dd4ee4d-99c8-4d80-a0f6-83ea05eb7e31 req-f5507b77-4e9d-4ba7-b9dd-080f0da0c56e tempest-VolumesSnapshotsTestJSON-1548411211 None] Acquiring lock "cinder-quobyte-25cae593-306a-418a-8367-9cac30a456bc" by "_delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:02 devstack cinder-volume[88568]: DEBUG cinder.coordination [req-3dd4ee4d-99c8-4d80-a0f6-83ea05eb7e31 req-f5507b77-4e9d-4ba7-b9dd-080f0da0c56e tempest-VolumesSnapshotsTestJSON-1548411211 None] Lock "cinder-quobyte-25cae593-306a-418a-8367-9cac30a456bc" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:02 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [req-3dd4ee4d-99c8-4d80-a0f6-83ea05eb7e31 req-f5507b77-4e9d-4ba7-b9dd-080f0da0c56e tempest-VolumesSnapshotsTestJSON-1548411211 None] Deleting offline snapshot 25cae593-306a-418a-8367-9cac30a456bc of volume 800d6bc4-98f5-4551-8640-100940a09d76 {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:55:02 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [req-3dd4ee4d-99c8-4d80-a0f6-83ea05eb7e31 req-f5507b77-4e9d-4ba7-b9dd-080f0da0c56e tempest-VolumesSnapshotsTestJSON-1548411211 None] snapshot_file for this snap is: volume-800d6bc4-98f5-4551-8640-100940a09d76.25cae593-306a-418a-8367-9cac30a456bc {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:55:02 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[79dfb7b3-d194-460c-88b6-8476d960345d]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [req-3dd4ee4d-99c8-4d80-a0f6-83ea05eb7e31 req-f5507b77-4e9d-4ba7-b9dd-080f0da0c56e tempest-VolumesSnapshotsTestJSON-1548411211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-800d6bc4-98f5-4551-8640-100940a09d76.25cae593-306a-418a-8367-9cac30a456bc {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:03 devstack sudo[96431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-800d6bc4-98f5-4551-8640-100940a09d76.25cae593-306a-418a-8367-9cac30a456bc Jul 30 16:55:03 devstack sudo[96431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:03 devstack sudo[96431]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [req-3dd4ee4d-99c8-4d80-a0f6-83ea05eb7e31 req-f5507b77-4e9d-4ba7-b9dd-080f0da0c56e tempest-VolumesSnapshotsTestJSON-1548411211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-800d6bc4-98f5-4551-8640-100940a09d76.25cae593-306a-418a-8367-9cac30a456bc" returned: 0 in 0.495s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:03 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [req-3dd4ee4d-99c8-4d80-a0f6-83ea05eb7e31 req-f5507b77-4e9d-4ba7-b9dd-080f0da0c56e tempest-VolumesSnapshotsTestJSON-1548411211 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-800d6bc4-98f5-4551-8640-100940a09d76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:55:03 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[216347ec-c5dc-4318-81ae-30c606aadaf7]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [req-3dd4ee4d-99c8-4d80-a0f6-83ea05eb7e31 req-f5507b77-4e9d-4ba7-b9dd-080f0da0c56e tempest-VolumesSnapshotsTestJSON-1548411211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-800d6bc4-98f5-4551-8640-100940a09d76 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:03 devstack sudo[96436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-800d6bc4-98f5-4551-8640-100940a09d76 Jul 30 16:55:03 devstack sudo[96436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:03 devstack sudo[96436]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [req-3dd4ee4d-99c8-4d80-a0f6-83ea05eb7e31 req-f5507b77-4e9d-4ba7-b9dd-080f0da0c56e tempest-VolumesSnapshotsTestJSON-1548411211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-800d6bc4-98f5-4551-8640-100940a09d76" returned: 0 in 0.478s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [req-3dd4ee4d-99c8-4d80-a0f6-83ea05eb7e31 req-f5507b77-4e9d-4ba7-b9dd-080f0da0c56e tempest-VolumesSnapshotsTestJSON-1548411211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-800d6bc4-98f5-4551-8640-100940a09d76.25cae593-306a-418a-8367-9cac30a456bc {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:03 devstack sudo[96441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-800d6bc4-98f5-4551-8640-100940a09d76.25cae593-306a-418a-8367-9cac30a456bc Jul 30 16:55:03 devstack sudo[96441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:04 devstack sudo[96441]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [req-3dd4ee4d-99c8-4d80-a0f6-83ea05eb7e31 req-f5507b77-4e9d-4ba7-b9dd-080f0da0c56e tempest-VolumesSnapshotsTestJSON-1548411211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-800d6bc4-98f5-4551-8640-100940a09d76.25cae593-306a-418a-8367-9cac30a456bc" returned: 0 in 0.559s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [req-3dd4ee4d-99c8-4d80-a0f6-83ea05eb7e31 req-f5507b77-4e9d-4ba7-b9dd-080f0da0c56e tempest-VolumesSnapshotsTestJSON-1548411211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-800d6bc4-98f5-4551-8640-100940a09d76.25cae593-306a-418a-8367-9cac30a456bc {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:04 devstack sudo[96449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-800d6bc4-98f5-4551-8640-100940a09d76.25cae593-306a-418a-8367-9cac30a456bc Jul 30 16:55:04 devstack sudo[96449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:04 devstack sudo[96449]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [req-3dd4ee4d-99c8-4d80-a0f6-83ea05eb7e31 req-f5507b77-4e9d-4ba7-b9dd-080f0da0c56e tempest-VolumesSnapshotsTestJSON-1548411211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-800d6bc4-98f5-4551-8640-100940a09d76.25cae593-306a-418a-8367-9cac30a456bc" returned: 0 in 0.292s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:04 devstack cinder-volume[88568]: DEBUG cinder.coordination [req-3dd4ee4d-99c8-4d80-a0f6-83ea05eb7e31 req-f5507b77-4e9d-4ba7-b9dd-080f0da0c56e tempest-VolumesSnapshotsTestJSON-1548411211 None] Lock "cinder-quobyte-25cae593-306a-418a-8367-9cac30a456bc" released by "_delete_snapshot" :: held 1.983s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:04 devstack cinder-volume[88568]: DEBUG cinder.coordination [req-3dd4ee4d-99c8-4d80-a0f6-83ea05eb7e31 req-f5507b77-4e9d-4ba7-b9dd-080f0da0c56e tempest-VolumesSnapshotsTestJSON-1548411211 None] Lock "cinder-quobyte-800d6bc4-98f5-4551-8640-100940a09d76" released by "delete_snapshot" :: held 2.020s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:04 devstack cinder-volume[88568]: DEBUG cinder.quota [req-3dd4ee4d-99c8-4d80-a0f6-83ea05eb7e31 req-f5507b77-4e9d-4ba7-b9dd-080f0da0c56e tempest-VolumesSnapshotsTestJSON-1548411211 None] Created reservations ['ded5a797-8f37-48ad-bc76-2c1b7b23a364', '4d05e97e-b9cb-4969-a5db-62398acdf381', '9ba7a326-6b48-450b-b283-70ff86b90a9c', 'a3b47007-b0fa-4bb4-99d2-27045d16a292'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:55:05 devstack cinder-volume[88568]: INFO cinder.volume.manager [req-3dd4ee4d-99c8-4d80-a0f6-83ea05eb7e31 req-f5507b77-4e9d-4ba7-b9dd-080f0da0c56e tempest-VolumesSnapshotsTestJSON-1548411211 None] Delete snapshot completed successfully. Jul 30 16:55:05 devstack cinder-volume[88568]: DEBUG cinder.coordination [req-3dd4ee4d-99c8-4d80-a0f6-83ea05eb7e31 req-f5507b77-4e9d-4ba7-b9dd-080f0da0c56e tempest-VolumesSnapshotsTestJSON-1548411211 None] Lock "cinder-25cae593-306a-418a-8367-9cac30a456bc-delete_snapshot" released by "delete_snapshot" :: held 2.238s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:05 devstack cinder-volume[88568]: DEBUG cinder.coordination [req-0851ec72-c4f6-47e6-8ee4-e21263c7f112 req-532df257-0027-43c4-8743-7cbcbd99f90e tempest-VolumesSnapshotsTestJSON-1548411211 None] Acquiring lock "cinder-800d6bc4-98f5-4551-8640-100940a09d76-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:05 devstack cinder-volume[88568]: DEBUG cinder.coordination [req-0851ec72-c4f6-47e6-8ee4-e21263c7f112 req-532df257-0027-43c4-8743-7cbcbd99f90e tempest-VolumesSnapshotsTestJSON-1548411211 None] Lock "cinder-800d6bc4-98f5-4551-8640-100940a09d76-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:05 devstack cinder-volume[88568]: DEBUG cinder.coordination [req-0851ec72-c4f6-47e6-8ee4-e21263c7f112 req-532df257-0027-43c4-8743-7cbcbd99f90e tempest-VolumesSnapshotsTestJSON-1548411211 None] Acquiring lock "cinder-quobyte-800d6bc4-98f5-4551-8640-100940a09d76" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:05 devstack cinder-volume[88568]: DEBUG cinder.coordination [req-0851ec72-c4f6-47e6-8ee4-e21263c7f112 req-532df257-0027-43c4-8743-7cbcbd99f90e tempest-VolumesSnapshotsTestJSON-1548411211 None] Lock "cinder-quobyte-800d6bc4-98f5-4551-8640-100940a09d76" acquired by "delete_volume" :: waited 0.026s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:05 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb427764-012a-444b-86ba-183714b80035]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:05 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [req-0851ec72-c4f6-47e6-8ee4-e21263c7f112 req-532df257-0027-43c4-8743-7cbcbd99f90e tempest-VolumesSnapshotsTestJSON-1548411211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-800d6bc4-98f5-4551-8640-100940a09d76 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:05 devstack sudo[96452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-800d6bc4-98f5-4551-8640-100940a09d76 Jul 30 16:55:05 devstack sudo[96452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:05 devstack sudo[96452]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:05 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [req-0851ec72-c4f6-47e6-8ee4-e21263c7f112 req-532df257-0027-43c4-8743-7cbcbd99f90e tempest-VolumesSnapshotsTestJSON-1548411211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-800d6bc4-98f5-4551-8640-100940a09d76" returned: 0 in 0.445s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:05 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [req-0851ec72-c4f6-47e6-8ee4-e21263c7f112 req-532df257-0027-43c4-8743-7cbcbd99f90e tempest-VolumesSnapshotsTestJSON-1548411211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-800d6bc4-98f5-4551-8640-100940a09d76 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:05 devstack sudo[96458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-800d6bc4-98f5-4551-8640-100940a09d76 Jul 30 16:55:05 devstack sudo[96458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:06 devstack sudo[96458]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [req-0851ec72-c4f6-47e6-8ee4-e21263c7f112 req-532df257-0027-43c4-8743-7cbcbd99f90e tempest-VolumesSnapshotsTestJSON-1548411211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-800d6bc4-98f5-4551-8640-100940a09d76" returned: 0 in 0.360s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:06 devstack cinder-volume[88568]: DEBUG cinder.coordination [req-0851ec72-c4f6-47e6-8ee4-e21263c7f112 req-532df257-0027-43c4-8743-7cbcbd99f90e tempest-VolumesSnapshotsTestJSON-1548411211 None] Lock "cinder-quobyte-800d6bc4-98f5-4551-8640-100940a09d76" released by "delete_volume" :: held 0.919s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:06 devstack cinder-volume[88568]: DEBUG cinder.quota [req-0851ec72-c4f6-47e6-8ee4-e21263c7f112 req-532df257-0027-43c4-8743-7cbcbd99f90e tempest-VolumesSnapshotsTestJSON-1548411211 None] Created reservations ['26cfb5c3-5824-43b0-bc35-07a3f5d16a35', 'ffd0bfb8-37e0-4981-bcf6-732e75d52437', 'f238a202-597f-44c0-b37b-fd77d668cd94', '7becf8db-600b-443f-a8d9-4a41ef7ac314'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:55:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-0851ec72-c4f6-47e6-8ee4-e21263c7f112 req-532df257-0027-43c4-8743-7cbcbd99f90e tempest-VolumesSnapshotsTestJSON-1548411211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-0851ec72-c4f6-47e6-8ee4-e21263c7f112 req-532df257-0027-43c4-8743-7cbcbd99f90e tempest-VolumesSnapshotsTestJSON-1548411211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:06 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [req-0851ec72-c4f6-47e6-8ee4-e21263c7f112 req-532df257-0027-43c4-8743-7cbcbd99f90e tempest-VolumesSnapshotsTestJSON-1548411211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:55:06 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [req-0851ec72-c4f6-47e6-8ee4-e21263c7f112 req-532df257-0027-43c4-8743-7cbcbd99f90e tempest-VolumesSnapshotsTestJSON-1548411211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:55:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-0851ec72-c4f6-47e6-8ee4-e21263c7f112 req-532df257-0027-43c4-8743-7cbcbd99f90e tempest-VolumesSnapshotsTestJSON-1548411211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [req-0851ec72-c4f6-47e6-8ee4-e21263c7f112 req-532df257-0027-43c4-8743-7cbcbd99f90e tempest-VolumesSnapshotsTestJSON-1548411211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:06 devstack sudo[96461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:55:06 devstack sudo[96461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:06 devstack sudo[96461]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [req-0851ec72-c4f6-47e6-8ee4-e21263c7f112 req-532df257-0027-43c4-8743-7cbcbd99f90e tempest-VolumesSnapshotsTestJSON-1548411211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.305s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:06 devstack cinder-volume[88568]: DEBUG cinder.manager [req-0851ec72-c4f6-47e6-8ee4-e21263c7f112 req-532df257-0027-43c4-8743-7cbcbd99f90e tempest-VolumesSnapshotsTestJSON-1548411211 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:55:06 devstack cinder-volume[88568]: INFO cinder.volume.manager [req-0851ec72-c4f6-47e6-8ee4-e21263c7f112 req-532df257-0027-43c4-8743-7cbcbd99f90e tempest-VolumesSnapshotsTestJSON-1548411211 None] Deleted volume successfully. Jul 30 16:55:06 devstack cinder-volume[88568]: DEBUG cinder.coordination [req-0851ec72-c4f6-47e6-8ee4-e21263c7f112 req-532df257-0027-43c4-8743-7cbcbd99f90e tempest-VolumesSnapshotsTestJSON-1548411211 None] Lock "cinder-800d6bc4-98f5-4551-8640-100940a09d76-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:08 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-0c8c7007-c17e-4fc3-be50-5576902030f1 tempest-GroupsV320Test-469612667 None] Group tempest-GroupsV320Test-Group-181059939: creating Jul 30 16:55:08 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-0c8c7007-c17e-4fc3-be50-5576902030f1 tempest-GroupsV320Test-469612667 None] Group tempest-GroupsV320Test-Group-181059939: created successfully Jul 30 16:55:08 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-0c8c7007-c17e-4fc3-be50-5576902030f1 tempest-GroupsV320Test-469612667 None] Create group completed successfully. Jul 30 16:55:08 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-75eac596-8e30-4619-bca7-125b504d6cc1 tempest-VolumeRetypeWithoutMigrationTest-458518532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:55:08 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-75eac596-8e30-4619-bca7-125b504d6cc1 tempest-VolumeRetypeWithoutMigrationTest-458518532 None] Flow 'volume_create_manager' (40469476-05fb-46ac-8876-8fb244625508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:55:08 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-75eac596-8e30-4619-bca7-125b504d6cc1 tempest-VolumeRetypeWithoutMigrationTest-458518532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ace83b7f-6b39-4141-a1e0-320d1b838abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:08 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-75eac596-8e30-4619-bca7-125b504d6cc1 tempest-VolumeRetypeWithoutMigrationTest-458518532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ace83b7f-6b39-4141-a1e0-320d1b838abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:55:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1902163977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2146835-1b3d-41d0-8352-aaf77e492628,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7325ec75f2647a0bc44a00348c3d8ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:55:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:55:09Z,use_quota=True,user_id='3c42808751654bd78614933d1a35282a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9caee56d-92dc-4d28-9f5f-589ee6f2e921),volume_type_id=9caee56d-92dc-4d28-9f5f-589ee6f2e921)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:08 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-75eac596-8e30-4619-bca7-125b504d6cc1 tempest-VolumeRetypeWithoutMigrationTest-458518532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cb92bfa-5b30-4b7c-a6ba-16e672787339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:08 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-75eac596-8e30-4619-bca7-125b504d6cc1 tempest-VolumeRetypeWithoutMigrationTest-458518532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cb92bfa-5b30-4b7c-a6ba-16e672787339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:08 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-75eac596-8e30-4619-bca7-125b504d6cc1 tempest-VolumeRetypeWithoutMigrationTest-458518532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbf5ce71-f015-4daf-8d37-70bbf8437dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:08 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-75eac596-8e30-4619-bca7-125b504d6cc1 tempest-VolumeRetypeWithoutMigrationTest-458518532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbf5ce71-f015-4daf-8d37-70bbf8437dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2146835-1b3d-41d0-8352-aaf77e492628', 'volume_name': 'volume-c2146835-1b3d-41d0-8352-aaf77e492628', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:08 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-75eac596-8e30-4619-bca7-125b504d6cc1 tempest-VolumeRetypeWithoutMigrationTest-458518532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f181747-ca8b-4ea2-9896-3390346ef945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:08 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-75eac596-8e30-4619-bca7-125b504d6cc1 tempest-VolumeRetypeWithoutMigrationTest-458518532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f181747-ca8b-4ea2-9896-3390346ef945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:08 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-75eac596-8e30-4619-bca7-125b504d6cc1 tempest-VolumeRetypeWithoutMigrationTest-458518532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f3eda01-4da9-4604-94fa-72ad05620255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:08 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-75eac596-8e30-4619-bca7-125b504d6cc1 tempest-VolumeRetypeWithoutMigrationTest-458518532 None] Volume c2146835-1b3d-41d0-8352-aaf77e492628: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2146835-1b3d-41d0-8352-aaf77e492628', 'volume_size': 1} Jul 30 16:55:08 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-75eac596-8e30-4619-bca7-125b504d6cc1 tempest-VolumeRetypeWithoutMigrationTest-458518532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:08 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-75eac596-8e30-4619-bca7-125b504d6cc1 tempest-VolumeRetypeWithoutMigrationTest-458518532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:08 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-75eac596-8e30-4619-bca7-125b504d6cc1 tempest-VolumeRetypeWithoutMigrationTest-458518532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:55:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1902163977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2146835-1b3d-41d0-8352-aaf77e492628,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7325ec75f2647a0bc44a00348c3d8ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:55:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:55:09Z,use_quota=True,user_id='3c42808751654bd78614933d1a35282a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9caee56d-92dc-4d28-9f5f-589ee6f2e921),volume_type_id=9caee56d-92dc-4d28-9f5f-589ee6f2e921)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:55:08 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-75eac596-8e30-4619-bca7-125b504d6cc1 tempest-VolumeRetypeWithoutMigrationTest-458518532 None] Creating volume c2146835-1b3d-41d0-8352-aaf77e492628 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:55:08 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-75eac596-8e30-4619-bca7-125b504d6cc1 tempest-VolumeRetypeWithoutMigrationTest-458518532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:08 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-75eac596-8e30-4619-bca7-125b504d6cc1 tempest-VolumeRetypeWithoutMigrationTest-458518532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:08 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-75eac596-8e30-4619-bca7-125b504d6cc1 tempest-VolumeRetypeWithoutMigrationTest-458518532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:55:08 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-75eac596-8e30-4619-bca7-125b504d6cc1 tempest-VolumeRetypeWithoutMigrationTest-458518532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:55:08 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-75eac596-8e30-4619-bca7-125b504d6cc1 tempest-VolumeRetypeWithoutMigrationTest-458518532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:08 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-75eac596-8e30-4619-bca7-125b504d6cc1 tempest-VolumeRetypeWithoutMigrationTest-458518532 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:55:08 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-75eac596-8e30-4619-bca7-125b504d6cc1 tempest-VolumeRetypeWithoutMigrationTest-458518532 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 16:55:08 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-75eac596-8e30-4619-bca7-125b504d6cc1 tempest-VolumeRetypeWithoutMigrationTest-458518532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c2146835-1b3d-41d0-8352-aaf77e492628 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:08 devstack sudo[96465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c2146835-1b3d-41d0-8352-aaf77e492628 1073741824 Jul 30 16:55:08 devstack sudo[96465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:09 devstack sudo[96465]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:09 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-75eac596-8e30-4619-bca7-125b504d6cc1 tempest-VolumeRetypeWithoutMigrationTest-458518532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c2146835-1b3d-41d0-8352-aaf77e492628 1073741824" returned: 0 in 0.651s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:09 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-75eac596-8e30-4619-bca7-125b504d6cc1 tempest-VolumeRetypeWithoutMigrationTest-458518532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c2146835-1b3d-41d0-8352-aaf77e492628 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:09 devstack sudo[96473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c2146835-1b3d-41d0-8352-aaf77e492628 Jul 30 16:55:09 devstack sudo[96473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:09 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-5d8e5df4-3d90-4d31-80e7-acd9c56c8b92 tempest-GroupsV320Test-469612667 None] Created reservations ['a77bdd6f-0166-4e22-baa3-4acd5129a508'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:55:09 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-5d8e5df4-3d90-4d31-80e7-acd9c56c8b92 tempest-GroupsV320Test-469612667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:09 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-5d8e5df4-3d90-4d31-80e7-acd9c56c8b92 tempest-GroupsV320Test-469612667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:09 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-5d8e5df4-3d90-4d31-80e7-acd9c56c8b92 tempest-GroupsV320Test-469612667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:55:10 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-5d8e5df4-3d90-4d31-80e7-acd9c56c8b92 tempest-GroupsV320Test-469612667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:55:10 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-5d8e5df4-3d90-4d31-80e7-acd9c56c8b92 tempest-GroupsV320Test-469612667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:10 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-5d8e5df4-3d90-4d31-80e7-acd9c56c8b92 tempest-GroupsV320Test-469612667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:10 devstack sudo[96473]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:10 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-75eac596-8e30-4619-bca7-125b504d6cc1 tempest-VolumeRetypeWithoutMigrationTest-458518532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c2146835-1b3d-41d0-8352-aaf77e492628" returned: 0 in 0.376s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:10 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-75eac596-8e30-4619-bca7-125b504d6cc1 tempest-VolumeRetypeWithoutMigrationTest-458518532 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:55:10 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-75eac596-8e30-4619-bca7-125b504d6cc1 tempest-VolumeRetypeWithoutMigrationTest-458518532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:10 devstack sudo[96477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:55:10 devstack sudo[96477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:10 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-75eac596-8e30-4619-bca7-125b504d6cc1 tempest-VolumeRetypeWithoutMigrationTest-458518532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f3eda01-4da9-4604-94fa-72ad05620255) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2146835-1b3d-41d0-8352-aaf77e492628', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:10 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-75eac596-8e30-4619-bca7-125b504d6cc1 tempest-VolumeRetypeWithoutMigrationTest-458518532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeafc5c3-fc60-4675-975f-7c29a2c17f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:10 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-75eac596-8e30-4619-bca7-125b504d6cc1 tempest-VolumeRetypeWithoutMigrationTest-458518532 None] Volume volume-c2146835-1b3d-41d0-8352-aaf77e492628 (c2146835-1b3d-41d0-8352-aaf77e492628): created successfully Jul 30 16:55:10 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-75eac596-8e30-4619-bca7-125b504d6cc1 tempest-VolumeRetypeWithoutMigrationTest-458518532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeafc5c3-fc60-4675-975f-7c29a2c17f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:10 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-75eac596-8e30-4619-bca7-125b504d6cc1 tempest-VolumeRetypeWithoutMigrationTest-458518532 None] Flow 'volume_create_manager' (40469476-05fb-46ac-8876-8fb244625508) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:55:10 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-75eac596-8e30-4619-bca7-125b504d6cc1 tempest-VolumeRetypeWithoutMigrationTest-458518532 None] Created volume successfully. Jul 30 16:55:10 devstack sudo[96477]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:10 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-5d8e5df4-3d90-4d31-80e7-acd9c56c8b92 tempest-GroupsV320Test-469612667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.341s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:10 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-5d8e5df4-3d90-4d31-80e7-acd9c56c8b92 tempest-GroupsV320Test-469612667 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:55:10 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-5d8e5df4-3d90-4d31-80e7-acd9c56c8b92 tempest-GroupsV320Test-469612667 None] Delete group completed successfully. Jul 30 16:55:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-05f3fc21-8de3-457d-9d29-1ffe0e2ad06a tempest-VolumeRetypeWithoutMigrationTest-458518532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-05f3fc21-8de3-457d-9d29-1ffe0e2ad06a tempest-VolumeRetypeWithoutMigrationTest-458518532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:11 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-05f3fc21-8de3-457d-9d29-1ffe0e2ad06a tempest-VolumeRetypeWithoutMigrationTest-458518532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:55:11 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-05f3fc21-8de3-457d-9d29-1ffe0e2ad06a tempest-VolumeRetypeWithoutMigrationTest-458518532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:55:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-05f3fc21-8de3-457d-9d29-1ffe0e2ad06a tempest-VolumeRetypeWithoutMigrationTest-458518532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-05f3fc21-8de3-457d-9d29-1ffe0e2ad06a tempest-VolumeRetypeWithoutMigrationTest-458518532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:11 devstack sudo[96482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:55:11 devstack sudo[96482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:11 devstack sudo[96482]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-05f3fc21-8de3-457d-9d29-1ffe0e2ad06a tempest-VolumeRetypeWithoutMigrationTest-458518532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.266s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:11 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-05f3fc21-8de3-457d-9d29-1ffe0e2ad06a tempest-VolumeRetypeWithoutMigrationTest-458518532 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:55:11 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-05f3fc21-8de3-457d-9d29-1ffe0e2ad06a tempest-VolumeRetypeWithoutMigrationTest-458518532 None] Retype volume completed successfully. Jul 30 16:55:12 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-adf3e888-cfd9-468d-b8c2-96c1ff7e70d2 tempest-GroupSnapshotsV319Test-459903956 None] Group tempest-GroupSnapshotsV319Test-Group-1626338083: creating Jul 30 16:55:12 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-adf3e888-cfd9-468d-b8c2-96c1ff7e70d2 tempest-GroupSnapshotsV319Test-459903956 None] Group tempest-GroupSnapshotsV319Test-Group-1626338083: created successfully Jul 30 16:55:12 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-adf3e888-cfd9-468d-b8c2-96c1ff7e70d2 tempest-GroupSnapshotsV319Test-459903956 None] Create group completed successfully. Jul 30 16:55:12 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-a231d6f6-cb7a-4f93-8898-3a01410ffefa tempest-VolumeRetypeWithoutMigrationTest-458518532 None] Acquiring lock "cinder-c2146835-1b3d-41d0-8352-aaf77e492628-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:12 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-a231d6f6-cb7a-4f93-8898-3a01410ffefa tempest-VolumeRetypeWithoutMigrationTest-458518532 None] Lock "cinder-c2146835-1b3d-41d0-8352-aaf77e492628-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:12 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-a231d6f6-cb7a-4f93-8898-3a01410ffefa tempest-VolumeRetypeWithoutMigrationTest-458518532 None] Acquiring lock "cinder-quobyte-c2146835-1b3d-41d0-8352-aaf77e492628" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:12 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-a231d6f6-cb7a-4f93-8898-3a01410ffefa tempest-VolumeRetypeWithoutMigrationTest-458518532 None] Lock "cinder-quobyte-c2146835-1b3d-41d0-8352-aaf77e492628" acquired by "delete_volume" :: waited 0.017s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:12 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb04358-eda9-4446-b4a9-26027d34c139]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a231d6f6-cb7a-4f93-8898-3a01410ffefa tempest-VolumeRetypeWithoutMigrationTest-458518532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c2146835-1b3d-41d0-8352-aaf77e492628 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:13 devstack sudo[96488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c2146835-1b3d-41d0-8352-aaf77e492628 Jul 30 16:55:13 devstack sudo[96488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:13 devstack sudo[96488]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a231d6f6-cb7a-4f93-8898-3a01410ffefa tempest-VolumeRetypeWithoutMigrationTest-458518532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c2146835-1b3d-41d0-8352-aaf77e492628" returned: 0 in 0.455s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a231d6f6-cb7a-4f93-8898-3a01410ffefa tempest-VolumeRetypeWithoutMigrationTest-458518532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c2146835-1b3d-41d0-8352-aaf77e492628 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:13 devstack sudo[96493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c2146835-1b3d-41d0-8352-aaf77e492628 Jul 30 16:55:13 devstack sudo[96493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:13 devstack sudo[96493]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a231d6f6-cb7a-4f93-8898-3a01410ffefa tempest-VolumeRetypeWithoutMigrationTest-458518532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c2146835-1b3d-41d0-8352-aaf77e492628" returned: 0 in 0.314s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:13 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-a231d6f6-cb7a-4f93-8898-3a01410ffefa tempest-VolumeRetypeWithoutMigrationTest-458518532 None] Lock "cinder-quobyte-c2146835-1b3d-41d0-8352-aaf77e492628" released by "delete_volume" :: held 0.843s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:13 devstack cinder-volume[88568]: WARNING cinder.quota [None req-a231d6f6-cb7a-4f93-8898-3a01410ffefa tempest-VolumeRetypeWithoutMigrationTest-458518532 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:55:13 devstack cinder-volume[88568]: WARNING cinder.quota [None req-a231d6f6-cb7a-4f93-8898-3a01410ffefa tempest-VolumeRetypeWithoutMigrationTest-458518532 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:55:13 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-a231d6f6-cb7a-4f93-8898-3a01410ffefa tempest-VolumeRetypeWithoutMigrationTest-458518532 None] Created reservations ['d2feaa19-b369-42ee-b3b9-1f07f1dea899', 'e849f71d-0f5d-4b8e-857a-a1677e6c7abd', 'a038d8ee-51d6-4a91-906a-d9b01e194f8b', '50de4ddd-5ab8-4344-98c5-eeb5f8ca8562'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:55:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a231d6f6-cb7a-4f93-8898-3a01410ffefa tempest-VolumeRetypeWithoutMigrationTest-458518532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a231d6f6-cb7a-4f93-8898-3a01410ffefa tempest-VolumeRetypeWithoutMigrationTest-458518532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:13 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-a231d6f6-cb7a-4f93-8898-3a01410ffefa tempest-VolumeRetypeWithoutMigrationTest-458518532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:55:13 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-a231d6f6-cb7a-4f93-8898-3a01410ffefa tempest-VolumeRetypeWithoutMigrationTest-458518532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:55:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a231d6f6-cb7a-4f93-8898-3a01410ffefa tempest-VolumeRetypeWithoutMigrationTest-458518532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a231d6f6-cb7a-4f93-8898-3a01410ffefa tempest-VolumeRetypeWithoutMigrationTest-458518532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:14 devstack sudo[96496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:55:14 devstack sudo[96496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:14 devstack sudo[96496]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a231d6f6-cb7a-4f93-8898-3a01410ffefa tempest-VolumeRetypeWithoutMigrationTest-458518532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.516s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:14 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-a231d6f6-cb7a-4f93-8898-3a01410ffefa tempest-VolumeRetypeWithoutMigrationTest-458518532 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:55:14 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-a231d6f6-cb7a-4f93-8898-3a01410ffefa tempest-VolumeRetypeWithoutMigrationTest-458518532 None] Deleted volume successfully. Jul 30 16:55:14 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-a231d6f6-cb7a-4f93-8898-3a01410ffefa tempest-VolumeRetypeWithoutMigrationTest-458518532 None] Lock "cinder-c2146835-1b3d-41d0-8352-aaf77e492628-delete_volume" released by "delete_volume" :: held 1.723s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:14 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fbe3de2-2edf-477e-885d-d6786357f76f tempest-GroupSnapshotsV319Test-459903956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:55:14 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4fbe3de2-2edf-477e-885d-d6786357f76f tempest-GroupSnapshotsV319Test-459903956 None] Flow 'volume_create_manager' (38c27c60-eafd-488e-a18c-abd525f9d879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:55:14 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4fbe3de2-2edf-477e-885d-d6786357f76f tempest-GroupSnapshotsV319Test-459903956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a6c7565-7241-4b82-bd86-d72a6958b0f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:14 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4fbe3de2-2edf-477e-885d-d6786357f76f tempest-GroupSnapshotsV319Test-459903956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a6c7565-7241-4b82-bd86-d72a6958b0f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:55:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-586283160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0206089e-f6e3-4725-8cda-beec4028e127,host='devstack@QuobyteHD#QuobyteHD',id=11dd1e49-dda5-4e16-bef2-a555738fbf50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4317b9aec0214f4dba3c823000a93e03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:55:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:55:15Z,use_quota=True,user_id='803127aa9ce242d0a4687d57df611548',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(812686fe-ff2f-4d76-b894-26ed164d5214),volume_type_id=812686fe-ff2f-4d76-b894-26ed164d5214)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:14 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4fbe3de2-2edf-477e-885d-d6786357f76f tempest-GroupSnapshotsV319Test-459903956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7ed14a9-ea79-4b42-a7e1-0ff084f47dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:14 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4fbe3de2-2edf-477e-885d-d6786357f76f tempest-GroupSnapshotsV319Test-459903956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7ed14a9-ea79-4b42-a7e1-0ff084f47dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:14 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4fbe3de2-2edf-477e-885d-d6786357f76f tempest-GroupSnapshotsV319Test-459903956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ab6f174-56b5-4ea6-9367-1cd2894807b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:14 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4fbe3de2-2edf-477e-885d-d6786357f76f tempest-GroupSnapshotsV319Test-459903956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ab6f174-56b5-4ea6-9367-1cd2894807b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11dd1e49-dda5-4e16-bef2-a555738fbf50', 'volume_name': 'volume-11dd1e49-dda5-4e16-bef2-a555738fbf50', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:14 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4fbe3de2-2edf-477e-885d-d6786357f76f tempest-GroupSnapshotsV319Test-459903956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eff0f4b2-c726-4dbb-a6a2-6d99cef94ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:14 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4fbe3de2-2edf-477e-885d-d6786357f76f tempest-GroupSnapshotsV319Test-459903956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eff0f4b2-c726-4dbb-a6a2-6d99cef94ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:14 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4fbe3de2-2edf-477e-885d-d6786357f76f tempest-GroupSnapshotsV319Test-459903956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (170bc38e-99f6-431f-8668-fc1778d8c833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:14 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-4fbe3de2-2edf-477e-885d-d6786357f76f tempest-GroupSnapshotsV319Test-459903956 None] Volume 11dd1e49-dda5-4e16-bef2-a555738fbf50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11dd1e49-dda5-4e16-bef2-a555738fbf50', 'volume_size': 1} Jul 30 16:55:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-4fbe3de2-2edf-477e-885d-d6786357f76f tempest-GroupSnapshotsV319Test-459903956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-4fbe3de2-2edf-477e-885d-d6786357f76f tempest-GroupSnapshotsV319Test-459903956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:14 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-4fbe3de2-2edf-477e-885d-d6786357f76f tempest-GroupSnapshotsV319Test-459903956 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0206089e-f6e3-4725-8cda-beec4028e127,created_at=2026-07-30T14:55:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-586283160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0206089e-f6e3-4725-8cda-beec4028e127,host='devstack@QuobyteHD#QuobyteHD',id=11dd1e49-dda5-4e16-bef2-a555738fbf50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4317b9aec0214f4dba3c823000a93e03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:55:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:55:15Z,use_quota=True,user_id='803127aa9ce242d0a4687d57df611548',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(812686fe-ff2f-4d76-b894-26ed164d5214),volume_type_id=812686fe-ff2f-4d76-b894-26ed164d5214)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:55:14 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-4fbe3de2-2edf-477e-885d-d6786357f76f tempest-GroupSnapshotsV319Test-459903956 None] Creating volume 11dd1e49-dda5-4e16-bef2-a555738fbf50 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:55:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-4fbe3de2-2edf-477e-885d-d6786357f76f tempest-GroupSnapshotsV319Test-459903956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-4fbe3de2-2edf-477e-885d-d6786357f76f tempest-GroupSnapshotsV319Test-459903956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:14 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-4fbe3de2-2edf-477e-885d-d6786357f76f tempest-GroupSnapshotsV319Test-459903956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:55:14 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-4fbe3de2-2edf-477e-885d-d6786357f76f tempest-GroupSnapshotsV319Test-459903956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:55:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-4fbe3de2-2edf-477e-885d-d6786357f76f tempest-GroupSnapshotsV319Test-459903956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:14 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-4fbe3de2-2edf-477e-885d-d6786357f76f tempest-GroupSnapshotsV319Test-459903956 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:55:14 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-4fbe3de2-2edf-477e-885d-d6786357f76f tempest-GroupSnapshotsV319Test-459903956 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 16:55:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-4fbe3de2-2edf-477e-885d-d6786357f76f tempest-GroupSnapshotsV319Test-459903956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-11dd1e49-dda5-4e16-bef2-a555738fbf50 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:14 devstack sudo[96500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-11dd1e49-dda5-4e16-bef2-a555738fbf50 1073741824 Jul 30 16:55:14 devstack sudo[96500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:15 devstack sudo[96500]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:15 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-4fbe3de2-2edf-477e-885d-d6786357f76f tempest-GroupSnapshotsV319Test-459903956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-11dd1e49-dda5-4e16-bef2-a555738fbf50 1073741824" returned: 0 in 0.716s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:15 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-4fbe3de2-2edf-477e-885d-d6786357f76f tempest-GroupSnapshotsV319Test-459903956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-11dd1e49-dda5-4e16-bef2-a555738fbf50 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:15 devstack sudo[96506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-11dd1e49-dda5-4e16-bef2-a555738fbf50 Jul 30 16:55:15 devstack sudo[96506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:16 devstack sudo[96506]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:16 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-4fbe3de2-2edf-477e-885d-d6786357f76f tempest-GroupSnapshotsV319Test-459903956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-11dd1e49-dda5-4e16-bef2-a555738fbf50" returned: 0 in 0.433s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:16 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-4fbe3de2-2edf-477e-885d-d6786357f76f tempest-GroupSnapshotsV319Test-459903956 None] <== create_volume: return (1217ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:55:16 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-4fbe3de2-2edf-477e-885d-d6786357f76f tempest-GroupSnapshotsV319Test-459903956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.220s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:16 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4fbe3de2-2edf-477e-885d-d6786357f76f tempest-GroupSnapshotsV319Test-459903956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (170bc38e-99f6-431f-8668-fc1778d8c833) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11dd1e49-dda5-4e16-bef2-a555738fbf50', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:16 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4fbe3de2-2edf-477e-885d-d6786357f76f tempest-GroupSnapshotsV319Test-459903956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f9cb83e-a009-42f5-bf0a-c3574fe2eee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:16 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-4fbe3de2-2edf-477e-885d-d6786357f76f tempest-GroupSnapshotsV319Test-459903956 None] Volume volume-11dd1e49-dda5-4e16-bef2-a555738fbf50 (11dd1e49-dda5-4e16-bef2-a555738fbf50): created successfully Jul 30 16:55:16 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4fbe3de2-2edf-477e-885d-d6786357f76f tempest-GroupSnapshotsV319Test-459903956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f9cb83e-a009-42f5-bf0a-c3574fe2eee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:16 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4fbe3de2-2edf-477e-885d-d6786357f76f tempest-GroupSnapshotsV319Test-459903956 None] Flow 'volume_create_manager' (38c27c60-eafd-488e-a18c-abd525f9d879) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:55:16 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-4fbe3de2-2edf-477e-885d-d6786357f76f tempest-GroupSnapshotsV319Test-459903956 None] Created volume successfully. Jul 30 16:55:17 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-ebf09114-bf03-4cca-9169-f78421abaf13 tempest-GroupSnapshotsV319Test-459903956 None] GroupSnapshot 3c957a2a-6487-474c-b797-1fd248a5a913: creating. Jul 30 16:55:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ebf09114-bf03-4cca-9169-f78421abaf13 tempest-GroupSnapshotsV319Test-459903956 None] Group snapshot 3c957a2a-6487-474c-b797-1fd248a5a913: creating. {{(pid=88568) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 30 16:55:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-ebf09114-bf03-4cca-9169-f78421abaf13 tempest-GroupSnapshotsV319Test-459903956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-ebf09114-bf03-4cca-9169-f78421abaf13 tempest-GroupSnapshotsV319Test-459903956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:17 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-ebf09114-bf03-4cca-9169-f78421abaf13 tempest-GroupSnapshotsV319Test-459903956 None] Creating offline snapshot bcea0d6f-b707-4f0e-bb6b-ad059ff5815a of volume 11dd1e49-dda5-4e16-bef2-a555738fbf50 {{(pid=88568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:55:17 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca9fdcc0-af9d-442d-b98e-f84ad4e31e4d]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-ebf09114-bf03-4cca-9169-f78421abaf13 tempest-GroupSnapshotsV319Test-459903956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-11dd1e49-dda5-4e16-bef2-a555738fbf50 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:17 devstack sudo[96509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-11dd1e49-dda5-4e16-bef2-a555738fbf50 Jul 30 16:55:17 devstack sudo[96509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:18 devstack sudo[96509]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-ebf09114-bf03-4cca-9169-f78421abaf13 tempest-GroupSnapshotsV319Test-459903956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-11dd1e49-dda5-4e16-bef2-a555738fbf50" returned: 0 in 0.591s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-ebf09114-bf03-4cca-9169-f78421abaf13 tempest-GroupSnapshotsV319Test-459903956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-11dd1e49-dda5-4e16-bef2-a555738fbf50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-11dd1e49-dda5-4e16-bef2-a555738fbf50.bcea0d6f-b707-4f0e-bb6b-ad059ff5815a 1G {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:18 devstack sudo[96514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-11dd1e49-dda5-4e16-bef2-a555738fbf50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-11dd1e49-dda5-4e16-bef2-a555738fbf50.bcea0d6f-b707-4f0e-bb6b-ad059ff5815a 1G Jul 30 16:55:18 devstack sudo[96514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:18 devstack sudo[96514]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-ebf09114-bf03-4cca-9169-f78421abaf13 tempest-GroupSnapshotsV319Test-459903956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-11dd1e49-dda5-4e16-bef2-a555738fbf50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-11dd1e49-dda5-4e16-bef2-a555738fbf50.bcea0d6f-b707-4f0e-bb6b-ad059ff5815a 1G" returned: 0 in 0.612s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-ebf09114-bf03-4cca-9169-f78421abaf13 tempest-GroupSnapshotsV319Test-459903956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11dd1e49-dda5-4e16-bef2-a555738fbf50 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-11dd1e49-dda5-4e16-bef2-a555738fbf50.bcea0d6f-b707-4f0e-bb6b-ad059ff5815a {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:18 devstack sudo[96520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11dd1e49-dda5-4e16-bef2-a555738fbf50 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-11dd1e49-dda5-4e16-bef2-a555738fbf50.bcea0d6f-b707-4f0e-bb6b-ad059ff5815a Jul 30 16:55:18 devstack sudo[96520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:19 devstack sudo[96520]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:19 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-ebf09114-bf03-4cca-9169-f78421abaf13 tempest-GroupSnapshotsV319Test-459903956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11dd1e49-dda5-4e16-bef2-a555738fbf50 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-11dd1e49-dda5-4e16-bef2-a555738fbf50.bcea0d6f-b707-4f0e-bb6b-ad059ff5815a" returned: 0 in 0.440s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:19 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-ebf09114-bf03-4cca-9169-f78421abaf13 tempest-GroupSnapshotsV319Test-459903956 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-11dd1e49-dda5-4e16-bef2-a555738fbf50.bcea0d6f-b707-4f0e-bb6b-ad059ff5815a is being set with open permissions: ugo+rw: NotImplementedError Jul 30 16:55:19 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-ebf09114-bf03-4cca-9169-f78421abaf13 tempest-GroupSnapshotsV319Test-459903956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-11dd1e49-dda5-4e16-bef2-a555738fbf50.bcea0d6f-b707-4f0e-bb6b-ad059ff5815a {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:19 devstack sudo[96525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-11dd1e49-dda5-4e16-bef2-a555738fbf50.bcea0d6f-b707-4f0e-bb6b-ad059ff5815a Jul 30 16:55:19 devstack sudo[96525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:19 devstack sudo[96525]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:19 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-ebf09114-bf03-4cca-9169-f78421abaf13 tempest-GroupSnapshotsV319Test-459903956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-11dd1e49-dda5-4e16-bef2-a555738fbf50.bcea0d6f-b707-4f0e-bb6b-ad059ff5815a" returned: 0 in 0.482s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:19 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-ebf09114-bf03-4cca-9169-f78421abaf13 tempest-GroupSnapshotsV319Test-459903956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-11dd1e49-dda5-4e16-bef2-a555738fbf50.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:19 devstack sudo[96528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-11dd1e49-dda5-4e16-bef2-a555738fbf50.info Jul 30 16:55:19 devstack sudo[96528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:20 devstack sudo[96528]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-ebf09114-bf03-4cca-9169-f78421abaf13 tempest-GroupSnapshotsV319Test-459903956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-11dd1e49-dda5-4e16-bef2-a555738fbf50.info" returned: 0 in 0.336s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:20 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-ebf09114-bf03-4cca-9169-f78421abaf13 tempest-GroupSnapshotsV319Test-459903956 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-11dd1e49-dda5-4e16-bef2-a555738fbf50.info is being set with open permissions: ugo+rw: NotImplementedError Jul 30 16:55:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-ebf09114-bf03-4cca-9169-f78421abaf13 tempest-GroupSnapshotsV319Test-459903956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-11dd1e49-dda5-4e16-bef2-a555738fbf50.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:20 devstack sudo[96531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-11dd1e49-dda5-4e16-bef2-a555738fbf50.info Jul 30 16:55:20 devstack sudo[96531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:20 devstack sudo[96531]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-ebf09114-bf03-4cca-9169-f78421abaf13 tempest-GroupSnapshotsV319Test-459903956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-11dd1e49-dda5-4e16-bef2-a555738fbf50.info" returned: 0 in 0.329s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-ebf09114-bf03-4cca-9169-f78421abaf13 tempest-GroupSnapshotsV319Test-459903956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.924s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:20 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-ebf09114-bf03-4cca-9169-f78421abaf13 tempest-GroupSnapshotsV319Test-459903956 None] group_snapshot 3c957a2a-6487-474c-b797-1fd248a5a913: created successfully Jul 30 16:55:21 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-f6d798f8-3ae1-4375-949e-e03edc64cb31 tempest-GroupSnapshotsV319Test-459903956 None] group_snapshot 3c957a2a-6487-474c-b797-1fd248a5a913: deleting Jul 30 16:55:21 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f6d798f8-3ae1-4375-949e-e03edc64cb31 tempest-GroupSnapshotsV319Test-459903956 None] group_snapshot 3c957a2a-6487-474c-b797-1fd248a5a913: deleting {{(pid=88568) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 30 16:55:21 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-f6d798f8-3ae1-4375-949e-e03edc64cb31 tempest-GroupSnapshotsV319Test-459903956 None] Acquiring lock "cinder-quobyte-11dd1e49-dda5-4e16-bef2-a555738fbf50" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:21 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-f6d798f8-3ae1-4375-949e-e03edc64cb31 tempest-GroupSnapshotsV319Test-459903956 None] Lock "cinder-quobyte-11dd1e49-dda5-4e16-bef2-a555738fbf50" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:21 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-f6d798f8-3ae1-4375-949e-e03edc64cb31 tempest-GroupSnapshotsV319Test-459903956 None] Acquiring lock "cinder-quobyte-bcea0d6f-b707-4f0e-bb6b-ad059ff5815a" by "_delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:21 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-f6d798f8-3ae1-4375-949e-e03edc64cb31 tempest-GroupSnapshotsV319Test-459903956 None] Lock "cinder-quobyte-bcea0d6f-b707-4f0e-bb6b-ad059ff5815a" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:21 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-f6d798f8-3ae1-4375-949e-e03edc64cb31 tempest-GroupSnapshotsV319Test-459903956 None] Deleting offline snapshot bcea0d6f-b707-4f0e-bb6b-ad059ff5815a of volume 11dd1e49-dda5-4e16-bef2-a555738fbf50 {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:55:21 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-f6d798f8-3ae1-4375-949e-e03edc64cb31 tempest-GroupSnapshotsV319Test-459903956 None] snapshot_file for this snap is: volume-11dd1e49-dda5-4e16-bef2-a555738fbf50.bcea0d6f-b707-4f0e-bb6b-ad059ff5815a {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:55:21 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[e60b60f5-81dc-464c-8a24-b108035a87cb]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:21 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f6d798f8-3ae1-4375-949e-e03edc64cb31 tempest-GroupSnapshotsV319Test-459903956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-11dd1e49-dda5-4e16-bef2-a555738fbf50.bcea0d6f-b707-4f0e-bb6b-ad059ff5815a {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:21 devstack sudo[96534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-11dd1e49-dda5-4e16-bef2-a555738fbf50.bcea0d6f-b707-4f0e-bb6b-ad059ff5815a Jul 30 16:55:21 devstack sudo[96534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:22 devstack sudo[96534]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:22 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f6d798f8-3ae1-4375-949e-e03edc64cb31 tempest-GroupSnapshotsV319Test-459903956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-11dd1e49-dda5-4e16-bef2-a555738fbf50.bcea0d6f-b707-4f0e-bb6b-ad059ff5815a" returned: 0 in 0.548s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:22 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-f6d798f8-3ae1-4375-949e-e03edc64cb31 tempest-GroupSnapshotsV319Test-459903956 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11dd1e49-dda5-4e16-bef2-a555738fbf50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:55:22 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c3c21f-a1b6-4e06-9ba7-498d4c4baf46]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:22 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f6d798f8-3ae1-4375-949e-e03edc64cb31 tempest-GroupSnapshotsV319Test-459903956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-11dd1e49-dda5-4e16-bef2-a555738fbf50 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:22 devstack sudo[96540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-11dd1e49-dda5-4e16-bef2-a555738fbf50 Jul 30 16:55:22 devstack sudo[96540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:22 devstack sudo[96540]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:22 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f6d798f8-3ae1-4375-949e-e03edc64cb31 tempest-GroupSnapshotsV319Test-459903956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-11dd1e49-dda5-4e16-bef2-a555738fbf50" returned: 0 in 0.563s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:22 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f6d798f8-3ae1-4375-949e-e03edc64cb31 tempest-GroupSnapshotsV319Test-459903956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-11dd1e49-dda5-4e16-bef2-a555738fbf50.bcea0d6f-b707-4f0e-bb6b-ad059ff5815a {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:22 devstack sudo[96546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-11dd1e49-dda5-4e16-bef2-a555738fbf50.bcea0d6f-b707-4f0e-bb6b-ad059ff5815a Jul 30 16:55:22 devstack sudo[96546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:23 devstack sudo[96546]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:23 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f6d798f8-3ae1-4375-949e-e03edc64cb31 tempest-GroupSnapshotsV319Test-459903956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-11dd1e49-dda5-4e16-bef2-a555738fbf50.bcea0d6f-b707-4f0e-bb6b-ad059ff5815a" returned: 0 in 0.571s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:23 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f6d798f8-3ae1-4375-949e-e03edc64cb31 tempest-GroupSnapshotsV319Test-459903956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-11dd1e49-dda5-4e16-bef2-a555738fbf50.bcea0d6f-b707-4f0e-bb6b-ad059ff5815a {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:23 devstack sudo[96551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-11dd1e49-dda5-4e16-bef2-a555738fbf50.bcea0d6f-b707-4f0e-bb6b-ad059ff5815a Jul 30 16:55:23 devstack sudo[96551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:23 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ed91f0e-c0a8-4d22-a571-e981eca02880 tempest-VolumesServicesTestJSON-1145887053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:55:23 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7ed91f0e-c0a8-4d22-a571-e981eca02880 tempest-VolumesServicesTestJSON-1145887053 None] Flow 'volume_create_manager' (691d482e-da53-46e7-ba6b-6eef1e8f0503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:55:23 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7ed91f0e-c0a8-4d22-a571-e981eca02880 tempest-VolumesServicesTestJSON-1145887053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a8de6e4-5a12-4b56-8473-2a81c5bc0f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:23 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7ed91f0e-c0a8-4d22-a571-e981eca02880 tempest-VolumesServicesTestJSON-1145887053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a8de6e4-5a12-4b56-8473-2a81c5bc0f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:55:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-751422499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1c992bc-85e5-4036-a17a-ca68c9184c12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cca29009533c4b188e75dce0ea174751',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:55:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:55:23Z,use_quota=True,user_id='90552913a10b4379ba4305dc991269ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:23 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7ed91f0e-c0a8-4d22-a571-e981eca02880 tempest-VolumesServicesTestJSON-1145887053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7da6b1fb-ec6d-401e-a587-ae6e1f1725cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:23 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7ed91f0e-c0a8-4d22-a571-e981eca02880 tempest-VolumesServicesTestJSON-1145887053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7da6b1fb-ec6d-401e-a587-ae6e1f1725cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:23 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7ed91f0e-c0a8-4d22-a571-e981eca02880 tempest-VolumesServicesTestJSON-1145887053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78a85788-4e4e-4ab1-9ed9-d9fbd8ec1564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:23 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7ed91f0e-c0a8-4d22-a571-e981eca02880 tempest-VolumesServicesTestJSON-1145887053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78a85788-4e4e-4ab1-9ed9-d9fbd8ec1564) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1c992bc-85e5-4036-a17a-ca68c9184c12', 'volume_name': 'volume-f1c992bc-85e5-4036-a17a-ca68c9184c12', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:23 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7ed91f0e-c0a8-4d22-a571-e981eca02880 tempest-VolumesServicesTestJSON-1145887053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cbca43c-07e4-47a4-9cc0-3f55bde6a6be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:23 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7ed91f0e-c0a8-4d22-a571-e981eca02880 tempest-VolumesServicesTestJSON-1145887053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cbca43c-07e4-47a4-9cc0-3f55bde6a6be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:23 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7ed91f0e-c0a8-4d22-a571-e981eca02880 tempest-VolumesServicesTestJSON-1145887053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34aa4b3d-1cb1-46ca-884c-e9381805e043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:23 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-7ed91f0e-c0a8-4d22-a571-e981eca02880 tempest-VolumesServicesTestJSON-1145887053 None] Volume f1c992bc-85e5-4036-a17a-ca68c9184c12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1c992bc-85e5-4036-a17a-ca68c9184c12', 'volume_size': 1} Jul 30 16:55:23 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-7ed91f0e-c0a8-4d22-a571-e981eca02880 tempest-VolumesServicesTestJSON-1145887053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:23 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-7ed91f0e-c0a8-4d22-a571-e981eca02880 tempest-VolumesServicesTestJSON-1145887053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:23 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-7ed91f0e-c0a8-4d22-a571-e981eca02880 tempest-VolumesServicesTestJSON-1145887053 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:55:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-751422499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1c992bc-85e5-4036-a17a-ca68c9184c12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cca29009533c4b188e75dce0ea174751',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:55:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:55:23Z,use_quota=True,user_id='90552913a10b4379ba4305dc991269ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:55:23 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-7ed91f0e-c0a8-4d22-a571-e981eca02880 tempest-VolumesServicesTestJSON-1145887053 None] Creating volume f1c992bc-85e5-4036-a17a-ca68c9184c12 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:55:23 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-7ed91f0e-c0a8-4d22-a571-e981eca02880 tempest-VolumesServicesTestJSON-1145887053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:23 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-7ed91f0e-c0a8-4d22-a571-e981eca02880 tempest-VolumesServicesTestJSON-1145887053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:23 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-7ed91f0e-c0a8-4d22-a571-e981eca02880 tempest-VolumesServicesTestJSON-1145887053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:55:23 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-7ed91f0e-c0a8-4d22-a571-e981eca02880 tempest-VolumesServicesTestJSON-1145887053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:55:23 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-7ed91f0e-c0a8-4d22-a571-e981eca02880 tempest-VolumesServicesTestJSON-1145887053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:23 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-7ed91f0e-c0a8-4d22-a571-e981eca02880 tempest-VolumesServicesTestJSON-1145887053 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:55:23 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-7ed91f0e-c0a8-4d22-a571-e981eca02880 tempest-VolumesServicesTestJSON-1145887053 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 16:55:23 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7ed91f0e-c0a8-4d22-a571-e981eca02880 tempest-VolumesServicesTestJSON-1145887053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f1c992bc-85e5-4036-a17a-ca68c9184c12 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:23 devstack sudo[96553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f1c992bc-85e5-4036-a17a-ca68c9184c12 1073741824 Jul 30 16:55:23 devstack sudo[96553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:23 devstack sudo[96551]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:23 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f6d798f8-3ae1-4375-949e-e03edc64cb31 tempest-GroupSnapshotsV319Test-459903956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-11dd1e49-dda5-4e16-bef2-a555738fbf50.bcea0d6f-b707-4f0e-bb6b-ad059ff5815a" returned: 0 in 0.327s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:23 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-f6d798f8-3ae1-4375-949e-e03edc64cb31 tempest-GroupSnapshotsV319Test-459903956 None] Lock "cinder-quobyte-bcea0d6f-b707-4f0e-bb6b-ad059ff5815a" released by "_delete_snapshot" :: held 2.167s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:23 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-f6d798f8-3ae1-4375-949e-e03edc64cb31 tempest-GroupSnapshotsV319Test-459903956 None] Lock "cinder-quobyte-11dd1e49-dda5-4e16-bef2-a555738fbf50" released by "delete_snapshot" :: held 2.213s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:23 devstack cinder-volume[88568]: WARNING cinder.quota [None req-f6d798f8-3ae1-4375-949e-e03edc64cb31 tempest-GroupSnapshotsV319Test-459903956 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-968910615 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-968910615, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:55:23 devstack cinder-volume[88568]: WARNING cinder.quota [None req-f6d798f8-3ae1-4375-949e-e03edc64cb31 tempest-GroupSnapshotsV319Test-459903956 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-968910615 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-968910615, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:55:23 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-f6d798f8-3ae1-4375-949e-e03edc64cb31 tempest-GroupSnapshotsV319Test-459903956 None] Created reservations ['96ec732a-ea74-4f2d-aa39-72fc492b2dc6', '5e41ee57-5b2d-4e14-b80d-36c0471fbbcb', 'd2eeb976-f765-4c64-bd14-48c3321fb7dc', '49e380d7-e083-48d2-8cff-9bffa0d8a4e7'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:55:23 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-f6d798f8-3ae1-4375-949e-e03edc64cb31 tempest-GroupSnapshotsV319Test-459903956 None] group_snapshot 3c957a2a-6487-474c-b797-1fd248a5a913: deleted successfully Jul 30 16:55:24 devstack sudo[96553]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7ed91f0e-c0a8-4d22-a571-e981eca02880 tempest-VolumesServicesTestJSON-1145887053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f1c992bc-85e5-4036-a17a-ca68c9184c12 1073741824" returned: 0 in 0.675s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7ed91f0e-c0a8-4d22-a571-e981eca02880 tempest-VolumesServicesTestJSON-1145887053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f1c992bc-85e5-4036-a17a-ca68c9184c12 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:24 devstack sudo[96561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f1c992bc-85e5-4036-a17a-ca68c9184c12 Jul 30 16:55:24 devstack sudo[96561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:24 devstack sudo[96561]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7ed91f0e-c0a8-4d22-a571-e981eca02880 tempest-VolumesServicesTestJSON-1145887053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f1c992bc-85e5-4036-a17a-ca68c9184c12" returned: 0 in 0.326s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:24 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-7ed91f0e-c0a8-4d22-a571-e981eca02880 tempest-VolumesServicesTestJSON-1145887053 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:55:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-7ed91f0e-c0a8-4d22-a571-e981eca02880 tempest-VolumesServicesTestJSON-1145887053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:24 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7ed91f0e-c0a8-4d22-a571-e981eca02880 tempest-VolumesServicesTestJSON-1145887053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34aa4b3d-1cb1-46ca-884c-e9381805e043) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1c992bc-85e5-4036-a17a-ca68c9184c12', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:24 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7ed91f0e-c0a8-4d22-a571-e981eca02880 tempest-VolumesServicesTestJSON-1145887053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a41881c5-0c05-4926-be2a-66dbfe8d858d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:24 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-7ed91f0e-c0a8-4d22-a571-e981eca02880 tempest-VolumesServicesTestJSON-1145887053 None] Volume volume-f1c992bc-85e5-4036-a17a-ca68c9184c12 (f1c992bc-85e5-4036-a17a-ca68c9184c12): created successfully Jul 30 16:55:24 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7ed91f0e-c0a8-4d22-a571-e981eca02880 tempest-VolumesServicesTestJSON-1145887053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a41881c5-0c05-4926-be2a-66dbfe8d858d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:24 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7ed91f0e-c0a8-4d22-a571-e981eca02880 tempest-VolumesServicesTestJSON-1145887053 None] Flow 'volume_create_manager' (691d482e-da53-46e7-ba6b-6eef1e8f0503) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:55:24 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-7ed91f0e-c0a8-4d22-a571-e981eca02880 tempest-VolumesServicesTestJSON-1145887053 None] Created volume successfully. Jul 30 16:55:25 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-a1182696-1809-4a2c-88b8-c0b80e4c144a tempest-GroupSnapshotsV319Test-459903956 None] Acquiring lock "cinder-quobyte-11dd1e49-dda5-4e16-bef2-a555738fbf50" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:25 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-a1182696-1809-4a2c-88b8-c0b80e4c144a tempest-GroupSnapshotsV319Test-459903956 None] Lock "cinder-quobyte-11dd1e49-dda5-4e16-bef2-a555738fbf50" acquired by "delete_volume" :: waited 0.024s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:25 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[b65bd2b4-0e86-4c6b-82be-0a4181008564]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:25 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a1182696-1809-4a2c-88b8-c0b80e4c144a tempest-GroupSnapshotsV319Test-459903956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-11dd1e49-dda5-4e16-bef2-a555738fbf50 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:25 devstack sudo[96564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-11dd1e49-dda5-4e16-bef2-a555738fbf50 Jul 30 16:55:25 devstack sudo[96564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:25 devstack sudo[96564]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:25 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a1182696-1809-4a2c-88b8-c0b80e4c144a tempest-GroupSnapshotsV319Test-459903956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-11dd1e49-dda5-4e16-bef2-a555738fbf50" returned: 0 in 0.580s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:25 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a1182696-1809-4a2c-88b8-c0b80e4c144a tempest-GroupSnapshotsV319Test-459903956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-11dd1e49-dda5-4e16-bef2-a555738fbf50 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:25 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-05c10fbb-4d34-4fff-83fc-b13273ee6cf8 tempest-VolumesServicesTestJSON-1145887053 None] Acquiring lock "cinder-f1c992bc-85e5-4036-a17a-ca68c9184c12-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:25 devstack sudo[96656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-11dd1e49-dda5-4e16-bef2-a555738fbf50 Jul 30 16:55:25 devstack sudo[96656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:25 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-05c10fbb-4d34-4fff-83fc-b13273ee6cf8 tempest-VolumesServicesTestJSON-1145887053 None] Lock "cinder-f1c992bc-85e5-4036-a17a-ca68c9184c12-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:25 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-05c10fbb-4d34-4fff-83fc-b13273ee6cf8 tempest-VolumesServicesTestJSON-1145887053 None] Acquiring lock "cinder-quobyte-f1c992bc-85e5-4036-a17a-ca68c9184c12" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:25 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-05c10fbb-4d34-4fff-83fc-b13273ee6cf8 tempest-VolumesServicesTestJSON-1145887053 None] Lock "cinder-quobyte-f1c992bc-85e5-4036-a17a-ca68c9184c12" acquired by "delete_volume" :: waited 0.020s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:26 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde577d4-1243-4199-b3b8-28f790b342f9]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-05c10fbb-4d34-4fff-83fc-b13273ee6cf8 tempest-VolumesServicesTestJSON-1145887053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f1c992bc-85e5-4036-a17a-ca68c9184c12 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:26 devstack sudo[96658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f1c992bc-85e5-4036-a17a-ca68c9184c12 Jul 30 16:55:26 devstack sudo[96658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:26 devstack sudo[96656]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a1182696-1809-4a2c-88b8-c0b80e4c144a tempest-GroupSnapshotsV319Test-459903956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-11dd1e49-dda5-4e16-bef2-a555738fbf50" returned: 0 in 0.323s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:26 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-a1182696-1809-4a2c-88b8-c0b80e4c144a tempest-GroupSnapshotsV319Test-459903956 None] Lock "cinder-quobyte-11dd1e49-dda5-4e16-bef2-a555738fbf50" released by "delete_volume" :: held 0.990s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:26 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-a1182696-1809-4a2c-88b8-c0b80e4c144a tempest-GroupSnapshotsV319Test-459903956 None] Created reservations ['9437ed8a-fa90-406d-bdea-a1daac921cd9'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:55:26 devstack cinder-volume[88568]: WARNING cinder.quota [None req-a1182696-1809-4a2c-88b8-c0b80e4c144a tempest-GroupSnapshotsV319Test-459903956 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-968910615 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-968910615, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:55:26 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-a1182696-1809-4a2c-88b8-c0b80e4c144a tempest-GroupSnapshotsV319Test-459903956 None] Created reservations ['99af9b94-023a-4517-817c-861aabb7c423', '903db223-71bb-4e0e-b563-bb845ebfec8b', '51b356a4-e9b5-410a-a73e-c8276705aa68', '6dfda19a-ff7d-4884-81f6-151becdf8396'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:55:26 devstack sudo[96658]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-05c10fbb-4d34-4fff-83fc-b13273ee6cf8 tempest-VolumesServicesTestJSON-1145887053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f1c992bc-85e5-4036-a17a-ca68c9184c12" returned: 0 in 0.494s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-05c10fbb-4d34-4fff-83fc-b13273ee6cf8 tempest-VolumesServicesTestJSON-1145887053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f1c992bc-85e5-4036-a17a-ca68c9184c12 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a1182696-1809-4a2c-88b8-c0b80e4c144a tempest-GroupSnapshotsV319Test-459903956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a1182696-1809-4a2c-88b8-c0b80e4c144a tempest-GroupSnapshotsV319Test-459903956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:26 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-a1182696-1809-4a2c-88b8-c0b80e4c144a tempest-GroupSnapshotsV319Test-459903956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:55:26 devstack sudo[96665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f1c992bc-85e5-4036-a17a-ca68c9184c12 Jul 30 16:55:26 devstack sudo[96665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:26 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-a1182696-1809-4a2c-88b8-c0b80e4c144a tempest-GroupSnapshotsV319Test-459903956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:55:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a1182696-1809-4a2c-88b8-c0b80e4c144a tempest-GroupSnapshotsV319Test-459903956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a1182696-1809-4a2c-88b8-c0b80e4c144a tempest-GroupSnapshotsV319Test-459903956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:26 devstack sudo[96667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:55:26 devstack sudo[96667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:26 devstack sudo[96665]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-05c10fbb-4d34-4fff-83fc-b13273ee6cf8 tempest-VolumesServicesTestJSON-1145887053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f1c992bc-85e5-4036-a17a-ca68c9184c12" returned: 0 in 0.348s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:26 devstack sudo[96667]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a1182696-1809-4a2c-88b8-c0b80e4c144a tempest-GroupSnapshotsV319Test-459903956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.318s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:26 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-a1182696-1809-4a2c-88b8-c0b80e4c144a tempest-GroupSnapshotsV319Test-459903956 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:55:26 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-05c10fbb-4d34-4fff-83fc-b13273ee6cf8 tempest-VolumesServicesTestJSON-1145887053 None] Lock "cinder-quobyte-f1c992bc-85e5-4036-a17a-ca68c9184c12" released by "delete_volume" :: held 0.906s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:26 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-a1182696-1809-4a2c-88b8-c0b80e4c144a tempest-GroupSnapshotsV319Test-459903956 None] Delete group completed successfully. Jul 30 16:55:26 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-05c10fbb-4d34-4fff-83fc-b13273ee6cf8 tempest-VolumesServicesTestJSON-1145887053 None] Created reservations ['bd11ee1f-388e-47db-b541-c4616d8be7f5', '35d8f728-7527-4649-9fae-7b8a33d6f4ad', '6e216a03-05c8-4f1a-895c-1e5152a45c11', '2ee2ea68-73c4-41a7-8ad9-e414a96cfbcc'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:55:27 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-05c10fbb-4d34-4fff-83fc-b13273ee6cf8 tempest-VolumesServicesTestJSON-1145887053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:27 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-05c10fbb-4d34-4fff-83fc-b13273ee6cf8 tempest-VolumesServicesTestJSON-1145887053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:27 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-05c10fbb-4d34-4fff-83fc-b13273ee6cf8 tempest-VolumesServicesTestJSON-1145887053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:55:27 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-05c10fbb-4d34-4fff-83fc-b13273ee6cf8 tempest-VolumesServicesTestJSON-1145887053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:55:27 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-05c10fbb-4d34-4fff-83fc-b13273ee6cf8 tempest-VolumesServicesTestJSON-1145887053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:27 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-05c10fbb-4d34-4fff-83fc-b13273ee6cf8 tempest-VolumesServicesTestJSON-1145887053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:27 devstack sudo[96671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:55:27 devstack sudo[96671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:27 devstack sudo[96671]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:27 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-05c10fbb-4d34-4fff-83fc-b13273ee6cf8 tempest-VolumesServicesTestJSON-1145887053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.262s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:27 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-05c10fbb-4d34-4fff-83fc-b13273ee6cf8 tempest-VolumesServicesTestJSON-1145887053 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:55:27 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-05c10fbb-4d34-4fff-83fc-b13273ee6cf8 tempest-VolumesServicesTestJSON-1145887053 None] Deleted volume successfully. Jul 30 16:55:27 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-05c10fbb-4d34-4fff-83fc-b13273ee6cf8 tempest-VolumesServicesTestJSON-1145887053 None] Lock "cinder-f1c992bc-85e5-4036-a17a-ca68c9184c12-delete_volume" released by "delete_volume" :: held 1.433s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:28 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-60c0a28c-9194-42cc-8168-7080459ebdc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:55:28 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-60c0a28c-9194-42cc-8168-7080459ebdc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] Flow 'volume_create_manager' (45e0b648-7172-43c9-adc9-4329c2de4913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:55:28 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-60c0a28c-9194-42cc-8168-7080459ebdc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0747ec41-626b-4ede-810e-b3cc5ba5532d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:28 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-60c0a28c-9194-42cc-8168-7080459ebdc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0747ec41-626b-4ede-810e-b3cc5ba5532d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:55:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-397368185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64001dde-7bc3-474c-af85-bcd13160e85b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89e419d5250f408fbdca6a95dc2e5b82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:55:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:55:28Z,use_quota=True,user_id='2c14a39c5f834325be539d3fce309f79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:28 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-60c0a28c-9194-42cc-8168-7080459ebdc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3f06dde-92f5-41f6-a25c-bed2cb38ae81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:28 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-60c0a28c-9194-42cc-8168-7080459ebdc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3f06dde-92f5-41f6-a25c-bed2cb38ae81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:28 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-60c0a28c-9194-42cc-8168-7080459ebdc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37ca6f87-f6bd-423c-b9d2-16b08b163775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:28 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-60c0a28c-9194-42cc-8168-7080459ebdc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37ca6f87-f6bd-423c-b9d2-16b08b163775) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64001dde-7bc3-474c-af85-bcd13160e85b', 'volume_name': 'volume-64001dde-7bc3-474c-af85-bcd13160e85b', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:28 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-60c0a28c-9194-42cc-8168-7080459ebdc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d2b3239-b8bc-4bf0-ab13-95a48da0992c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:28 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-60c0a28c-9194-42cc-8168-7080459ebdc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d2b3239-b8bc-4bf0-ab13-95a48da0992c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:28 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-60c0a28c-9194-42cc-8168-7080459ebdc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ece9805-b28e-4851-b4ac-0e6cd5f4c352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:28 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-60c0a28c-9194-42cc-8168-7080459ebdc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] Volume 64001dde-7bc3-474c-af85-bcd13160e85b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64001dde-7bc3-474c-af85-bcd13160e85b', 'volume_size': 1} Jul 30 16:55:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-60c0a28c-9194-42cc-8168-7080459ebdc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-60c0a28c-9194-42cc-8168-7080459ebdc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:28 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-60c0a28c-9194-42cc-8168-7080459ebdc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:55:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-397368185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64001dde-7bc3-474c-af85-bcd13160e85b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89e419d5250f408fbdca6a95dc2e5b82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:55:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:55:28Z,use_quota=True,user_id='2c14a39c5f834325be539d3fce309f79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:55:28 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-60c0a28c-9194-42cc-8168-7080459ebdc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] Creating volume 64001dde-7bc3-474c-af85-bcd13160e85b {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:55:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-60c0a28c-9194-42cc-8168-7080459ebdc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-60c0a28c-9194-42cc-8168-7080459ebdc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:28 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-60c0a28c-9194-42cc-8168-7080459ebdc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:55:28 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-60c0a28c-9194-42cc-8168-7080459ebdc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:55:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-60c0a28c-9194-42cc-8168-7080459ebdc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:28 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-60c0a28c-9194-42cc-8168-7080459ebdc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:55:28 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-60c0a28c-9194-42cc-8168-7080459ebdc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 16:55:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-60c0a28c-9194-42cc-8168-7080459ebdc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-64001dde-7bc3-474c-af85-bcd13160e85b 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:28 devstack sudo[96674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-64001dde-7bc3-474c-af85-bcd13160e85b 1073741824 Jul 30 16:55:28 devstack sudo[96674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:28 devstack sudo[96674]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-60c0a28c-9194-42cc-8168-7080459ebdc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-64001dde-7bc3-474c-af85-bcd13160e85b 1073741824" returned: 0 in 0.594s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-60c0a28c-9194-42cc-8168-7080459ebdc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-64001dde-7bc3-474c-af85-bcd13160e85b {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:28 devstack sudo[96680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-64001dde-7bc3-474c-af85-bcd13160e85b Jul 30 16:55:28 devstack sudo[96680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:29 devstack sudo[96680]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-60c0a28c-9194-42cc-8168-7080459ebdc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-64001dde-7bc3-474c-af85-bcd13160e85b" returned: 0 in 0.292s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:29 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-60c0a28c-9194-42cc-8168-7080459ebdc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:55:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-60c0a28c-9194-42cc-8168-7080459ebdc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:29 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-60c0a28c-9194-42cc-8168-7080459ebdc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ece9805-b28e-4851-b4ac-0e6cd5f4c352) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64001dde-7bc3-474c-af85-bcd13160e85b', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:29 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-60c0a28c-9194-42cc-8168-7080459ebdc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2444fbcc-b5a5-4ed6-bfa3-26dcd477bce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:29 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-60c0a28c-9194-42cc-8168-7080459ebdc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] Volume volume-64001dde-7bc3-474c-af85-bcd13160e85b (64001dde-7bc3-474c-af85-bcd13160e85b): created successfully Jul 30 16:55:29 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-60c0a28c-9194-42cc-8168-7080459ebdc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2444fbcc-b5a5-4ed6-bfa3-26dcd477bce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:29 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-60c0a28c-9194-42cc-8168-7080459ebdc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] Flow 'volume_create_manager' (45e0b648-7172-43c9-adc9-4329c2de4913) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:55:29 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-60c0a28c-9194-42cc-8168-7080459ebdc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] Created volume successfully. Jul 30 16:55:30 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-75a9474a-d276-4292-b8e6-ac54f281c2b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:30 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-75a9474a-d276-4292-b8e6-ac54f281c2b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:30 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-75a9474a-d276-4292-b8e6-ac54f281c2b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] Creating offline snapshot e3179055-1e44-4aef-8ea1-ab9719224b49 of volume 64001dde-7bc3-474c-af85-bcd13160e85b {{(pid=88568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:55:30 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3971eb-2cc9-4367-8ce4-2045f13eb1e6]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:30 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-75a9474a-d276-4292-b8e6-ac54f281c2b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-64001dde-7bc3-474c-af85-bcd13160e85b {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:30 devstack sudo[96683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-64001dde-7bc3-474c-af85-bcd13160e85b Jul 30 16:55:30 devstack sudo[96683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:31 devstack sudo[96683]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:31 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-75a9474a-d276-4292-b8e6-ac54f281c2b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-64001dde-7bc3-474c-af85-bcd13160e85b" returned: 0 in 0.540s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:31 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-75a9474a-d276-4292-b8e6-ac54f281c2b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-64001dde-7bc3-474c-af85-bcd13160e85b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-64001dde-7bc3-474c-af85-bcd13160e85b.e3179055-1e44-4aef-8ea1-ab9719224b49 1G {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:31 devstack sudo[96722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-64001dde-7bc3-474c-af85-bcd13160e85b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-64001dde-7bc3-474c-af85-bcd13160e85b.e3179055-1e44-4aef-8ea1-ab9719224b49 1G Jul 30 16:55:31 devstack sudo[96722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:31 devstack sudo[96722]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:31 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-75a9474a-d276-4292-b8e6-ac54f281c2b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-64001dde-7bc3-474c-af85-bcd13160e85b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-64001dde-7bc3-474c-af85-bcd13160e85b.e3179055-1e44-4aef-8ea1-ab9719224b49 1G" returned: 0 in 0.796s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:31 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-75a9474a-d276-4292-b8e6-ac54f281c2b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64001dde-7bc3-474c-af85-bcd13160e85b -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-64001dde-7bc3-474c-af85-bcd13160e85b.e3179055-1e44-4aef-8ea1-ab9719224b49 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:31 devstack sudo[96732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64001dde-7bc3-474c-af85-bcd13160e85b -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-64001dde-7bc3-474c-af85-bcd13160e85b.e3179055-1e44-4aef-8ea1-ab9719224b49 Jul 30 16:55:31 devstack sudo[96732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:32 devstack sudo[96732]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:32 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-75a9474a-d276-4292-b8e6-ac54f281c2b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64001dde-7bc3-474c-af85-bcd13160e85b -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-64001dde-7bc3-474c-af85-bcd13160e85b.e3179055-1e44-4aef-8ea1-ab9719224b49" returned: 0 in 0.392s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:32 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-75a9474a-d276-4292-b8e6-ac54f281c2b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-64001dde-7bc3-474c-af85-bcd13160e85b.e3179055-1e44-4aef-8ea1-ab9719224b49 is being set with open permissions: ugo+rw Jul 30 16:55:32 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-75a9474a-d276-4292-b8e6-ac54f281c2b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-64001dde-7bc3-474c-af85-bcd13160e85b.e3179055-1e44-4aef-8ea1-ab9719224b49 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:32 devstack sudo[96737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-64001dde-7bc3-474c-af85-bcd13160e85b.e3179055-1e44-4aef-8ea1-ab9719224b49 Jul 30 16:55:32 devstack sudo[96737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:32 devstack sudo[96737]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:32 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-75a9474a-d276-4292-b8e6-ac54f281c2b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-64001dde-7bc3-474c-af85-bcd13160e85b.e3179055-1e44-4aef-8ea1-ab9719224b49" returned: 0 in 0.341s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:32 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-75a9474a-d276-4292-b8e6-ac54f281c2b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-64001dde-7bc3-474c-af85-bcd13160e85b.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:32 devstack sudo[96741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-64001dde-7bc3-474c-af85-bcd13160e85b.info Jul 30 16:55:32 devstack sudo[96741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:32 devstack sudo[96741]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:32 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-75a9474a-d276-4292-b8e6-ac54f281c2b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-64001dde-7bc3-474c-af85-bcd13160e85b.info" returned: 0 in 0.299s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:32 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-75a9474a-d276-4292-b8e6-ac54f281c2b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-64001dde-7bc3-474c-af85-bcd13160e85b.info is being set with open permissions: ugo+rw Jul 30 16:55:32 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-75a9474a-d276-4292-b8e6-ac54f281c2b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-64001dde-7bc3-474c-af85-bcd13160e85b.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:32 devstack sudo[96744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-64001dde-7bc3-474c-af85-bcd13160e85b.info Jul 30 16:55:32 devstack sudo[96744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:33 devstack sudo[96744]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:33 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-75a9474a-d276-4292-b8e6-ac54f281c2b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-64001dde-7bc3-474c-af85-bcd13160e85b.info" returned: 0 in 0.305s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:33 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-75a9474a-d276-4292-b8e6-ac54f281c2b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.839s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:33 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-75a9474a-d276-4292-b8e6-ac54f281c2b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] Create snapshot completed successfully Jul 30 16:55:34 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-1eda7a70-b9f8-4fbe-a429-833185c366ee tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] Acquiring lock "cinder-e3179055-1e44-4aef-8ea1-ab9719224b49-delete_snapshot" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:34 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-1eda7a70-b9f8-4fbe-a429-833185c366ee tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] Lock "cinder-e3179055-1e44-4aef-8ea1-ab9719224b49-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:34 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-1eda7a70-b9f8-4fbe-a429-833185c366ee tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] Acquiring lock "cinder-quobyte-64001dde-7bc3-474c-af85-bcd13160e85b" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:34 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-1eda7a70-b9f8-4fbe-a429-833185c366ee tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] Lock "cinder-quobyte-64001dde-7bc3-474c-af85-bcd13160e85b" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:34 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-1eda7a70-b9f8-4fbe-a429-833185c366ee tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] Acquiring lock "cinder-quobyte-e3179055-1e44-4aef-8ea1-ab9719224b49" by "_delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:34 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-1eda7a70-b9f8-4fbe-a429-833185c366ee tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] Lock "cinder-quobyte-e3179055-1e44-4aef-8ea1-ab9719224b49" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:34 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-1eda7a70-b9f8-4fbe-a429-833185c366ee tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] Deleting offline snapshot e3179055-1e44-4aef-8ea1-ab9719224b49 of volume 64001dde-7bc3-474c-af85-bcd13160e85b {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:55:34 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-1eda7a70-b9f8-4fbe-a429-833185c366ee tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] snapshot_file for this snap is: volume-64001dde-7bc3-474c-af85-bcd13160e85b.e3179055-1e44-4aef-8ea1-ab9719224b49 {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:55:34 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ac7438-7be5-47d2-8321-406e5397c81b]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:34 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-1eda7a70-b9f8-4fbe-a429-833185c366ee tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-64001dde-7bc3-474c-af85-bcd13160e85b.e3179055-1e44-4aef-8ea1-ab9719224b49 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:34 devstack sudo[96763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-64001dde-7bc3-474c-af85-bcd13160e85b.e3179055-1e44-4aef-8ea1-ab9719224b49 Jul 30 16:55:34 devstack sudo[96763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:35 devstack sudo[96763]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-1eda7a70-b9f8-4fbe-a429-833185c366ee tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-64001dde-7bc3-474c-af85-bcd13160e85b.e3179055-1e44-4aef-8ea1-ab9719224b49" returned: 0 in 0.536s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:35 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-1eda7a70-b9f8-4fbe-a429-833185c366ee tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64001dde-7bc3-474c-af85-bcd13160e85b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:55:35 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e9ba720-4561-4fd7-b9d7-d4e13c1d5aa0]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-1eda7a70-b9f8-4fbe-a429-833185c366ee tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-64001dde-7bc3-474c-af85-bcd13160e85b {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:35 devstack sudo[96768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-64001dde-7bc3-474c-af85-bcd13160e85b Jul 30 16:55:35 devstack sudo[96768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:35 devstack sudo[96768]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-1eda7a70-b9f8-4fbe-a429-833185c366ee tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-64001dde-7bc3-474c-af85-bcd13160e85b" returned: 0 in 0.445s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-1eda7a70-b9f8-4fbe-a429-833185c366ee tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-64001dde-7bc3-474c-af85-bcd13160e85b.e3179055-1e44-4aef-8ea1-ab9719224b49 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:35 devstack sudo[96774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-64001dde-7bc3-474c-af85-bcd13160e85b.e3179055-1e44-4aef-8ea1-ab9719224b49 Jul 30 16:55:35 devstack sudo[96774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:35 devstack sudo[96774]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-1eda7a70-b9f8-4fbe-a429-833185c366ee tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-64001dde-7bc3-474c-af85-bcd13160e85b.e3179055-1e44-4aef-8ea1-ab9719224b49" returned: 0 in 0.419s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-1eda7a70-b9f8-4fbe-a429-833185c366ee tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-64001dde-7bc3-474c-af85-bcd13160e85b.e3179055-1e44-4aef-8ea1-ab9719224b49 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:35 devstack sudo[96779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-64001dde-7bc3-474c-af85-bcd13160e85b.e3179055-1e44-4aef-8ea1-ab9719224b49 Jul 30 16:55:35 devstack sudo[96779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:36 devstack sudo[96779]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-1eda7a70-b9f8-4fbe-a429-833185c366ee tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-64001dde-7bc3-474c-af85-bcd13160e85b.e3179055-1e44-4aef-8ea1-ab9719224b49" returned: 0 in 0.382s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:36 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-1eda7a70-b9f8-4fbe-a429-833185c366ee tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] Lock "cinder-quobyte-e3179055-1e44-4aef-8ea1-ab9719224b49" released by "_delete_snapshot" :: held 1.967s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:36 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-1eda7a70-b9f8-4fbe-a429-833185c366ee tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] Lock "cinder-quobyte-64001dde-7bc3-474c-af85-bcd13160e85b" released by "delete_snapshot" :: held 2.004s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:36 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-1eda7a70-b9f8-4fbe-a429-833185c366ee tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] Created reservations ['fd717ad1-8167-4517-a848-6c259f17a373', '311f2fe6-4ff9-4e98-97c2-eb99ba1c3d44', '74b674e4-c268-4f66-948f-4cef2dc26696', '4f3b9630-2915-49d2-b4eb-97d2898e39bf'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:55:36 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-1eda7a70-b9f8-4fbe-a429-833185c366ee tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] Delete snapshot completed successfully. Jul 30 16:55:36 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-1eda7a70-b9f8-4fbe-a429-833185c366ee tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] Lock "cinder-e3179055-1e44-4aef-8ea1-ab9719224b49-delete_snapshot" released by "delete_snapshot" :: held 2.207s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:37 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-504cc6f2-0bdd-46ec-9d57-3f1e53bc2b2c tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] Acquiring lock "cinder-64001dde-7bc3-474c-af85-bcd13160e85b-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:37 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-504cc6f2-0bdd-46ec-9d57-3f1e53bc2b2c tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] Lock "cinder-64001dde-7bc3-474c-af85-bcd13160e85b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:38 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-504cc6f2-0bdd-46ec-9d57-3f1e53bc2b2c tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] Acquiring lock "cinder-quobyte-64001dde-7bc3-474c-af85-bcd13160e85b" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:38 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-504cc6f2-0bdd-46ec-9d57-3f1e53bc2b2c tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] Lock "cinder-quobyte-64001dde-7bc3-474c-af85-bcd13160e85b" acquired by "delete_volume" :: waited 0.026s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:38 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[e88022e2-55ee-42c4-a1dc-7146be4980a8]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:38 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-504cc6f2-0bdd-46ec-9d57-3f1e53bc2b2c tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-64001dde-7bc3-474c-af85-bcd13160e85b {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:38 devstack sudo[96835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-64001dde-7bc3-474c-af85-bcd13160e85b Jul 30 16:55:38 devstack sudo[96835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:38 devstack sudo[96835]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:38 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-504cc6f2-0bdd-46ec-9d57-3f1e53bc2b2c tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-64001dde-7bc3-474c-af85-bcd13160e85b" returned: 0 in 0.628s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:38 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-504cc6f2-0bdd-46ec-9d57-3f1e53bc2b2c tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-64001dde-7bc3-474c-af85-bcd13160e85b {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:38 devstack sudo[96854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-64001dde-7bc3-474c-af85-bcd13160e85b Jul 30 16:55:38 devstack sudo[96854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:39 devstack sudo[96854]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:39 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-504cc6f2-0bdd-46ec-9d57-3f1e53bc2b2c tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-64001dde-7bc3-474c-af85-bcd13160e85b" returned: 0 in 0.419s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:39 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-504cc6f2-0bdd-46ec-9d57-3f1e53bc2b2c tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] Lock "cinder-quobyte-64001dde-7bc3-474c-af85-bcd13160e85b" released by "delete_volume" :: held 1.156s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:39 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-504cc6f2-0bdd-46ec-9d57-3f1e53bc2b2c tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] Created reservations ['22b4cd66-a004-45ab-9c75-fac166329d30', '432e3484-904a-4c95-a8e9-86958a841a00', '2c740a7a-a239-4901-b85a-896bb84a74b9', 'a02b6b1f-ddf6-4912-ad07-44bc0a856dcb'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:55:39 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-504cc6f2-0bdd-46ec-9d57-3f1e53bc2b2c tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:39 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-504cc6f2-0bdd-46ec-9d57-3f1e53bc2b2c tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:39 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-504cc6f2-0bdd-46ec-9d57-3f1e53bc2b2c tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:55:39 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-504cc6f2-0bdd-46ec-9d57-3f1e53bc2b2c tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:55:39 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-504cc6f2-0bdd-46ec-9d57-3f1e53bc2b2c tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:39 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-504cc6f2-0bdd-46ec-9d57-3f1e53bc2b2c tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:39 devstack sudo[96872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:55:39 devstack sudo[96872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:39 devstack sudo[96872]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:39 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-504cc6f2-0bdd-46ec-9d57-3f1e53bc2b2c tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.427s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:39 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-504cc6f2-0bdd-46ec-9d57-3f1e53bc2b2c tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:55:39 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-504cc6f2-0bdd-46ec-9d57-3f1e53bc2b2c tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] Deleted volume successfully. Jul 30 16:55:39 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-504cc6f2-0bdd-46ec-9d57-3f1e53bc2b2c tempest-VolumeSnapshotQuotasNegativeTestJSON-508674534 None] Lock "cinder-64001dde-7bc3-474c-af85-bcd13160e85b-delete_volume" released by "delete_volume" :: held 1.951s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:49 devstack cinder-volume[88568]: DEBUG dbcounter [-] [88568] Writing DB stats cinder:UPDATE=130,cinder:DELETE=6,cinder:SELECT=122,cinder:INSERT=36 {{(pid=88568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:55:49 devstack cinder-volume[88568]: DEBUG dbcounter [-] [88568] Writing DB stats cinder:SELECT=122,cinder:INSERT=29,cinder:UPDATE=151,cinder:DELETE=11 {{(pid=88568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:55:52 devstack cinder-volume[88568]: DEBUG oslo_service.periodic_task [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:55:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:52 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:55:52 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:55:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:52 devstack sudo[96917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:55:52 devstack sudo[96917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:52 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-a699e6f4-e7e7-4b97-8f6b-269c2ff7187c tempest-SnapshotMetadataTestJSON-1056846926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:55:52 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a699e6f4-e7e7-4b97-8f6b-269c2ff7187c tempest-SnapshotMetadataTestJSON-1056846926 None] Flow 'volume_create_manager' (ec2c3aa2-81f0-4d0a-abd1-5ad6a7d61776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:55:52 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a699e6f4-e7e7-4b97-8f6b-269c2ff7187c tempest-SnapshotMetadataTestJSON-1056846926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44cb501a-566d-43b9-8933-4b992795fb77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:52 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a699e6f4-e7e7-4b97-8f6b-269c2ff7187c tempest-SnapshotMetadataTestJSON-1056846926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44cb501a-566d-43b9-8933-4b992795fb77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:55:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1142194191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=080d2943-7e9a-4092-ba33-75e2bf0d1eca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58ad9ae1d75540ccb720f2fda5401332',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:55:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:55:53Z,use_quota=True,user_id='dda7e8ebe9794f6b8b3b21f0c11056a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:52 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a699e6f4-e7e7-4b97-8f6b-269c2ff7187c tempest-SnapshotMetadataTestJSON-1056846926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ba895c7-a871-478b-9b5a-d29e3982362d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:52 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a699e6f4-e7e7-4b97-8f6b-269c2ff7187c tempest-SnapshotMetadataTestJSON-1056846926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ba895c7-a871-478b-9b5a-d29e3982362d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:52 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a699e6f4-e7e7-4b97-8f6b-269c2ff7187c tempest-SnapshotMetadataTestJSON-1056846926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (939d6806-a433-4bfc-bdc8-e4aee61df331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:52 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a699e6f4-e7e7-4b97-8f6b-269c2ff7187c tempest-SnapshotMetadataTestJSON-1056846926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (939d6806-a433-4bfc-bdc8-e4aee61df331) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '080d2943-7e9a-4092-ba33-75e2bf0d1eca', 'volume_name': 'volume-080d2943-7e9a-4092-ba33-75e2bf0d1eca', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:52 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a699e6f4-e7e7-4b97-8f6b-269c2ff7187c tempest-SnapshotMetadataTestJSON-1056846926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4110e979-895c-4e1d-8de7-7e72862f2b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:52 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a699e6f4-e7e7-4b97-8f6b-269c2ff7187c tempest-SnapshotMetadataTestJSON-1056846926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4110e979-895c-4e1d-8de7-7e72862f2b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:52 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a699e6f4-e7e7-4b97-8f6b-269c2ff7187c tempest-SnapshotMetadataTestJSON-1056846926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d35377e-76be-4e13-9d01-3cf483b3b4d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:52 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-a699e6f4-e7e7-4b97-8f6b-269c2ff7187c tempest-SnapshotMetadataTestJSON-1056846926 None] Volume 080d2943-7e9a-4092-ba33-75e2bf0d1eca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-080d2943-7e9a-4092-ba33-75e2bf0d1eca', 'volume_size': 1} Jul 30 16:55:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a699e6f4-e7e7-4b97-8f6b-269c2ff7187c tempest-SnapshotMetadataTestJSON-1056846926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a699e6f4-e7e7-4b97-8f6b-269c2ff7187c tempest-SnapshotMetadataTestJSON-1056846926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:52 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-a699e6f4-e7e7-4b97-8f6b-269c2ff7187c tempest-SnapshotMetadataTestJSON-1056846926 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:55:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1142194191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=080d2943-7e9a-4092-ba33-75e2bf0d1eca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58ad9ae1d75540ccb720f2fda5401332',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:55:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:55:53Z,use_quota=True,user_id='dda7e8ebe9794f6b8b3b21f0c11056a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:55:52 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-a699e6f4-e7e7-4b97-8f6b-269c2ff7187c tempest-SnapshotMetadataTestJSON-1056846926 None] Creating volume 080d2943-7e9a-4092-ba33-75e2bf0d1eca {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:55:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a699e6f4-e7e7-4b97-8f6b-269c2ff7187c tempest-SnapshotMetadataTestJSON-1056846926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a699e6f4-e7e7-4b97-8f6b-269c2ff7187c tempest-SnapshotMetadataTestJSON-1056846926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:52 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-a699e6f4-e7e7-4b97-8f6b-269c2ff7187c tempest-SnapshotMetadataTestJSON-1056846926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:55:52 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-a699e6f4-e7e7-4b97-8f6b-269c2ff7187c tempest-SnapshotMetadataTestJSON-1056846926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:55:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a699e6f4-e7e7-4b97-8f6b-269c2ff7187c tempest-SnapshotMetadataTestJSON-1056846926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:52 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-a699e6f4-e7e7-4b97-8f6b-269c2ff7187c tempest-SnapshotMetadataTestJSON-1056846926 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:55:52 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-a699e6f4-e7e7-4b97-8f6b-269c2ff7187c tempest-SnapshotMetadataTestJSON-1056846926 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 16:55:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a699e6f4-e7e7-4b97-8f6b-269c2ff7187c tempest-SnapshotMetadataTestJSON-1056846926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-080d2943-7e9a-4092-ba33-75e2bf0d1eca 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:52 devstack sudo[96920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-080d2943-7e9a-4092-ba33-75e2bf0d1eca 1073741824 Jul 30 16:55:52 devstack sudo[96920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:52 devstack sudo[96917]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.360s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:52 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:55:52 devstack cinder-volume[88568]: DEBUG oslo_service.periodic_task [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Running periodic task VolumeManager._thread_info {{(pid=88568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:55:52 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] thread count: 8 {{(pid=88568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:55:52 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] thread info: [<_MainThread(MainThread, started 127406866608256)>, , , , , , , ] {{(pid=88568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:55:53 devstack sudo[96920]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:53 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a699e6f4-e7e7-4b97-8f6b-269c2ff7187c tempest-SnapshotMetadataTestJSON-1056846926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-080d2943-7e9a-4092-ba33-75e2bf0d1eca 1073741824" returned: 0 in 0.613s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:53 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a699e6f4-e7e7-4b97-8f6b-269c2ff7187c tempest-SnapshotMetadataTestJSON-1056846926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-080d2943-7e9a-4092-ba33-75e2bf0d1eca {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:53 devstack sudo[96932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-080d2943-7e9a-4092-ba33-75e2bf0d1eca Jul 30 16:55:53 devstack sudo[96932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:53 devstack sudo[96932]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:53 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a699e6f4-e7e7-4b97-8f6b-269c2ff7187c tempest-SnapshotMetadataTestJSON-1056846926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-080d2943-7e9a-4092-ba33-75e2bf0d1eca" returned: 0 in 0.375s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:53 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-a699e6f4-e7e7-4b97-8f6b-269c2ff7187c tempest-SnapshotMetadataTestJSON-1056846926 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:55:53 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a699e6f4-e7e7-4b97-8f6b-269c2ff7187c tempest-SnapshotMetadataTestJSON-1056846926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:53 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a699e6f4-e7e7-4b97-8f6b-269c2ff7187c tempest-SnapshotMetadataTestJSON-1056846926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d35377e-76be-4e13-9d01-3cf483b3b4d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-080d2943-7e9a-4092-ba33-75e2bf0d1eca', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:53 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a699e6f4-e7e7-4b97-8f6b-269c2ff7187c tempest-SnapshotMetadataTestJSON-1056846926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae81c0ec-b70d-435a-83c5-1e982b41dcb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:53 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-a699e6f4-e7e7-4b97-8f6b-269c2ff7187c tempest-SnapshotMetadataTestJSON-1056846926 None] Volume volume-080d2943-7e9a-4092-ba33-75e2bf0d1eca (080d2943-7e9a-4092-ba33-75e2bf0d1eca): created successfully Jul 30 16:55:53 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a699e6f4-e7e7-4b97-8f6b-269c2ff7187c tempest-SnapshotMetadataTestJSON-1056846926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae81c0ec-b70d-435a-83c5-1e982b41dcb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:53 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a699e6f4-e7e7-4b97-8f6b-269c2ff7187c tempest-SnapshotMetadataTestJSON-1056846926 None] Flow 'volume_create_manager' (ec2c3aa2-81f0-4d0a-abd1-5ad6a7d61776) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:55:53 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-a699e6f4-e7e7-4b97-8f6b-269c2ff7187c tempest-SnapshotMetadataTestJSON-1056846926 None] Created volume successfully. Jul 30 16:55:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-e11157b5-877f-4a5f-83d1-981abf6a1f13 tempest-SnapshotMetadataTestJSON-1056846926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-e11157b5-877f-4a5f-83d1-981abf6a1f13 tempest-SnapshotMetadataTestJSON-1056846926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:55 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-e11157b5-877f-4a5f-83d1-981abf6a1f13 tempest-SnapshotMetadataTestJSON-1056846926 None] Creating offline snapshot c8832e8d-af90-4b19-a3f1-64830c0350fa of volume 080d2943-7e9a-4092-ba33-75e2bf0d1eca {{(pid=88568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:55:55 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac7a93e0-a8b5-4c33-9076-fed506acf0ec]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e11157b5-877f-4a5f-83d1-981abf6a1f13 tempest-SnapshotMetadataTestJSON-1056846926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-080d2943-7e9a-4092-ba33-75e2bf0d1eca {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:55 devstack sudo[96939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-080d2943-7e9a-4092-ba33-75e2bf0d1eca Jul 30 16:55:55 devstack sudo[96939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:55 devstack sudo[96939]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e11157b5-877f-4a5f-83d1-981abf6a1f13 tempest-SnapshotMetadataTestJSON-1056846926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-080d2943-7e9a-4092-ba33-75e2bf0d1eca" returned: 0 in 0.380s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e11157b5-877f-4a5f-83d1-981abf6a1f13 tempest-SnapshotMetadataTestJSON-1056846926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-080d2943-7e9a-4092-ba33-75e2bf0d1eca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-080d2943-7e9a-4092-ba33-75e2bf0d1eca.c8832e8d-af90-4b19-a3f1-64830c0350fa 1G {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:55 devstack sudo[96945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-080d2943-7e9a-4092-ba33-75e2bf0d1eca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-080d2943-7e9a-4092-ba33-75e2bf0d1eca.c8832e8d-af90-4b19-a3f1-64830c0350fa 1G Jul 30 16:55:55 devstack sudo[96945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:55 devstack sudo[96945]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e11157b5-877f-4a5f-83d1-981abf6a1f13 tempest-SnapshotMetadataTestJSON-1056846926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-080d2943-7e9a-4092-ba33-75e2bf0d1eca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-080d2943-7e9a-4092-ba33-75e2bf0d1eca.c8832e8d-af90-4b19-a3f1-64830c0350fa 1G" returned: 0 in 0.405s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e11157b5-877f-4a5f-83d1-981abf6a1f13 tempest-SnapshotMetadataTestJSON-1056846926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-080d2943-7e9a-4092-ba33-75e2bf0d1eca -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-080d2943-7e9a-4092-ba33-75e2bf0d1eca.c8832e8d-af90-4b19-a3f1-64830c0350fa {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:55 devstack sudo[96951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-080d2943-7e9a-4092-ba33-75e2bf0d1eca -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-080d2943-7e9a-4092-ba33-75e2bf0d1eca.c8832e8d-af90-4b19-a3f1-64830c0350fa Jul 30 16:55:55 devstack sudo[96951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:56 devstack sudo[96951]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e11157b5-877f-4a5f-83d1-981abf6a1f13 tempest-SnapshotMetadataTestJSON-1056846926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-080d2943-7e9a-4092-ba33-75e2bf0d1eca -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-080d2943-7e9a-4092-ba33-75e2bf0d1eca.c8832e8d-af90-4b19-a3f1-64830c0350fa" returned: 0 in 0.332s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:56 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-e11157b5-877f-4a5f-83d1-981abf6a1f13 tempest-SnapshotMetadataTestJSON-1056846926 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-080d2943-7e9a-4092-ba33-75e2bf0d1eca.c8832e8d-af90-4b19-a3f1-64830c0350fa is being set with open permissions: ugo+rw Jul 30 16:55:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e11157b5-877f-4a5f-83d1-981abf6a1f13 tempest-SnapshotMetadataTestJSON-1056846926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-080d2943-7e9a-4092-ba33-75e2bf0d1eca.c8832e8d-af90-4b19-a3f1-64830c0350fa {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:56 devstack sudo[96956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-080d2943-7e9a-4092-ba33-75e2bf0d1eca.c8832e8d-af90-4b19-a3f1-64830c0350fa Jul 30 16:55:56 devstack sudo[96956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:56 devstack sudo[96956]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e11157b5-877f-4a5f-83d1-981abf6a1f13 tempest-SnapshotMetadataTestJSON-1056846926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-080d2943-7e9a-4092-ba33-75e2bf0d1eca.c8832e8d-af90-4b19-a3f1-64830c0350fa" returned: 0 in 0.279s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e11157b5-877f-4a5f-83d1-981abf6a1f13 tempest-SnapshotMetadataTestJSON-1056846926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-080d2943-7e9a-4092-ba33-75e2bf0d1eca.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:56 devstack sudo[96959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-080d2943-7e9a-4092-ba33-75e2bf0d1eca.info Jul 30 16:55:56 devstack sudo[96959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:56 devstack sudo[96959]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e11157b5-877f-4a5f-83d1-981abf6a1f13 tempest-SnapshotMetadataTestJSON-1056846926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-080d2943-7e9a-4092-ba33-75e2bf0d1eca.info" returned: 0 in 0.298s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:56 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-e11157b5-877f-4a5f-83d1-981abf6a1f13 tempest-SnapshotMetadataTestJSON-1056846926 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-080d2943-7e9a-4092-ba33-75e2bf0d1eca.info is being set with open permissions: ugo+rw Jul 30 16:55:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e11157b5-877f-4a5f-83d1-981abf6a1f13 tempest-SnapshotMetadataTestJSON-1056846926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-080d2943-7e9a-4092-ba33-75e2bf0d1eca.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:56 devstack sudo[96962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-080d2943-7e9a-4092-ba33-75e2bf0d1eca.info Jul 30 16:55:56 devstack sudo[96962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:57 devstack sudo[96962]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e11157b5-877f-4a5f-83d1-981abf6a1f13 tempest-SnapshotMetadataTestJSON-1056846926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-080d2943-7e9a-4092-ba33-75e2bf0d1eca.info" returned: 0 in 0.321s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-e11157b5-877f-4a5f-83d1-981abf6a1f13 tempest-SnapshotMetadataTestJSON-1056846926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.128s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:57 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-e11157b5-877f-4a5f-83d1-981abf6a1f13 tempest-SnapshotMetadataTestJSON-1056846926 None] Create snapshot completed successfully Jul 30 16:55:59 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-16711644-270f-4f2a-9afb-f9bf497a87f2 tempest-SnapshotMetadataTestJSON-1056846926 None] Acquiring lock "cinder-c8832e8d-af90-4b19-a3f1-64830c0350fa-delete_snapshot" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:59 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-16711644-270f-4f2a-9afb-f9bf497a87f2 tempest-SnapshotMetadataTestJSON-1056846926 None] Lock "cinder-c8832e8d-af90-4b19-a3f1-64830c0350fa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:59 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-16711644-270f-4f2a-9afb-f9bf497a87f2 tempest-SnapshotMetadataTestJSON-1056846926 None] Acquiring lock "cinder-quobyte-080d2943-7e9a-4092-ba33-75e2bf0d1eca" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:59 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-16711644-270f-4f2a-9afb-f9bf497a87f2 tempest-SnapshotMetadataTestJSON-1056846926 None] Lock "cinder-quobyte-080d2943-7e9a-4092-ba33-75e2bf0d1eca" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:59 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-16711644-270f-4f2a-9afb-f9bf497a87f2 tempest-SnapshotMetadataTestJSON-1056846926 None] Acquiring lock "cinder-quobyte-c8832e8d-af90-4b19-a3f1-64830c0350fa" by "_delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:59 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-16711644-270f-4f2a-9afb-f9bf497a87f2 tempest-SnapshotMetadataTestJSON-1056846926 None] Lock "cinder-quobyte-c8832e8d-af90-4b19-a3f1-64830c0350fa" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:59 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-16711644-270f-4f2a-9afb-f9bf497a87f2 tempest-SnapshotMetadataTestJSON-1056846926 None] Deleting offline snapshot c8832e8d-af90-4b19-a3f1-64830c0350fa of volume 080d2943-7e9a-4092-ba33-75e2bf0d1eca {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:55:59 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-16711644-270f-4f2a-9afb-f9bf497a87f2 tempest-SnapshotMetadataTestJSON-1056846926 None] snapshot_file for this snap is: volume-080d2943-7e9a-4092-ba33-75e2bf0d1eca.c8832e8d-af90-4b19-a3f1-64830c0350fa {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:55:59 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[988a2f03-458b-4564-b80b-1fe53927e630]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-16711644-270f-4f2a-9afb-f9bf497a87f2 tempest-SnapshotMetadataTestJSON-1056846926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-080d2943-7e9a-4092-ba33-75e2bf0d1eca.c8832e8d-af90-4b19-a3f1-64830c0350fa {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:59 devstack sudo[96965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-080d2943-7e9a-4092-ba33-75e2bf0d1eca.c8832e8d-af90-4b19-a3f1-64830c0350fa Jul 30 16:55:59 devstack sudo[96965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:00 devstack sudo[96965]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:00 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-16711644-270f-4f2a-9afb-f9bf497a87f2 tempest-SnapshotMetadataTestJSON-1056846926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-080d2943-7e9a-4092-ba33-75e2bf0d1eca.c8832e8d-af90-4b19-a3f1-64830c0350fa" returned: 0 in 0.627s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:00 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-16711644-270f-4f2a-9afb-f9bf497a87f2 tempest-SnapshotMetadataTestJSON-1056846926 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-080d2943-7e9a-4092-ba33-75e2bf0d1eca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:56:00 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c1d216-6390-4b18-9b3a-82b5791d50f3]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:56:00 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-16711644-270f-4f2a-9afb-f9bf497a87f2 tempest-SnapshotMetadataTestJSON-1056846926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-080d2943-7e9a-4092-ba33-75e2bf0d1eca {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:00 devstack sudo[96970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-080d2943-7e9a-4092-ba33-75e2bf0d1eca Jul 30 16:56:00 devstack sudo[96970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:00 devstack sudo[96970]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:00 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-16711644-270f-4f2a-9afb-f9bf497a87f2 tempest-SnapshotMetadataTestJSON-1056846926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-080d2943-7e9a-4092-ba33-75e2bf0d1eca" returned: 0 in 0.506s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:00 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-16711644-270f-4f2a-9afb-f9bf497a87f2 tempest-SnapshotMetadataTestJSON-1056846926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-080d2943-7e9a-4092-ba33-75e2bf0d1eca.c8832e8d-af90-4b19-a3f1-64830c0350fa {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:00 devstack sudo[96975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-080d2943-7e9a-4092-ba33-75e2bf0d1eca.c8832e8d-af90-4b19-a3f1-64830c0350fa Jul 30 16:56:00 devstack sudo[96975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:01 devstack sudo[96975]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-16711644-270f-4f2a-9afb-f9bf497a87f2 tempest-SnapshotMetadataTestJSON-1056846926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-080d2943-7e9a-4092-ba33-75e2bf0d1eca.c8832e8d-af90-4b19-a3f1-64830c0350fa" returned: 0 in 0.543s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-16711644-270f-4f2a-9afb-f9bf497a87f2 tempest-SnapshotMetadataTestJSON-1056846926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-080d2943-7e9a-4092-ba33-75e2bf0d1eca.c8832e8d-af90-4b19-a3f1-64830c0350fa {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:01 devstack sudo[96980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-080d2943-7e9a-4092-ba33-75e2bf0d1eca.c8832e8d-af90-4b19-a3f1-64830c0350fa Jul 30 16:56:01 devstack sudo[96980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:01 devstack sudo[96980]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-16711644-270f-4f2a-9afb-f9bf497a87f2 tempest-SnapshotMetadataTestJSON-1056846926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-080d2943-7e9a-4092-ba33-75e2bf0d1eca.c8832e8d-af90-4b19-a3f1-64830c0350fa" returned: 0 in 0.407s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:01 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-16711644-270f-4f2a-9afb-f9bf497a87f2 tempest-SnapshotMetadataTestJSON-1056846926 None] Lock "cinder-quobyte-c8832e8d-af90-4b19-a3f1-64830c0350fa" released by "_delete_snapshot" :: held 2.271s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:56:01 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-16711644-270f-4f2a-9afb-f9bf497a87f2 tempest-SnapshotMetadataTestJSON-1056846926 None] Lock "cinder-quobyte-080d2943-7e9a-4092-ba33-75e2bf0d1eca" released by "delete_snapshot" :: held 2.305s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:56:01 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-16711644-270f-4f2a-9afb-f9bf497a87f2 tempest-SnapshotMetadataTestJSON-1056846926 None] Created reservations ['8a42c68b-e64c-4b4e-a9c6-6b0c807669f8', '460d2050-37f6-4e5b-a799-24d6ff119fb7', '64291313-4d4d-4a54-8a3b-860afcbe5712', '2d9a13e1-11ef-4ec7-bc02-622bc5c158cb'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:56:02 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-16711644-270f-4f2a-9afb-f9bf497a87f2 tempest-SnapshotMetadataTestJSON-1056846926 None] Delete snapshot completed successfully. Jul 30 16:56:02 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-16711644-270f-4f2a-9afb-f9bf497a87f2 tempest-SnapshotMetadataTestJSON-1056846926 None] Lock "cinder-c8832e8d-af90-4b19-a3f1-64830c0350fa-delete_snapshot" released by "delete_snapshot" :: held 2.480s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:56:02 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-3acff69d-963c-4975-9002-d7c3aef4b4ad tempest-SnapshotMetadataTestJSON-1056846926 None] Acquiring lock "cinder-080d2943-7e9a-4092-ba33-75e2bf0d1eca-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:56:02 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-3acff69d-963c-4975-9002-d7c3aef4b4ad tempest-SnapshotMetadataTestJSON-1056846926 None] Lock "cinder-080d2943-7e9a-4092-ba33-75e2bf0d1eca-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:56:03 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-3acff69d-963c-4975-9002-d7c3aef4b4ad tempest-SnapshotMetadataTestJSON-1056846926 None] Acquiring lock "cinder-quobyte-080d2943-7e9a-4092-ba33-75e2bf0d1eca" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:56:03 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-3acff69d-963c-4975-9002-d7c3aef4b4ad tempest-SnapshotMetadataTestJSON-1056846926 None] Lock "cinder-quobyte-080d2943-7e9a-4092-ba33-75e2bf0d1eca" acquired by "delete_volume" :: waited 0.020s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:56:03 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b78fe36-9e3a-4079-a62d-01362b68f6b9]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:56:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-3acff69d-963c-4975-9002-d7c3aef4b4ad tempest-SnapshotMetadataTestJSON-1056846926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-080d2943-7e9a-4092-ba33-75e2bf0d1eca {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:03 devstack sudo[96983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-080d2943-7e9a-4092-ba33-75e2bf0d1eca Jul 30 16:56:03 devstack sudo[96983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:03 devstack sudo[96983]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-3acff69d-963c-4975-9002-d7c3aef4b4ad tempest-SnapshotMetadataTestJSON-1056846926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-080d2943-7e9a-4092-ba33-75e2bf0d1eca" returned: 0 in 0.441s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-3acff69d-963c-4975-9002-d7c3aef4b4ad tempest-SnapshotMetadataTestJSON-1056846926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-080d2943-7e9a-4092-ba33-75e2bf0d1eca {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:03 devstack sudo[96988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-080d2943-7e9a-4092-ba33-75e2bf0d1eca Jul 30 16:56:03 devstack sudo[96988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:03 devstack sudo[96988]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-3acff69d-963c-4975-9002-d7c3aef4b4ad tempest-SnapshotMetadataTestJSON-1056846926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-080d2943-7e9a-4092-ba33-75e2bf0d1eca" returned: 0 in 0.285s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:03 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-3acff69d-963c-4975-9002-d7c3aef4b4ad tempest-SnapshotMetadataTestJSON-1056846926 None] Lock "cinder-quobyte-080d2943-7e9a-4092-ba33-75e2bf0d1eca" released by "delete_volume" :: held 0.810s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:56:03 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-3acff69d-963c-4975-9002-d7c3aef4b4ad tempest-SnapshotMetadataTestJSON-1056846926 None] Created reservations ['0857ec20-bfec-420d-a578-7165be83429e', 'fd3c99a7-5e6f-4def-83d6-66a500ff68c8', 'fcc529ab-529a-4571-be9f-819efcc26988', '804b46da-7c76-4a76-ac36-1435c957858c'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:56:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-3acff69d-963c-4975-9002-d7c3aef4b4ad tempest-SnapshotMetadataTestJSON-1056846926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:56:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-3acff69d-963c-4975-9002-d7c3aef4b4ad tempest-SnapshotMetadataTestJSON-1056846926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:56:04 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-3acff69d-963c-4975-9002-d7c3aef4b4ad tempest-SnapshotMetadataTestJSON-1056846926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:56:04 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-3acff69d-963c-4975-9002-d7c3aef4b4ad tempest-SnapshotMetadataTestJSON-1056846926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:56:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-3acff69d-963c-4975-9002-d7c3aef4b4ad tempest-SnapshotMetadataTestJSON-1056846926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:56:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-3acff69d-963c-4975-9002-d7c3aef4b4ad tempest-SnapshotMetadataTestJSON-1056846926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:04 devstack sudo[96991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:56:04 devstack sudo[96991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:04 devstack sudo[96991]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-3acff69d-963c-4975-9002-d7c3aef4b4ad tempest-SnapshotMetadataTestJSON-1056846926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.430s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:04 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-3acff69d-963c-4975-9002-d7c3aef4b4ad tempest-SnapshotMetadataTestJSON-1056846926 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:56:04 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-3acff69d-963c-4975-9002-d7c3aef4b4ad tempest-SnapshotMetadataTestJSON-1056846926 None] Deleted volume successfully. Jul 30 16:56:04 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-3acff69d-963c-4975-9002-d7c3aef4b4ad tempest-SnapshotMetadataTestJSON-1056846926 None] Lock "cinder-080d2943-7e9a-4092-ba33-75e2bf0d1eca-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:56:05 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-15349b87-548a-405c-ad4b-c33f8cba822a tempest-AttachVolumeNegativeTest-1037417113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:56:05 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-15349b87-548a-405c-ad4b-c33f8cba822a tempest-AttachVolumeNegativeTest-1037417113 None] Flow 'volume_create_manager' (39620d31-da04-400a-bdb2-adcf1174e623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:56:05 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-15349b87-548a-405c-ad4b-c33f8cba822a tempest-AttachVolumeNegativeTest-1037417113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a51e176a-5001-4ed6-ad99-823441708474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:05 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-15349b87-548a-405c-ad4b-c33f8cba822a tempest-AttachVolumeNegativeTest-1037417113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a51e176a-5001-4ed6-ad99-823441708474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:56:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1118863981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a02b427c-6e26-4fcf-b0ca-6161d756a83a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9e601affb8f4aecbadcf75c60187e20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:56:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:56:05Z,use_quota=True,user_id='6bbe8f4a440a4bf18642093e7843287b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:05 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-15349b87-548a-405c-ad4b-c33f8cba822a tempest-AttachVolumeNegativeTest-1037417113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (420c7802-722a-4e1a-8eba-0c46b1a57ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:05 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-15349b87-548a-405c-ad4b-c33f8cba822a tempest-AttachVolumeNegativeTest-1037417113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (420c7802-722a-4e1a-8eba-0c46b1a57ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:05 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-15349b87-548a-405c-ad4b-c33f8cba822a tempest-AttachVolumeNegativeTest-1037417113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2e3c250-882e-4e9a-8b30-96d97dbac380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:05 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-15349b87-548a-405c-ad4b-c33f8cba822a tempest-AttachVolumeNegativeTest-1037417113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2e3c250-882e-4e9a-8b30-96d97dbac380) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a02b427c-6e26-4fcf-b0ca-6161d756a83a', 'volume_name': 'volume-a02b427c-6e26-4fcf-b0ca-6161d756a83a', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:05 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-15349b87-548a-405c-ad4b-c33f8cba822a tempest-AttachVolumeNegativeTest-1037417113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68c40b4e-40b3-460c-83df-a75efd86271a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:05 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-15349b87-548a-405c-ad4b-c33f8cba822a tempest-AttachVolumeNegativeTest-1037417113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68c40b4e-40b3-460c-83df-a75efd86271a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:05 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-15349b87-548a-405c-ad4b-c33f8cba822a tempest-AttachVolumeNegativeTest-1037417113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b269a580-2587-478c-a344-44d52f7ada07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:05 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-15349b87-548a-405c-ad4b-c33f8cba822a tempest-AttachVolumeNegativeTest-1037417113 None] Volume a02b427c-6e26-4fcf-b0ca-6161d756a83a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a02b427c-6e26-4fcf-b0ca-6161d756a83a', 'volume_size': 1} Jul 30 16:56:05 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-15349b87-548a-405c-ad4b-c33f8cba822a tempest-AttachVolumeNegativeTest-1037417113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:56:05 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-15349b87-548a-405c-ad4b-c33f8cba822a tempest-AttachVolumeNegativeTest-1037417113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:56:05 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-15349b87-548a-405c-ad4b-c33f8cba822a tempest-AttachVolumeNegativeTest-1037417113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:56:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1118863981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a02b427c-6e26-4fcf-b0ca-6161d756a83a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9e601affb8f4aecbadcf75c60187e20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:56:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:56:05Z,use_quota=True,user_id='6bbe8f4a440a4bf18642093e7843287b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:56:05 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-15349b87-548a-405c-ad4b-c33f8cba822a tempest-AttachVolumeNegativeTest-1037417113 None] Creating volume a02b427c-6e26-4fcf-b0ca-6161d756a83a {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:56:05 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-15349b87-548a-405c-ad4b-c33f8cba822a tempest-AttachVolumeNegativeTest-1037417113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:56:05 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-15349b87-548a-405c-ad4b-c33f8cba822a tempest-AttachVolumeNegativeTest-1037417113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:56:05 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-15349b87-548a-405c-ad4b-c33f8cba822a tempest-AttachVolumeNegativeTest-1037417113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:56:05 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-15349b87-548a-405c-ad4b-c33f8cba822a tempest-AttachVolumeNegativeTest-1037417113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:56:05 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-15349b87-548a-405c-ad4b-c33f8cba822a tempest-AttachVolumeNegativeTest-1037417113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:56:05 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-15349b87-548a-405c-ad4b-c33f8cba822a tempest-AttachVolumeNegativeTest-1037417113 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:56:05 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-15349b87-548a-405c-ad4b-c33f8cba822a tempest-AttachVolumeNegativeTest-1037417113 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 16:56:05 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-15349b87-548a-405c-ad4b-c33f8cba822a tempest-AttachVolumeNegativeTest-1037417113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-a02b427c-6e26-4fcf-b0ca-6161d756a83a 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:05 devstack sudo[96998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-a02b427c-6e26-4fcf-b0ca-6161d756a83a 1073741824 Jul 30 16:56:05 devstack sudo[96998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:05 devstack sudo[96998]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:05 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-15349b87-548a-405c-ad4b-c33f8cba822a tempest-AttachVolumeNegativeTest-1037417113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-a02b427c-6e26-4fcf-b0ca-6161d756a83a 1073741824" returned: 0 in 0.612s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:05 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-15349b87-548a-405c-ad4b-c33f8cba822a tempest-AttachVolumeNegativeTest-1037417113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-a02b427c-6e26-4fcf-b0ca-6161d756a83a {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:06 devstack sudo[97004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-a02b427c-6e26-4fcf-b0ca-6161d756a83a Jul 30 16:56:06 devstack sudo[97004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:06 devstack sudo[97004]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-15349b87-548a-405c-ad4b-c33f8cba822a tempest-AttachVolumeNegativeTest-1037417113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-a02b427c-6e26-4fcf-b0ca-6161d756a83a" returned: 0 in 0.370s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:06 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-15349b87-548a-405c-ad4b-c33f8cba822a tempest-AttachVolumeNegativeTest-1037417113 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:56:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-15349b87-548a-405c-ad4b-c33f8cba822a tempest-AttachVolumeNegativeTest-1037417113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:56:06 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-15349b87-548a-405c-ad4b-c33f8cba822a tempest-AttachVolumeNegativeTest-1037417113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b269a580-2587-478c-a344-44d52f7ada07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a02b427c-6e26-4fcf-b0ca-6161d756a83a', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:06 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-15349b87-548a-405c-ad4b-c33f8cba822a tempest-AttachVolumeNegativeTest-1037417113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2577112-cf2a-4638-a32e-5fc24ce643b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:06 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-15349b87-548a-405c-ad4b-c33f8cba822a tempest-AttachVolumeNegativeTest-1037417113 None] Volume volume-a02b427c-6e26-4fcf-b0ca-6161d756a83a (a02b427c-6e26-4fcf-b0ca-6161d756a83a): created successfully Jul 30 16:56:06 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-15349b87-548a-405c-ad4b-c33f8cba822a tempest-AttachVolumeNegativeTest-1037417113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2577112-cf2a-4638-a32e-5fc24ce643b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:06 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-15349b87-548a-405c-ad4b-c33f8cba822a tempest-AttachVolumeNegativeTest-1037417113 None] Flow 'volume_create_manager' (39620d31-da04-400a-bdb2-adcf1174e623) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:56:06 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-15349b87-548a-405c-ad4b-c33f8cba822a tempest-AttachVolumeNegativeTest-1037417113 None] Created volume successfully. Jul 30 16:56:08 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-723dd780-701d-446d-ad28-84a0762f57b2 req-f387ca2c-7ab5-40f3-ba75-934e387e0d1c tempest-AttachVolumeNegativeTest-1037417113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:56:08 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-723dd780-701d-446d-ad28-84a0762f57b2 req-f387ca2c-7ab5-40f3-ba75-934e387e0d1c tempest-AttachVolumeNegativeTest-1037417113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:56:08 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-723dd780-701d-446d-ad28-84a0762f57b2 req-f387ca2c-7ab5-40f3-ba75-934e387e0d1c tempest-AttachVolumeNegativeTest-1037417113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:56:08 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [req-723dd780-701d-446d-ad28-84a0762f57b2 req-f387ca2c-7ab5-40f3-ba75-934e387e0d1c tempest-AttachVolumeNegativeTest-1037417113 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924', 'name': 'volume-a02b427c-6e26-4fcf-b0ca-6161d756a83a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '700a0c61-6fa4-4b69-842f-968905c6d004', 'enforce_multipath': True} {{(pid=88568) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 16:56:08 devstack cinder-volume[88568]: INFO cinder.volume.manager [req-723dd780-701d-446d-ad28-84a0762f57b2 req-f387ca2c-7ab5-40f3-ba75-934e387e0d1c tempest-AttachVolumeNegativeTest-1037417113 None] attachment_update completed successfully. Jul 30 16:56:09 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f2f1df3-b4b1-40be-88e3-4e3148f03b2c tempest-AbsoluteLimitsTests-863760549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:56:09 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9f2f1df3-b4b1-40be-88e3-4e3148f03b2c tempest-AbsoluteLimitsTests-863760549 None] Flow 'volume_create_manager' (38e6175d-f7d5-4ca5-945d-04c4dddb4431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:56:09 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9f2f1df3-b4b1-40be-88e3-4e3148f03b2c tempest-AbsoluteLimitsTests-863760549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47353f50-d535-42cf-a0a6-49122f41887b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:09 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9f2f1df3-b4b1-40be-88e3-4e3148f03b2c tempest-AbsoluteLimitsTests-863760549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47353f50-d535-42cf-a0a6-49122f41887b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:56:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1071003524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfd92724-345c-4a16-a74d-ec67592b28f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb8841367ce546aa8ebba129658d6f6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:56:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:56:10Z,use_quota=True,user_id='0b40c65936df41cd97d988121d5e5c49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:09 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9f2f1df3-b4b1-40be-88e3-4e3148f03b2c tempest-AbsoluteLimitsTests-863760549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36789bb9-8d9c-432e-9068-446b7a5cc9fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:09 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9f2f1df3-b4b1-40be-88e3-4e3148f03b2c tempest-AbsoluteLimitsTests-863760549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36789bb9-8d9c-432e-9068-446b7a5cc9fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:09 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9f2f1df3-b4b1-40be-88e3-4e3148f03b2c tempest-AbsoluteLimitsTests-863760549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (872c4052-8946-46c1-a60a-6028b0465767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:09 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9f2f1df3-b4b1-40be-88e3-4e3148f03b2c tempest-AbsoluteLimitsTests-863760549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (872c4052-8946-46c1-a60a-6028b0465767) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfd92724-345c-4a16-a74d-ec67592b28f5', 'volume_name': 'volume-dfd92724-345c-4a16-a74d-ec67592b28f5', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:09 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9f2f1df3-b4b1-40be-88e3-4e3148f03b2c tempest-AbsoluteLimitsTests-863760549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9736f3f-e9b2-43fb-8815-33d551973f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:09 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9f2f1df3-b4b1-40be-88e3-4e3148f03b2c tempest-AbsoluteLimitsTests-863760549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9736f3f-e9b2-43fb-8815-33d551973f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:09 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9f2f1df3-b4b1-40be-88e3-4e3148f03b2c tempest-AbsoluteLimitsTests-863760549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea246a2c-a6bb-4c9b-a0b1-7c17659c6593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:09 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-9f2f1df3-b4b1-40be-88e3-4e3148f03b2c tempest-AbsoluteLimitsTests-863760549 None] Volume dfd92724-345c-4a16-a74d-ec67592b28f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfd92724-345c-4a16-a74d-ec67592b28f5', 'volume_size': 1} Jul 30 16:56:09 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-9f2f1df3-b4b1-40be-88e3-4e3148f03b2c tempest-AbsoluteLimitsTests-863760549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:56:09 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-9f2f1df3-b4b1-40be-88e3-4e3148f03b2c tempest-AbsoluteLimitsTests-863760549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:56:09 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-9f2f1df3-b4b1-40be-88e3-4e3148f03b2c tempest-AbsoluteLimitsTests-863760549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:56:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1071003524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfd92724-345c-4a16-a74d-ec67592b28f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb8841367ce546aa8ebba129658d6f6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:56:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:56:10Z,use_quota=True,user_id='0b40c65936df41cd97d988121d5e5c49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:56:09 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-9f2f1df3-b4b1-40be-88e3-4e3148f03b2c tempest-AbsoluteLimitsTests-863760549 None] Creating volume dfd92724-345c-4a16-a74d-ec67592b28f5 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:56:09 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-9f2f1df3-b4b1-40be-88e3-4e3148f03b2c tempest-AbsoluteLimitsTests-863760549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:56:09 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-9f2f1df3-b4b1-40be-88e3-4e3148f03b2c tempest-AbsoluteLimitsTests-863760549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:56:09 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-9f2f1df3-b4b1-40be-88e3-4e3148f03b2c tempest-AbsoluteLimitsTests-863760549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:56:09 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-9f2f1df3-b4b1-40be-88e3-4e3148f03b2c tempest-AbsoluteLimitsTests-863760549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:56:09 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-9f2f1df3-b4b1-40be-88e3-4e3148f03b2c tempest-AbsoluteLimitsTests-863760549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:56:09 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-9f2f1df3-b4b1-40be-88e3-4e3148f03b2c tempest-AbsoluteLimitsTests-863760549 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:56:09 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-9f2f1df3-b4b1-40be-88e3-4e3148f03b2c tempest-AbsoluteLimitsTests-863760549 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 16:56:09 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9f2f1df3-b4b1-40be-88e3-4e3148f03b2c tempest-AbsoluteLimitsTests-863760549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-dfd92724-345c-4a16-a74d-ec67592b28f5 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:09 devstack sudo[97405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-dfd92724-345c-4a16-a74d-ec67592b28f5 1073741824 Jul 30 16:56:09 devstack sudo[97405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:10 devstack sudo[97405]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:10 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9f2f1df3-b4b1-40be-88e3-4e3148f03b2c tempest-AbsoluteLimitsTests-863760549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-dfd92724-345c-4a16-a74d-ec67592b28f5 1073741824" returned: 0 in 0.577s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:10 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9f2f1df3-b4b1-40be-88e3-4e3148f03b2c tempest-AbsoluteLimitsTests-863760549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-dfd92724-345c-4a16-a74d-ec67592b28f5 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:10 devstack sudo[97413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-dfd92724-345c-4a16-a74d-ec67592b28f5 Jul 30 16:56:10 devstack sudo[97413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:10 devstack sudo[97413]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:10 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9f2f1df3-b4b1-40be-88e3-4e3148f03b2c tempest-AbsoluteLimitsTests-863760549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-dfd92724-345c-4a16-a74d-ec67592b28f5" returned: 0 in 0.306s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:10 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-9f2f1df3-b4b1-40be-88e3-4e3148f03b2c tempest-AbsoluteLimitsTests-863760549 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:56:10 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-9f2f1df3-b4b1-40be-88e3-4e3148f03b2c tempest-AbsoluteLimitsTests-863760549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:56:10 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9f2f1df3-b4b1-40be-88e3-4e3148f03b2c tempest-AbsoluteLimitsTests-863760549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea246a2c-a6bb-4c9b-a0b1-7c17659c6593) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfd92724-345c-4a16-a74d-ec67592b28f5', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:10 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9f2f1df3-b4b1-40be-88e3-4e3148f03b2c tempest-AbsoluteLimitsTests-863760549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98b042c2-5c32-4bb2-9e36-5fdd3b56524e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:10 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-9f2f1df3-b4b1-40be-88e3-4e3148f03b2c tempest-AbsoluteLimitsTests-863760549 None] Volume volume-dfd92724-345c-4a16-a74d-ec67592b28f5 (dfd92724-345c-4a16-a74d-ec67592b28f5): created successfully Jul 30 16:56:10 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9f2f1df3-b4b1-40be-88e3-4e3148f03b2c tempest-AbsoluteLimitsTests-863760549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98b042c2-5c32-4bb2-9e36-5fdd3b56524e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:10 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9f2f1df3-b4b1-40be-88e3-4e3148f03b2c tempest-AbsoluteLimitsTests-863760549 None] Flow 'volume_create_manager' (38e6175d-f7d5-4ca5-945d-04c4dddb4431) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:56:10 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-9f2f1df3-b4b1-40be-88e3-4e3148f03b2c tempest-AbsoluteLimitsTests-863760549 None] Created volume successfully. Jul 30 16:56:12 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-9957c68e-249c-4823-b243-7f5b2abe2f5c tempest-AbsoluteLimitsTests-863760549 None] Acquiring lock "cinder-dfd92724-345c-4a16-a74d-ec67592b28f5-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:56:12 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-9957c68e-249c-4823-b243-7f5b2abe2f5c tempest-AbsoluteLimitsTests-863760549 None] Lock "cinder-dfd92724-345c-4a16-a74d-ec67592b28f5-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:56:12 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-9957c68e-249c-4823-b243-7f5b2abe2f5c tempest-AbsoluteLimitsTests-863760549 None] Acquiring lock "cinder-quobyte-dfd92724-345c-4a16-a74d-ec67592b28f5" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:56:12 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-9957c68e-249c-4823-b243-7f5b2abe2f5c tempest-AbsoluteLimitsTests-863760549 None] Lock "cinder-quobyte-dfd92724-345c-4a16-a74d-ec67592b28f5" acquired by "delete_volume" :: waited 0.024s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:56:12 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f7305ca-f267-467d-8823-dc7e7bbd31ce]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:56:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9957c68e-249c-4823-b243-7f5b2abe2f5c tempest-AbsoluteLimitsTests-863760549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-dfd92724-345c-4a16-a74d-ec67592b28f5 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:12 devstack sudo[97417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-dfd92724-345c-4a16-a74d-ec67592b28f5 Jul 30 16:56:12 devstack sudo[97417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:12 devstack sudo[97417]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9957c68e-249c-4823-b243-7f5b2abe2f5c tempest-AbsoluteLimitsTests-863760549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-dfd92724-345c-4a16-a74d-ec67592b28f5" returned: 0 in 0.476s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9957c68e-249c-4823-b243-7f5b2abe2f5c tempest-AbsoluteLimitsTests-863760549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-dfd92724-345c-4a16-a74d-ec67592b28f5 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:12 devstack sudo[97424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-dfd92724-345c-4a16-a74d-ec67592b28f5 Jul 30 16:56:12 devstack sudo[97424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:12 devstack sudo[97424]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9957c68e-249c-4823-b243-7f5b2abe2f5c tempest-AbsoluteLimitsTests-863760549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-dfd92724-345c-4a16-a74d-ec67592b28f5" returned: 0 in 0.332s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:13 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-9957c68e-249c-4823-b243-7f5b2abe2f5c tempest-AbsoluteLimitsTests-863760549 None] Lock "cinder-quobyte-dfd92724-345c-4a16-a74d-ec67592b28f5" released by "delete_volume" :: held 0.868s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:56:13 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-9957c68e-249c-4823-b243-7f5b2abe2f5c tempest-AbsoluteLimitsTests-863760549 None] Created reservations ['6b1a667b-8808-41a4-8067-ecdc15e592ee', '40ff106a-b8f2-47ee-bd4d-418be9636c5b', '3d0716b8-ac9d-4c89-a116-78d71acb16c1', '95bd9b73-c41f-412b-a33a-6dbaf647dbd4'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:56:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-9957c68e-249c-4823-b243-7f5b2abe2f5c tempest-AbsoluteLimitsTests-863760549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:56:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-9957c68e-249c-4823-b243-7f5b2abe2f5c tempest-AbsoluteLimitsTests-863760549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:56:13 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-9957c68e-249c-4823-b243-7f5b2abe2f5c tempest-AbsoluteLimitsTests-863760549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:56:13 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-9957c68e-249c-4823-b243-7f5b2abe2f5c tempest-AbsoluteLimitsTests-863760549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:56:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-9957c68e-249c-4823-b243-7f5b2abe2f5c tempest-AbsoluteLimitsTests-863760549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:56:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9957c68e-249c-4823-b243-7f5b2abe2f5c tempest-AbsoluteLimitsTests-863760549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:13 devstack sudo[97427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:56:13 devstack sudo[97427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:13 devstack sudo[97427]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9957c68e-249c-4823-b243-7f5b2abe2f5c tempest-AbsoluteLimitsTests-863760549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.399s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:13 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-9957c68e-249c-4823-b243-7f5b2abe2f5c tempest-AbsoluteLimitsTests-863760549 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:56:13 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-9957c68e-249c-4823-b243-7f5b2abe2f5c tempest-AbsoluteLimitsTests-863760549 None] Deleted volume successfully. Jul 30 16:56:13 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-9957c68e-249c-4823-b243-7f5b2abe2f5c tempest-AbsoluteLimitsTests-863760549 None] Lock "cinder-dfd92724-345c-4a16-a74d-ec67592b28f5-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:56:23 devstack cinder-volume[88568]: DEBUG dbcounter [-] [88568] Writing DB stats cinder:SELECT=39,cinder:INSERT=8,cinder:UPDATE=30,cinder:DELETE=3 {{(pid=88568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:56:23 devstack cinder-volume[88568]: DEBUG dbcounter [-] [88568] Writing DB stats cinder:UPDATE=37,cinder:DELETE=3,cinder:SELECT=24,cinder:INSERT=8 {{(pid=88568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:56:24 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-97de093a-d3fe-4904-a2dd-6ed8c8d7e08e tempest-VolumesTransfersV355Test-298642761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:56:24 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-97de093a-d3fe-4904-a2dd-6ed8c8d7e08e tempest-VolumesTransfersV355Test-298642761 None] Flow 'volume_create_manager' (cc8bc74c-a1a9-41c1-a75e-d45f18fde6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:56:24 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-97de093a-d3fe-4904-a2dd-6ed8c8d7e08e tempest-VolumesTransfersV355Test-298642761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (038d8f56-4c4e-4a51-8f6c-97a6f349de8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:24 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-97de093a-d3fe-4904-a2dd-6ed8c8d7e08e tempest-VolumesTransfersV355Test-298642761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (038d8f56-4c4e-4a51-8f6c-97a6f349de8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:56:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1656438012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f323fbd-8511-4ef0-ac28-44bea7d4bd2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a79f32192fac47b798a06b11049dd65c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:56:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:56:24Z,use_quota=True,user_id='d265017b5f514ad5825c4e7a0dabcfff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:24 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-97de093a-d3fe-4904-a2dd-6ed8c8d7e08e tempest-VolumesTransfersV355Test-298642761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e457a4ac-6b83-4f0f-a0cb-1a793ecb85c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:24 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-97de093a-d3fe-4904-a2dd-6ed8c8d7e08e tempest-VolumesTransfersV355Test-298642761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e457a4ac-6b83-4f0f-a0cb-1a793ecb85c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:24 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-97de093a-d3fe-4904-a2dd-6ed8c8d7e08e tempest-VolumesTransfersV355Test-298642761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b1e96d4-1c95-4e73-90ae-bf14df119283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:24 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-97de093a-d3fe-4904-a2dd-6ed8c8d7e08e tempest-VolumesTransfersV355Test-298642761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b1e96d4-1c95-4e73-90ae-bf14df119283) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f323fbd-8511-4ef0-ac28-44bea7d4bd2c', 'volume_name': 'volume-4f323fbd-8511-4ef0-ac28-44bea7d4bd2c', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:24 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-97de093a-d3fe-4904-a2dd-6ed8c8d7e08e tempest-VolumesTransfersV355Test-298642761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (699b8d9d-2752-4dba-a542-e904c5059139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:24 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-97de093a-d3fe-4904-a2dd-6ed8c8d7e08e tempest-VolumesTransfersV355Test-298642761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (699b8d9d-2752-4dba-a542-e904c5059139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:24 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-97de093a-d3fe-4904-a2dd-6ed8c8d7e08e tempest-VolumesTransfersV355Test-298642761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3790845d-911c-46f5-a2cb-3a469b220458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:24 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-97de093a-d3fe-4904-a2dd-6ed8c8d7e08e tempest-VolumesTransfersV355Test-298642761 None] Volume 4f323fbd-8511-4ef0-ac28-44bea7d4bd2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f323fbd-8511-4ef0-ac28-44bea7d4bd2c', 'volume_size': 1} Jul 30 16:56:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-97de093a-d3fe-4904-a2dd-6ed8c8d7e08e tempest-VolumesTransfersV355Test-298642761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:56:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-97de093a-d3fe-4904-a2dd-6ed8c8d7e08e tempest-VolumesTransfersV355Test-298642761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:56:24 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-97de093a-d3fe-4904-a2dd-6ed8c8d7e08e tempest-VolumesTransfersV355Test-298642761 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:56:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1656438012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f323fbd-8511-4ef0-ac28-44bea7d4bd2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a79f32192fac47b798a06b11049dd65c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:56:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:56:24Z,use_quota=True,user_id='d265017b5f514ad5825c4e7a0dabcfff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:56:24 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-97de093a-d3fe-4904-a2dd-6ed8c8d7e08e tempest-VolumesTransfersV355Test-298642761 None] Creating volume 4f323fbd-8511-4ef0-ac28-44bea7d4bd2c {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:56:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-97de093a-d3fe-4904-a2dd-6ed8c8d7e08e tempest-VolumesTransfersV355Test-298642761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:56:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-97de093a-d3fe-4904-a2dd-6ed8c8d7e08e tempest-VolumesTransfersV355Test-298642761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:56:24 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-97de093a-d3fe-4904-a2dd-6ed8c8d7e08e tempest-VolumesTransfersV355Test-298642761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:56:24 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-97de093a-d3fe-4904-a2dd-6ed8c8d7e08e tempest-VolumesTransfersV355Test-298642761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:56:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-97de093a-d3fe-4904-a2dd-6ed8c8d7e08e tempest-VolumesTransfersV355Test-298642761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:56:24 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-97de093a-d3fe-4904-a2dd-6ed8c8d7e08e tempest-VolumesTransfersV355Test-298642761 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:56:24 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-97de093a-d3fe-4904-a2dd-6ed8c8d7e08e tempest-VolumesTransfersV355Test-298642761 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 16:56:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-97de093a-d3fe-4904-a2dd-6ed8c8d7e08e tempest-VolumesTransfersV355Test-298642761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4f323fbd-8511-4ef0-ac28-44bea7d4bd2c 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:24 devstack sudo[97474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4f323fbd-8511-4ef0-ac28-44bea7d4bd2c 1073741824 Jul 30 16:56:24 devstack sudo[97474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:24 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec472808-158e-4fad-a9be-24c6df80de57 tempest-VolumeTypesAccessTest-975754958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:56:24 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ec472808-158e-4fad-a9be-24c6df80de57 tempest-VolumeTypesAccessTest-975754958 None] Flow 'volume_create_manager' (81c4ed55-ff1f-44a3-8d34-1152f44819b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:56:24 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ec472808-158e-4fad-a9be-24c6df80de57 tempest-VolumeTypesAccessTest-975754958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2d233f5-fe7a-40f5-91f9-af654a955918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:24 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ec472808-158e-4fad-a9be-24c6df80de57 tempest-VolumeTypesAccessTest-975754958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2d233f5-fe7a-40f5-91f9-af654a955918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:56:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-272638181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40c8a5a0-fabe-483c-8337-c6b081a197a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61d5ff95e47746a4a366694a6b941e34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:56:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:56:24Z,use_quota=True,user_id='68d04283eef14455b0ea5cb57b47d733',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3377f61-6e95-4ef3-9322-21ad84acc42d),volume_type_id=f3377f61-6e95-4ef3-9322-21ad84acc42d)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:24 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ec472808-158e-4fad-a9be-24c6df80de57 tempest-VolumeTypesAccessTest-975754958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d4ffc4a-8cdb-459f-a368-8c9a35911108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:24 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ec472808-158e-4fad-a9be-24c6df80de57 tempest-VolumeTypesAccessTest-975754958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d4ffc4a-8cdb-459f-a368-8c9a35911108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:24 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ec472808-158e-4fad-a9be-24c6df80de57 tempest-VolumeTypesAccessTest-975754958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7934ac6-6ef3-4a00-9fd0-a9d04626548a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:24 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ec472808-158e-4fad-a9be-24c6df80de57 tempest-VolumeTypesAccessTest-975754958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7934ac6-6ef3-4a00-9fd0-a9d04626548a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40c8a5a0-fabe-483c-8337-c6b081a197a2', 'volume_name': 'volume-40c8a5a0-fabe-483c-8337-c6b081a197a2', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:24 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ec472808-158e-4fad-a9be-24c6df80de57 tempest-VolumeTypesAccessTest-975754958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e574372-c69f-4ac3-916e-e1871bbdfb14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:24 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ec472808-158e-4fad-a9be-24c6df80de57 tempest-VolumeTypesAccessTest-975754958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e574372-c69f-4ac3-916e-e1871bbdfb14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:24 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ec472808-158e-4fad-a9be-24c6df80de57 tempest-VolumeTypesAccessTest-975754958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a66ae9c1-209b-4d6a-bf63-cd03a093bd42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:24 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-ec472808-158e-4fad-a9be-24c6df80de57 tempest-VolumeTypesAccessTest-975754958 None] Volume 40c8a5a0-fabe-483c-8337-c6b081a197a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40c8a5a0-fabe-483c-8337-c6b081a197a2', 'volume_size': 1} Jul 30 16:56:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-ec472808-158e-4fad-a9be-24c6df80de57 tempest-VolumeTypesAccessTest-975754958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:56:24 devstack sudo[97474]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-97de093a-d3fe-4904-a2dd-6ed8c8d7e08e tempest-VolumesTransfersV355Test-298642761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4f323fbd-8511-4ef0-ac28-44bea7d4bd2c 1073741824" returned: 0 in 0.625s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-97de093a-d3fe-4904-a2dd-6ed8c8d7e08e tempest-VolumesTransfersV355Test-298642761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4f323fbd-8511-4ef0-ac28-44bea7d4bd2c {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:24 devstack sudo[97482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4f323fbd-8511-4ef0-ac28-44bea7d4bd2c Jul 30 16:56:24 devstack sudo[97482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:25 devstack sudo[97482]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:25 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-97de093a-d3fe-4904-a2dd-6ed8c8d7e08e tempest-VolumesTransfersV355Test-298642761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4f323fbd-8511-4ef0-ac28-44bea7d4bd2c" returned: 0 in 0.433s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:25 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-97de093a-d3fe-4904-a2dd-6ed8c8d7e08e tempest-VolumesTransfersV355Test-298642761 None] <== create_volume: return (1124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:56:25 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-97de093a-d3fe-4904-a2dd-6ed8c8d7e08e tempest-VolumesTransfersV355Test-298642761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:56:25 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-ec472808-158e-4fad-a9be-24c6df80de57 tempest-VolumeTypesAccessTest-975754958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.689s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:56:25 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-ec472808-158e-4fad-a9be-24c6df80de57 tempest-VolumeTypesAccessTest-975754958 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:56:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-272638181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40c8a5a0-fabe-483c-8337-c6b081a197a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61d5ff95e47746a4a366694a6b941e34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:56:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:56:24Z,use_quota=True,user_id='68d04283eef14455b0ea5cb57b47d733',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3377f61-6e95-4ef3-9322-21ad84acc42d),volume_type_id=f3377f61-6e95-4ef3-9322-21ad84acc42d)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:56:25 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-ec472808-158e-4fad-a9be-24c6df80de57 tempest-VolumeTypesAccessTest-975754958 None] Creating volume 40c8a5a0-fabe-483c-8337-c6b081a197a2 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:56:25 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-ec472808-158e-4fad-a9be-24c6df80de57 tempest-VolumeTypesAccessTest-975754958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:56:25 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-ec472808-158e-4fad-a9be-24c6df80de57 tempest-VolumeTypesAccessTest-975754958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:56:25 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-ec472808-158e-4fad-a9be-24c6df80de57 tempest-VolumeTypesAccessTest-975754958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:56:25 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-ec472808-158e-4fad-a9be-24c6df80de57 tempest-VolumeTypesAccessTest-975754958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:56:25 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-ec472808-158e-4fad-a9be-24c6df80de57 tempest-VolumeTypesAccessTest-975754958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.068s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:56:25 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-ec472808-158e-4fad-a9be-24c6df80de57 tempest-VolumeTypesAccessTest-975754958 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:56:25 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-ec472808-158e-4fad-a9be-24c6df80de57 tempest-VolumeTypesAccessTest-975754958 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 16:56:25 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-ec472808-158e-4fad-a9be-24c6df80de57 tempest-VolumeTypesAccessTest-975754958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-40c8a5a0-fabe-483c-8337-c6b081a197a2 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:25 devstack sudo[97524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-40c8a5a0-fabe-483c-8337-c6b081a197a2 1073741824 Jul 30 16:56:25 devstack sudo[97524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:25 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-97de093a-d3fe-4904-a2dd-6ed8c8d7e08e tempest-VolumesTransfersV355Test-298642761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3790845d-911c-46f5-a2cb-3a469b220458) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f323fbd-8511-4ef0-ac28-44bea7d4bd2c', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:25 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-97de093a-d3fe-4904-a2dd-6ed8c8d7e08e tempest-VolumesTransfersV355Test-298642761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d01fd98-4f75-4084-afeb-d9cd732c492f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:25 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-97de093a-d3fe-4904-a2dd-6ed8c8d7e08e tempest-VolumesTransfersV355Test-298642761 None] Volume volume-4f323fbd-8511-4ef0-ac28-44bea7d4bd2c (4f323fbd-8511-4ef0-ac28-44bea7d4bd2c): created successfully Jul 30 16:56:25 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-97de093a-d3fe-4904-a2dd-6ed8c8d7e08e tempest-VolumesTransfersV355Test-298642761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d01fd98-4f75-4084-afeb-d9cd732c492f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:25 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-97de093a-d3fe-4904-a2dd-6ed8c8d7e08e tempest-VolumesTransfersV355Test-298642761 None] Flow 'volume_create_manager' (cc8bc74c-a1a9-41c1-a75e-d45f18fde6e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:56:25 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-97de093a-d3fe-4904-a2dd-6ed8c8d7e08e tempest-VolumesTransfersV355Test-298642761 None] Created volume successfully. Jul 30 16:56:26 devstack sudo[97524]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-ec472808-158e-4fad-a9be-24c6df80de57 tempest-VolumeTypesAccessTest-975754958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-40c8a5a0-fabe-483c-8337-c6b081a197a2 1073741824" returned: 0 in 1.027s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-ec472808-158e-4fad-a9be-24c6df80de57 tempest-VolumeTypesAccessTest-975754958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-40c8a5a0-fabe-483c-8337-c6b081a197a2 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:26 devstack sudo[97567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-40c8a5a0-fabe-483c-8337-c6b081a197a2 Jul 30 16:56:26 devstack sudo[97567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:26 devstack sudo[97567]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-ec472808-158e-4fad-a9be-24c6df80de57 tempest-VolumeTypesAccessTest-975754958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-40c8a5a0-fabe-483c-8337-c6b081a197a2" returned: 0 in 0.455s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:26 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-ec472808-158e-4fad-a9be-24c6df80de57 tempest-VolumeTypesAccessTest-975754958 None] <== create_volume: return (1623ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:56:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-ec472808-158e-4fad-a9be-24c6df80de57 tempest-VolumeTypesAccessTest-975754958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.634s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:56:26 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ec472808-158e-4fad-a9be-24c6df80de57 tempest-VolumeTypesAccessTest-975754958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a66ae9c1-209b-4d6a-bf63-cd03a093bd42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40c8a5a0-fabe-483c-8337-c6b081a197a2', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:27 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ec472808-158e-4fad-a9be-24c6df80de57 tempest-VolumeTypesAccessTest-975754958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6c04dff-eace-4e08-ac59-7a561898c80c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:27 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-ec472808-158e-4fad-a9be-24c6df80de57 tempest-VolumeTypesAccessTest-975754958 None] Volume volume-40c8a5a0-fabe-483c-8337-c6b081a197a2 (40c8a5a0-fabe-483c-8337-c6b081a197a2): created successfully Jul 30 16:56:27 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ec472808-158e-4fad-a9be-24c6df80de57 tempest-VolumeTypesAccessTest-975754958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6c04dff-eace-4e08-ac59-7a561898c80c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:27 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ec472808-158e-4fad-a9be-24c6df80de57 tempest-VolumeTypesAccessTest-975754958 None] Flow 'volume_create_manager' (81c4ed55-ff1f-44a3-8d34-1152f44819b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:56:27 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-ec472808-158e-4fad-a9be-24c6df80de57 tempest-VolumeTypesAccessTest-975754958 None] Created volume successfully. Jul 30 16:56:27 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-8952f0c0-64b3-40c8-9cbe-f309f1449ac3 tempest-VolumesTransfersV355Test-1647797661 None] Transfer volume completed successfully. Jul 30 16:56:27 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-acb5a3f2-cc61-4c28-8496-0dd380666e0f tempest-VolumesTransfersV355Test-1126991584 None] Acquiring lock "cinder-4f323fbd-8511-4ef0-ac28-44bea7d4bd2c-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:56:28 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-acb5a3f2-cc61-4c28-8496-0dd380666e0f tempest-VolumesTransfersV355Test-1126991584 None] Lock "cinder-4f323fbd-8511-4ef0-ac28-44bea7d4bd2c-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:56:28 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-232d66fe-8e5b-4be0-b4fd-2440c385d962 tempest-VolumeTypesAccessTest-975754958 None] Acquiring lock "cinder-40c8a5a0-fabe-483c-8337-c6b081a197a2-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:56:28 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-acb5a3f2-cc61-4c28-8496-0dd380666e0f tempest-VolumesTransfersV355Test-1126991584 None] Acquiring lock "cinder-quobyte-4f323fbd-8511-4ef0-ac28-44bea7d4bd2c" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:56:28 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-acb5a3f2-cc61-4c28-8496-0dd380666e0f tempest-VolumesTransfersV355Test-1126991584 None] Lock "cinder-quobyte-4f323fbd-8511-4ef0-ac28-44bea7d4bd2c" acquired by "delete_volume" :: waited 0.035s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:56:28 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-232d66fe-8e5b-4be0-b4fd-2440c385d962 tempest-VolumeTypesAccessTest-975754958 None] Lock "cinder-40c8a5a0-fabe-483c-8337-c6b081a197a2-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:56:28 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b1aabd-f3ac-4ee6-b087-f7f1441a60ab]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:56:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-acb5a3f2-cc61-4c28-8496-0dd380666e0f tempest-VolumesTransfersV355Test-1126991584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4f323fbd-8511-4ef0-ac28-44bea7d4bd2c {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:28 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-232d66fe-8e5b-4be0-b4fd-2440c385d962 tempest-VolumeTypesAccessTest-975754958 None] Acquiring lock "cinder-quobyte-40c8a5a0-fabe-483c-8337-c6b081a197a2" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:56:28 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-232d66fe-8e5b-4be0-b4fd-2440c385d962 tempest-VolumeTypesAccessTest-975754958 None] Lock "cinder-quobyte-40c8a5a0-fabe-483c-8337-c6b081a197a2" acquired by "delete_volume" :: waited 0.021s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:56:28 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ac8848-2f2c-40ca-a4e0-a8ac7193e03a]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:56:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-232d66fe-8e5b-4be0-b4fd-2440c385d962 tempest-VolumeTypesAccessTest-975754958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-40c8a5a0-fabe-483c-8337-c6b081a197a2 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:28 devstack sudo[97632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4f323fbd-8511-4ef0-ac28-44bea7d4bd2c Jul 30 16:56:28 devstack sudo[97632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:28 devstack sudo[97633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-40c8a5a0-fabe-483c-8337-c6b081a197a2 Jul 30 16:56:28 devstack sudo[97633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:28 devstack sudo[97632]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-acb5a3f2-cc61-4c28-8496-0dd380666e0f tempest-VolumesTransfersV355Test-1126991584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4f323fbd-8511-4ef0-ac28-44bea7d4bd2c" returned: 0 in 0.536s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-acb5a3f2-cc61-4c28-8496-0dd380666e0f tempest-VolumesTransfersV355Test-1126991584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4f323fbd-8511-4ef0-ac28-44bea7d4bd2c {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:28 devstack sudo[97633]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:28 devstack sudo[97667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4f323fbd-8511-4ef0-ac28-44bea7d4bd2c Jul 30 16:56:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-232d66fe-8e5b-4be0-b4fd-2440c385d962 tempest-VolumeTypesAccessTest-975754958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-40c8a5a0-fabe-483c-8337-c6b081a197a2" returned: 0 in 0.489s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-232d66fe-8e5b-4be0-b4fd-2440c385d962 tempest-VolumeTypesAccessTest-975754958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-40c8a5a0-fabe-483c-8337-c6b081a197a2 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:28 devstack sudo[97667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:28 devstack sudo[97669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-40c8a5a0-fabe-483c-8337-c6b081a197a2 Jul 30 16:56:28 devstack sudo[97669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:29 devstack sudo[97667]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:29 devstack sudo[97669]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-acb5a3f2-cc61-4c28-8496-0dd380666e0f tempest-VolumesTransfersV355Test-1126991584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4f323fbd-8511-4ef0-ac28-44bea7d4bd2c" returned: 0 in 0.464s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-232d66fe-8e5b-4be0-b4fd-2440c385d962 tempest-VolumeTypesAccessTest-975754958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-40c8a5a0-fabe-483c-8337-c6b081a197a2" returned: 0 in 0.461s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:29 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-acb5a3f2-cc61-4c28-8496-0dd380666e0f tempest-VolumesTransfersV355Test-1126991584 None] Lock "cinder-quobyte-4f323fbd-8511-4ef0-ac28-44bea7d4bd2c" released by "delete_volume" :: held 1.170s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:56:29 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-232d66fe-8e5b-4be0-b4fd-2440c385d962 tempest-VolumeTypesAccessTest-975754958 None] Lock "cinder-quobyte-40c8a5a0-fabe-483c-8337-c6b081a197a2" released by "delete_volume" :: held 1.100s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:56:29 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-acb5a3f2-cc61-4c28-8496-0dd380666e0f tempest-VolumesTransfersV355Test-1126991584 None] Created reservations ['1f22ee28-c507-4753-9a61-47d82e92a80b', '9718185d-77c4-47fa-85a0-6a348ea6d0ea', '41222bb8-1016-4320-80ac-d0e2e2eed709', '39624678-4a53-4882-a9e7-cfb4acb9d4c5'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:56:29 devstack cinder-volume[88568]: WARNING cinder.quota [None req-232d66fe-8e5b-4be0-b4fd-2440c385d962 tempest-VolumeTypesAccessTest-975754958 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1297807761 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1297807761, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:56:29 devstack cinder-volume[88568]: WARNING cinder.quota [None req-232d66fe-8e5b-4be0-b4fd-2440c385d962 tempest-VolumeTypesAccessTest-975754958 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1297807761 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1297807761, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:56:29 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-232d66fe-8e5b-4be0-b4fd-2440c385d962 tempest-VolumeTypesAccessTest-975754958 None] Created reservations ['243c9207-db81-4a1a-aaf4-f8546da3107c', 'f424f822-78f0-4783-b8ea-7b30a2d05223', '433e2f3f-e92c-45d3-85d7-143e4809898f', '7ab693c2-585a-40a3-98fa-acc0adbedf45'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:56:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-acb5a3f2-cc61-4c28-8496-0dd380666e0f tempest-VolumesTransfersV355Test-1126991584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:56:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-acb5a3f2-cc61-4c28-8496-0dd380666e0f tempest-VolumesTransfersV355Test-1126991584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:56:29 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-acb5a3f2-cc61-4c28-8496-0dd380666e0f tempest-VolumesTransfersV355Test-1126991584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:56:29 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-acb5a3f2-cc61-4c28-8496-0dd380666e0f tempest-VolumesTransfersV355Test-1126991584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:56:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-acb5a3f2-cc61-4c28-8496-0dd380666e0f tempest-VolumesTransfersV355Test-1126991584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:56:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-acb5a3f2-cc61-4c28-8496-0dd380666e0f tempest-VolumesTransfersV355Test-1126991584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:29 devstack sudo[97677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:56:29 devstack sudo[97677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-232d66fe-8e5b-4be0-b4fd-2440c385d962 tempest-VolumeTypesAccessTest-975754958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:56:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-232d66fe-8e5b-4be0-b4fd-2440c385d962 tempest-VolumeTypesAccessTest-975754958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:56:29 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-232d66fe-8e5b-4be0-b4fd-2440c385d962 tempest-VolumeTypesAccessTest-975754958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:56:29 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-232d66fe-8e5b-4be0-b4fd-2440c385d962 tempest-VolumeTypesAccessTest-975754958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:56:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-232d66fe-8e5b-4be0-b4fd-2440c385d962 tempest-VolumeTypesAccessTest-975754958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:56:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-232d66fe-8e5b-4be0-b4fd-2440c385d962 tempest-VolumeTypesAccessTest-975754958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:29 devstack sudo[97679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:56:29 devstack sudo[97679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:30 devstack sudo[97677]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:30 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-acb5a3f2-cc61-4c28-8496-0dd380666e0f tempest-VolumesTransfersV355Test-1126991584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.750s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:30 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-acb5a3f2-cc61-4c28-8496-0dd380666e0f tempest-VolumesTransfersV355Test-1126991584 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:56:30 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-acb5a3f2-cc61-4c28-8496-0dd380666e0f tempest-VolumesTransfersV355Test-1126991584 None] Deleted volume successfully. Jul 30 16:56:30 devstack sudo[97679]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:30 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-232d66fe-8e5b-4be0-b4fd-2440c385d962 tempest-VolumeTypesAccessTest-975754958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.736s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:30 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-232d66fe-8e5b-4be0-b4fd-2440c385d962 tempest-VolumeTypesAccessTest-975754958 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:56:30 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-232d66fe-8e5b-4be0-b4fd-2440c385d962 tempest-VolumeTypesAccessTest-975754958 None] Deleted volume successfully. Jul 30 16:56:30 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-acb5a3f2-cc61-4c28-8496-0dd380666e0f tempest-VolumesTransfersV355Test-1126991584 None] Lock "cinder-4f323fbd-8511-4ef0-ac28-44bea7d4bd2c-delete_volume" released by "delete_volume" :: held 2.634s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:56:30 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-232d66fe-8e5b-4be0-b4fd-2440c385d962 tempest-VolumeTypesAccessTest-975754958 None] Lock "cinder-40c8a5a0-fabe-483c-8337-c6b081a197a2-delete_volume" released by "delete_volume" :: held 2.563s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:56:31 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-382a417c-0950-460d-bc7b-6645fa4e6d54 tempest-VolumesTransfersV355Test-298642761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:56:31 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-382a417c-0950-460d-bc7b-6645fa4e6d54 tempest-VolumesTransfersV355Test-298642761 None] Flow 'volume_create_manager' (aa6bfb4e-9eaf-4918-b3d0-03668eb5986f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:56:31 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-382a417c-0950-460d-bc7b-6645fa4e6d54 tempest-VolumesTransfersV355Test-298642761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf09657b-34a8-40ae-ad60-901a0ff97944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:31 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-382a417c-0950-460d-bc7b-6645fa4e6d54 tempest-VolumesTransfersV355Test-298642761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf09657b-34a8-40ae-ad60-901a0ff97944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:56:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-227442983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46a388dd-54fc-4309-8a08-67e0ec57e324,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a79f32192fac47b798a06b11049dd65c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:56:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:56:32Z,use_quota=True,user_id='d265017b5f514ad5825c4e7a0dabcfff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:31 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-382a417c-0950-460d-bc7b-6645fa4e6d54 tempest-VolumesTransfersV355Test-298642761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64813a32-1982-4c9f-8b7f-ba5cb6d7dd15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:31 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-382a417c-0950-460d-bc7b-6645fa4e6d54 tempest-VolumesTransfersV355Test-298642761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64813a32-1982-4c9f-8b7f-ba5cb6d7dd15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:31 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-382a417c-0950-460d-bc7b-6645fa4e6d54 tempest-VolumesTransfersV355Test-298642761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64d24081-86f7-438b-a454-2f0eafdc7a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:31 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-382a417c-0950-460d-bc7b-6645fa4e6d54 tempest-VolumesTransfersV355Test-298642761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64d24081-86f7-438b-a454-2f0eafdc7a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46a388dd-54fc-4309-8a08-67e0ec57e324', 'volume_name': 'volume-46a388dd-54fc-4309-8a08-67e0ec57e324', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:31 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-382a417c-0950-460d-bc7b-6645fa4e6d54 tempest-VolumesTransfersV355Test-298642761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f8d34cc-0163-4df6-8892-e5b0f673f261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:31 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-382a417c-0950-460d-bc7b-6645fa4e6d54 tempest-VolumesTransfersV355Test-298642761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f8d34cc-0163-4df6-8892-e5b0f673f261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:31 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-382a417c-0950-460d-bc7b-6645fa4e6d54 tempest-VolumesTransfersV355Test-298642761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f563fa72-5182-4a75-8493-6372fe6246af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:31 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-382a417c-0950-460d-bc7b-6645fa4e6d54 tempest-VolumesTransfersV355Test-298642761 None] Volume 46a388dd-54fc-4309-8a08-67e0ec57e324: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46a388dd-54fc-4309-8a08-67e0ec57e324', 'volume_size': 1} Jul 30 16:56:31 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-382a417c-0950-460d-bc7b-6645fa4e6d54 tempest-VolumesTransfersV355Test-298642761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:56:31 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-382a417c-0950-460d-bc7b-6645fa4e6d54 tempest-VolumesTransfersV355Test-298642761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:56:31 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-382a417c-0950-460d-bc7b-6645fa4e6d54 tempest-VolumesTransfersV355Test-298642761 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:56:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-227442983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46a388dd-54fc-4309-8a08-67e0ec57e324,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a79f32192fac47b798a06b11049dd65c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:56:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:56:32Z,use_quota=True,user_id='d265017b5f514ad5825c4e7a0dabcfff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:56:31 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-382a417c-0950-460d-bc7b-6645fa4e6d54 tempest-VolumesTransfersV355Test-298642761 None] Creating volume 46a388dd-54fc-4309-8a08-67e0ec57e324 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:56:31 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-382a417c-0950-460d-bc7b-6645fa4e6d54 tempest-VolumesTransfersV355Test-298642761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:56:31 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-382a417c-0950-460d-bc7b-6645fa4e6d54 tempest-VolumesTransfersV355Test-298642761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:56:31 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-382a417c-0950-460d-bc7b-6645fa4e6d54 tempest-VolumesTransfersV355Test-298642761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:56:31 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-382a417c-0950-460d-bc7b-6645fa4e6d54 tempest-VolumesTransfersV355Test-298642761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:56:31 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-382a417c-0950-460d-bc7b-6645fa4e6d54 tempest-VolumesTransfersV355Test-298642761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:56:31 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-382a417c-0950-460d-bc7b-6645fa4e6d54 tempest-VolumesTransfersV355Test-298642761 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:56:31 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-382a417c-0950-460d-bc7b-6645fa4e6d54 tempest-VolumesTransfersV355Test-298642761 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 16:56:31 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-382a417c-0950-460d-bc7b-6645fa4e6d54 tempest-VolumesTransfersV355Test-298642761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-46a388dd-54fc-4309-8a08-67e0ec57e324 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:32 devstack sudo[97698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-46a388dd-54fc-4309-8a08-67e0ec57e324 1073741824 Jul 30 16:56:32 devstack sudo[97698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:32 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5bd7e3d-1894-459b-add1-5e7a534171cc tempest-VolumesActionsTest-1451724932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:56:32 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-c5bd7e3d-1894-459b-add1-5e7a534171cc tempest-VolumesActionsTest-1451724932 None] Flow 'volume_create_manager' (3074fd33-6afc-462b-a665-3ff26ddf1f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:56:32 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-c5bd7e3d-1894-459b-add1-5e7a534171cc tempest-VolumesActionsTest-1451724932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d92a7e1-f697-41d3-80ff-b160404863f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:32 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-c5bd7e3d-1894-459b-add1-5e7a534171cc tempest-VolumesActionsTest-1451724932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d92a7e1-f697-41d3-80ff-b160404863f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:56:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-882151165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7e36d53-240e-4fb4-b0c5-d223f7933b5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d4cdc44a4d34072822865ed569a0be7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:56:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:56:32Z,use_quota=True,user_id='1cde7b4767cf4521bd2e65a15a371b3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:32 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-c5bd7e3d-1894-459b-add1-5e7a534171cc tempest-VolumesActionsTest-1451724932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee5acae6-b162-4d13-9387-8ee7036d74aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:32 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-c5bd7e3d-1894-459b-add1-5e7a534171cc tempest-VolumesActionsTest-1451724932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee5acae6-b162-4d13-9387-8ee7036d74aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:32 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-c5bd7e3d-1894-459b-add1-5e7a534171cc tempest-VolumesActionsTest-1451724932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fa0c11f-a171-40bd-92fe-aae9cd350114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:32 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-c5bd7e3d-1894-459b-add1-5e7a534171cc tempest-VolumesActionsTest-1451724932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fa0c11f-a171-40bd-92fe-aae9cd350114) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7e36d53-240e-4fb4-b0c5-d223f7933b5f', 'volume_name': 'volume-a7e36d53-240e-4fb4-b0c5-d223f7933b5f', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:32 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-c5bd7e3d-1894-459b-add1-5e7a534171cc tempest-VolumesActionsTest-1451724932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d19a0b2-cc45-4ab4-9950-da5327716b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:32 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-c5bd7e3d-1894-459b-add1-5e7a534171cc tempest-VolumesActionsTest-1451724932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d19a0b2-cc45-4ab4-9950-da5327716b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:32 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-c5bd7e3d-1894-459b-add1-5e7a534171cc tempest-VolumesActionsTest-1451724932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76012911-f399-4a0c-83d1-7c24c4bc7a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:32 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-c5bd7e3d-1894-459b-add1-5e7a534171cc tempest-VolumesActionsTest-1451724932 None] Volume a7e36d53-240e-4fb4-b0c5-d223f7933b5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7e36d53-240e-4fb4-b0c5-d223f7933b5f', 'volume_size': 1} Jul 30 16:56:32 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-c5bd7e3d-1894-459b-add1-5e7a534171cc tempest-VolumesActionsTest-1451724932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:56:33 devstack sudo[97698]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:33 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-382a417c-0950-460d-bc7b-6645fa4e6d54 tempest-VolumesTransfersV355Test-298642761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-46a388dd-54fc-4309-8a08-67e0ec57e324 1073741824" returned: 0 in 1.154s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:33 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-382a417c-0950-460d-bc7b-6645fa4e6d54 tempest-VolumesTransfersV355Test-298642761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-46a388dd-54fc-4309-8a08-67e0ec57e324 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:33 devstack sudo[97725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-46a388dd-54fc-4309-8a08-67e0ec57e324 Jul 30 16:56:33 devstack sudo[97725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:33 devstack sudo[97725]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:33 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-382a417c-0950-460d-bc7b-6645fa4e6d54 tempest-VolumesTransfersV355Test-298642761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-46a388dd-54fc-4309-8a08-67e0ec57e324" returned: 0 in 0.586s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:33 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-382a417c-0950-460d-bc7b-6645fa4e6d54 tempest-VolumesTransfersV355Test-298642761 None] <== create_volume: return (1872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:56:33 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-382a417c-0950-460d-bc7b-6645fa4e6d54 tempest-VolumesTransfersV355Test-298642761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.878s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:56:33 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-c5bd7e3d-1894-459b-add1-5e7a534171cc tempest-VolumesActionsTest-1451724932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.124s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:56:33 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-c5bd7e3d-1894-459b-add1-5e7a534171cc tempest-VolumesActionsTest-1451724932 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:56:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-882151165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7e36d53-240e-4fb4-b0c5-d223f7933b5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d4cdc44a4d34072822865ed569a0be7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:56:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:56:32Z,use_quota=True,user_id='1cde7b4767cf4521bd2e65a15a371b3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:56:33 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-c5bd7e3d-1894-459b-add1-5e7a534171cc tempest-VolumesActionsTest-1451724932 None] Creating volume a7e36d53-240e-4fb4-b0c5-d223f7933b5f {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:56:33 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-c5bd7e3d-1894-459b-add1-5e7a534171cc tempest-VolumesActionsTest-1451724932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:56:33 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-c5bd7e3d-1894-459b-add1-5e7a534171cc tempest-VolumesActionsTest-1451724932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:56:33 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-c5bd7e3d-1894-459b-add1-5e7a534171cc tempest-VolumesActionsTest-1451724932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:56:33 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-c5bd7e3d-1894-459b-add1-5e7a534171cc tempest-VolumesActionsTest-1451724932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:56:33 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-c5bd7e3d-1894-459b-add1-5e7a534171cc tempest-VolumesActionsTest-1451724932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:56:33 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-c5bd7e3d-1894-459b-add1-5e7a534171cc tempest-VolumesActionsTest-1451724932 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:56:33 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-c5bd7e3d-1894-459b-add1-5e7a534171cc tempest-VolumesActionsTest-1451724932 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 16:56:33 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-c5bd7e3d-1894-459b-add1-5e7a534171cc tempest-VolumesActionsTest-1451724932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-a7e36d53-240e-4fb4-b0c5-d223f7933b5f 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:33 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-382a417c-0950-460d-bc7b-6645fa4e6d54 tempest-VolumesTransfersV355Test-298642761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f563fa72-5182-4a75-8493-6372fe6246af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46a388dd-54fc-4309-8a08-67e0ec57e324', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:33 devstack sudo[97729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-a7e36d53-240e-4fb4-b0c5-d223f7933b5f 1073741824 Jul 30 16:56:33 devstack sudo[97729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:33 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-382a417c-0950-460d-bc7b-6645fa4e6d54 tempest-VolumesTransfersV355Test-298642761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0da308e-8771-484b-a3ec-7e1f331e57f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:33 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-382a417c-0950-460d-bc7b-6645fa4e6d54 tempest-VolumesTransfersV355Test-298642761 None] Volume volume-46a388dd-54fc-4309-8a08-67e0ec57e324 (46a388dd-54fc-4309-8a08-67e0ec57e324): created successfully Jul 30 16:56:33 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-382a417c-0950-460d-bc7b-6645fa4e6d54 tempest-VolumesTransfersV355Test-298642761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0da308e-8771-484b-a3ec-7e1f331e57f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:34 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-382a417c-0950-460d-bc7b-6645fa4e6d54 tempest-VolumesTransfersV355Test-298642761 None] Flow 'volume_create_manager' (aa6bfb4e-9eaf-4918-b3d0-03668eb5986f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:56:34 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-382a417c-0950-460d-bc7b-6645fa4e6d54 tempest-VolumesTransfersV355Test-298642761 None] Created volume successfully. Jul 30 16:56:34 devstack sudo[97729]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:34 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-c5bd7e3d-1894-459b-add1-5e7a534171cc tempest-VolumesActionsTest-1451724932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-a7e36d53-240e-4fb4-b0c5-d223f7933b5f 1073741824" returned: 0 in 0.922s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:34 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-c5bd7e3d-1894-459b-add1-5e7a534171cc tempest-VolumesActionsTest-1451724932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-a7e36d53-240e-4fb4-b0c5-d223f7933b5f {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:34 devstack sudo[97737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-a7e36d53-240e-4fb4-b0c5-d223f7933b5f Jul 30 16:56:34 devstack sudo[97737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:35 devstack sudo[97737]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-c5bd7e3d-1894-459b-add1-5e7a534171cc tempest-VolumesActionsTest-1451724932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-a7e36d53-240e-4fb4-b0c5-d223f7933b5f" returned: 0 in 0.811s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:35 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-c5bd7e3d-1894-459b-add1-5e7a534171cc tempest-VolumesActionsTest-1451724932 None] <== create_volume: return (1825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:56:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-c5bd7e3d-1894-459b-add1-5e7a534171cc tempest-VolumesActionsTest-1451724932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.832s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:56:35 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-c5bd7e3d-1894-459b-add1-5e7a534171cc tempest-VolumesActionsTest-1451724932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76012911-f399-4a0c-83d1-7c24c4bc7a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7e36d53-240e-4fb4-b0c5-d223f7933b5f', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:35 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-c5bd7e3d-1894-459b-add1-5e7a534171cc tempest-VolumesActionsTest-1451724932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bba25d13-4144-4253-8951-e53bdbcca76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:35 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-c5bd7e3d-1894-459b-add1-5e7a534171cc tempest-VolumesActionsTest-1451724932 None] Volume volume-a7e36d53-240e-4fb4-b0c5-d223f7933b5f (a7e36d53-240e-4fb4-b0c5-d223f7933b5f): created successfully Jul 30 16:56:35 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-c5bd7e3d-1894-459b-add1-5e7a534171cc tempest-VolumesActionsTest-1451724932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bba25d13-4144-4253-8951-e53bdbcca76f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:35 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-c5bd7e3d-1894-459b-add1-5e7a534171cc tempest-VolumesActionsTest-1451724932 None] Flow 'volume_create_manager' (3074fd33-6afc-462b-a665-3ff26ddf1f1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:56:35 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-c5bd7e3d-1894-459b-add1-5e7a534171cc tempest-VolumesActionsTest-1451724932 None] Created volume successfully. Jul 30 16:56:35 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-6123bb78-3256-4871-bb87-8cec1333a125 tempest-VolumesTransfersV355Test-1126991584 None] Acquiring lock "cinder-46a388dd-54fc-4309-8a08-67e0ec57e324-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:56:35 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-6123bb78-3256-4871-bb87-8cec1333a125 tempest-VolumesTransfersV355Test-1126991584 None] Lock "cinder-46a388dd-54fc-4309-8a08-67e0ec57e324-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:56:36 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-6123bb78-3256-4871-bb87-8cec1333a125 tempest-VolumesTransfersV355Test-1126991584 None] Acquiring lock "cinder-quobyte-46a388dd-54fc-4309-8a08-67e0ec57e324" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:56:36 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-6123bb78-3256-4871-bb87-8cec1333a125 tempest-VolumesTransfersV355Test-1126991584 None] Lock "cinder-quobyte-46a388dd-54fc-4309-8a08-67e0ec57e324" acquired by "delete_volume" :: waited 0.021s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:56:36 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d0c581-c57e-4e8e-af47-77419a04b90b]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:56:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-6123bb78-3256-4871-bb87-8cec1333a125 tempest-VolumesTransfersV355Test-1126991584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-46a388dd-54fc-4309-8a08-67e0ec57e324 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:36 devstack sudo[97740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-46a388dd-54fc-4309-8a08-67e0ec57e324 Jul 30 16:56:36 devstack sudo[97740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:36 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-62f9d151-c691-4779-bad5-e24d5c853598 tempest-VolumesActionsTest-1451724932 None] Acquiring lock "cinder-a7e36d53-240e-4fb4-b0c5-d223f7933b5f" by "attach_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:56:36 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-62f9d151-c691-4779-bad5-e24d5c853598 tempest-VolumesActionsTest-1451724932 None] Lock "cinder-a7e36d53-240e-4fb4-b0c5-d223f7933b5f" acquired by "attach_volume" :: waited 0.024s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:56:36 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-62f9d151-c691-4779-bad5-e24d5c853598 tempest-VolumesActionsTest-1451724932 None] Attaching volume a7e36d53-240e-4fb4-b0c5-d223f7933b5f to instance 8117c832-85c0-44af-80f0-457cd91ef4c9 at mountpoint /dev/vdb on host None. Jul 30 16:56:36 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-62f9d151-c691-4779-bad5-e24d5c853598 tempest-VolumesActionsTest-1451724932 None] Attach volume completed successfully. Jul 30 16:56:36 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-62f9d151-c691-4779-bad5-e24d5c853598 tempest-VolumesActionsTest-1451724932 None] Lock "cinder-a7e36d53-240e-4fb4-b0c5-d223f7933b5f" released by "attach_volume" :: held 0.133s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:56:37 devstack sudo[97740]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:37 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-6123bb78-3256-4871-bb87-8cec1333a125 tempest-VolumesTransfersV355Test-1126991584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-46a388dd-54fc-4309-8a08-67e0ec57e324" returned: 0 in 0.793s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:37 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-6123bb78-3256-4871-bb87-8cec1333a125 tempest-VolumesTransfersV355Test-1126991584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-46a388dd-54fc-4309-8a08-67e0ec57e324 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:37 devstack sudo[97745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-46a388dd-54fc-4309-8a08-67e0ec57e324 Jul 30 16:56:37 devstack sudo[97745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:37 devstack sudo[97745]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:37 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-6123bb78-3256-4871-bb87-8cec1333a125 tempest-VolumesTransfersV355Test-1126991584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-46a388dd-54fc-4309-8a08-67e0ec57e324" returned: 0 in 0.568s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:37 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-6123bb78-3256-4871-bb87-8cec1333a125 tempest-VolumesTransfersV355Test-1126991584 None] Lock "cinder-quobyte-46a388dd-54fc-4309-8a08-67e0ec57e324" released by "delete_volume" :: held 1.430s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:56:37 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-6123bb78-3256-4871-bb87-8cec1333a125 tempest-VolumesTransfersV355Test-1126991584 None] Created reservations ['b9faddf6-8403-4660-9c11-267036cbdf7d', 'cbe98140-aa8b-4692-bfb3-474b5ad357f1', 'c10be0ae-c4e3-4d91-af5f-c30790a352bf', 'f33eadb6-c213-4186-ad21-008414ecfd02'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:56:37 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-6123bb78-3256-4871-bb87-8cec1333a125 tempest-VolumesTransfersV355Test-1126991584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:56:37 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-6123bb78-3256-4871-bb87-8cec1333a125 tempest-VolumesTransfersV355Test-1126991584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:56:37 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-6123bb78-3256-4871-bb87-8cec1333a125 tempest-VolumesTransfersV355Test-1126991584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:56:37 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-6123bb78-3256-4871-bb87-8cec1333a125 tempest-VolumesTransfersV355Test-1126991584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:56:37 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-6123bb78-3256-4871-bb87-8cec1333a125 tempest-VolumesTransfersV355Test-1126991584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:56:37 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-6123bb78-3256-4871-bb87-8cec1333a125 tempest-VolumesTransfersV355Test-1126991584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:37 devstack sudo[97748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:56:37 devstack sudo[97748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:38 devstack sudo[97748]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:38 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-6123bb78-3256-4871-bb87-8cec1333a125 tempest-VolumesTransfersV355Test-1126991584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.431s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:38 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-6123bb78-3256-4871-bb87-8cec1333a125 tempest-VolumesTransfersV355Test-1126991584 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:56:38 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-6123bb78-3256-4871-bb87-8cec1333a125 tempest-VolumesTransfersV355Test-1126991584 None] Deleted volume successfully. Jul 30 16:56:38 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-6123bb78-3256-4871-bb87-8cec1333a125 tempest-VolumesTransfersV355Test-1126991584 None] Lock "cinder-46a388dd-54fc-4309-8a08-67e0ec57e324-delete_volume" released by "delete_volume" :: held 2.373s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:56:38 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-c0518e42-ed5a-489b-bdab-3ee4a2c641d9 tempest-VolumesActionsTest-373005339 None] Terminate volume connection completed successfully. Jul 30 16:56:38 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-c0518e42-ed5a-489b-bdab-3ee4a2c641d9 tempest-VolumesActionsTest-373005339 None] Acquiring lock "cinder-a7e36d53-240e-4fb4-b0c5-d223f7933b5f-detach_volume" by "detach_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:56:38 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-c0518e42-ed5a-489b-bdab-3ee4a2c641d9 tempest-VolumesActionsTest-373005339 None] Lock "cinder-a7e36d53-240e-4fb4-b0c5-d223f7933b5f-detach_volume" acquired by "detach_volume" :: waited 0.035s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:56:38 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-c0518e42-ed5a-489b-bdab-3ee4a2c641d9 tempest-VolumesActionsTest-373005339 None] Detaching volume a7e36d53-240e-4fb4-b0c5-d223f7933b5f from instance 8117c832-85c0-44af-80f0-457cd91ef4c9. Jul 30 16:56:38 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-c0518e42-ed5a-489b-bdab-3ee4a2c641d9 tempest-VolumesActionsTest-373005339 None] Detach volume completed successfully. Jul 30 16:56:38 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-c0518e42-ed5a-489b-bdab-3ee4a2c641d9 tempest-VolumesActionsTest-373005339 None] Lock "cinder-a7e36d53-240e-4fb4-b0c5-d223f7933b5f-detach_volume" released by "detach_volume" :: held 0.161s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:56:39 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-22f3da00-4f36-4e8f-8eb9-71266a21eabd tempest-VolumesActionsTest-1451724932 None] Acquiring lock "cinder-a7e36d53-240e-4fb4-b0c5-d223f7933b5f-detach_volume" by "detach_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:56:39 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-22f3da00-4f36-4e8f-8eb9-71266a21eabd tempest-VolumesActionsTest-1451724932 None] Lock "cinder-a7e36d53-240e-4fb4-b0c5-d223f7933b5f-detach_volume" acquired by "detach_volume" :: waited 0.043s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:56:39 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-22f3da00-4f36-4e8f-8eb9-71266a21eabd tempest-VolumesActionsTest-1451724932 None] Volume detach called, but volume not attached. Jul 30 16:56:39 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-22f3da00-4f36-4e8f-8eb9-71266a21eabd tempest-VolumesActionsTest-1451724932 None] Lock "cinder-a7e36d53-240e-4fb4-b0c5-d223f7933b5f-detach_volume" released by "detach_volume" :: held 0.055s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:56:39 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-c6842351-cdb4-4608-a8b0-277e1d988a53 tempest-VolumesActionsTest-1451724932 None] Acquiring lock "cinder-a7e36d53-240e-4fb4-b0c5-d223f7933b5f-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:56:39 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-c6842351-cdb4-4608-a8b0-277e1d988a53 tempest-VolumesActionsTest-1451724932 None] Lock "cinder-a7e36d53-240e-4fb4-b0c5-d223f7933b5f-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:56:39 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-c6842351-cdb4-4608-a8b0-277e1d988a53 tempest-VolumesActionsTest-1451724932 None] Acquiring lock "cinder-quobyte-a7e36d53-240e-4fb4-b0c5-d223f7933b5f" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:56:39 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-c6842351-cdb4-4608-a8b0-277e1d988a53 tempest-VolumesActionsTest-1451724932 None] Lock "cinder-quobyte-a7e36d53-240e-4fb4-b0c5-d223f7933b5f" acquired by "delete_volume" :: waited 0.039s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:56:39 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[633e2a2d-2395-45c2-bd83-b2c7cc6288a3]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:56:39 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-c6842351-cdb4-4608-a8b0-277e1d988a53 tempest-VolumesActionsTest-1451724932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-a7e36d53-240e-4fb4-b0c5-d223f7933b5f {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:40 devstack sudo[97751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-a7e36d53-240e-4fb4-b0c5-d223f7933b5f Jul 30 16:56:40 devstack sudo[97751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:40 devstack sudo[97751]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:40 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-c6842351-cdb4-4608-a8b0-277e1d988a53 tempest-VolumesActionsTest-1451724932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-a7e36d53-240e-4fb4-b0c5-d223f7933b5f" returned: 0 in 0.850s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:40 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-c6842351-cdb4-4608-a8b0-277e1d988a53 tempest-VolumesActionsTest-1451724932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-a7e36d53-240e-4fb4-b0c5-d223f7933b5f {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:40 devstack sudo[97756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-a7e36d53-240e-4fb4-b0c5-d223f7933b5f Jul 30 16:56:40 devstack sudo[97756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:41 devstack sudo[97756]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:41 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-c6842351-cdb4-4608-a8b0-277e1d988a53 tempest-VolumesActionsTest-1451724932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-a7e36d53-240e-4fb4-b0c5-d223f7933b5f" returned: 0 in 0.480s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:41 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-c6842351-cdb4-4608-a8b0-277e1d988a53 tempest-VolumesActionsTest-1451724932 None] Lock "cinder-quobyte-a7e36d53-240e-4fb4-b0c5-d223f7933b5f" released by "delete_volume" :: held 1.426s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:56:41 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-c6842351-cdb4-4608-a8b0-277e1d988a53 tempest-VolumesActionsTest-1451724932 None] Created reservations ['f448f611-5379-4031-9fce-e8253d661383', '753e9b34-5dd5-4911-8f1d-a59686a013df', 'dc26633d-8417-4857-94e1-bd6ecfb146af', '66defa7a-dc48-4383-83d8-1a2f8fa45975'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:56:41 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-c6842351-cdb4-4608-a8b0-277e1d988a53 tempest-VolumesActionsTest-1451724932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:56:41 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-c6842351-cdb4-4608-a8b0-277e1d988a53 tempest-VolumesActionsTest-1451724932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:56:41 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-c6842351-cdb4-4608-a8b0-277e1d988a53 tempest-VolumesActionsTest-1451724932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:56:41 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-c6842351-cdb4-4608-a8b0-277e1d988a53 tempest-VolumesActionsTest-1451724932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:56:41 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-c6842351-cdb4-4608-a8b0-277e1d988a53 tempest-VolumesActionsTest-1451724932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:56:41 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-c6842351-cdb4-4608-a8b0-277e1d988a53 tempest-VolumesActionsTest-1451724932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:41 devstack sudo[97759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:56:41 devstack sudo[97759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:42 devstack sudo[97759]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:42 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-c6842351-cdb4-4608-a8b0-277e1d988a53 tempest-VolumesActionsTest-1451724932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.695s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:42 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-c6842351-cdb4-4608-a8b0-277e1d988a53 tempest-VolumesActionsTest-1451724932 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:56:42 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-c6842351-cdb4-4608-a8b0-277e1d988a53 tempest-VolumesActionsTest-1451724932 None] Deleted volume successfully. Jul 30 16:56:42 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-c6842351-cdb4-4608-a8b0-277e1d988a53 tempest-VolumesActionsTest-1451724932 None] Lock "cinder-a7e36d53-240e-4fb4-b0c5-d223f7933b5f-delete_volume" released by "delete_volume" :: held 2.676s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:56:46 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-98876d96-cadf-441a-8658-5f1ffdea425b tempest-VolumesActionsTest-1451724932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:56:46 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-98876d96-cadf-441a-8658-5f1ffdea425b tempest-VolumesActionsTest-1451724932 None] Flow 'volume_create_manager' (0f1cb163-c59e-48f1-9b6d-a72840706404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:56:46 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-98876d96-cadf-441a-8658-5f1ffdea425b tempest-VolumesActionsTest-1451724932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51a86097-d432-406a-946c-c32fdbe512ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-98876d96-cadf-441a-8658-5f1ffdea425b tempest-VolumesActionsTest-1451724932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51a86097-d432-406a-946c-c32fdbe512ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:56:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1330443995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0c13484-7475-4eb8-83f7-9fd682e93e19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d4cdc44a4d34072822865ed569a0be7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:56:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:56:47Z,use_quota=True,user_id='1cde7b4767cf4521bd2e65a15a371b3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-98876d96-cadf-441a-8658-5f1ffdea425b tempest-VolumesActionsTest-1451724932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f78f464b-5175-422e-a404-a431b229f5fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-98876d96-cadf-441a-8658-5f1ffdea425b tempest-VolumesActionsTest-1451724932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f78f464b-5175-422e-a404-a431b229f5fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-98876d96-cadf-441a-8658-5f1ffdea425b tempest-VolumesActionsTest-1451724932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (083d617c-f317-46a8-946e-2de2a6ae1ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-98876d96-cadf-441a-8658-5f1ffdea425b tempest-VolumesActionsTest-1451724932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (083d617c-f317-46a8-946e-2de2a6ae1ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0c13484-7475-4eb8-83f7-9fd682e93e19', 'volume_name': 'volume-c0c13484-7475-4eb8-83f7-9fd682e93e19', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-98876d96-cadf-441a-8658-5f1ffdea425b tempest-VolumesActionsTest-1451724932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0eb926ad-f241-4b9c-bca4-7e9de695f4b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-98876d96-cadf-441a-8658-5f1ffdea425b tempest-VolumesActionsTest-1451724932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0eb926ad-f241-4b9c-bca4-7e9de695f4b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-98876d96-cadf-441a-8658-5f1ffdea425b tempest-VolumesActionsTest-1451724932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fead707b-8896-4d82-9fb6-8c1a2429ff32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:47 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-98876d96-cadf-441a-8658-5f1ffdea425b tempest-VolumesActionsTest-1451724932 None] Volume c0c13484-7475-4eb8-83f7-9fd682e93e19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0c13484-7475-4eb8-83f7-9fd682e93e19', 'volume_size': 1} Jul 30 16:56:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-98876d96-cadf-441a-8658-5f1ffdea425b tempest-VolumesActionsTest-1451724932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:56:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-98876d96-cadf-441a-8658-5f1ffdea425b tempest-VolumesActionsTest-1451724932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:56:47 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-98876d96-cadf-441a-8658-5f1ffdea425b tempest-VolumesActionsTest-1451724932 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:56:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1330443995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0c13484-7475-4eb8-83f7-9fd682e93e19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d4cdc44a4d34072822865ed569a0be7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:56:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:56:47Z,use_quota=True,user_id='1cde7b4767cf4521bd2e65a15a371b3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:56:47 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-98876d96-cadf-441a-8658-5f1ffdea425b tempest-VolumesActionsTest-1451724932 None] Creating volume c0c13484-7475-4eb8-83f7-9fd682e93e19 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:56:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-98876d96-cadf-441a-8658-5f1ffdea425b tempest-VolumesActionsTest-1451724932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:56:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-98876d96-cadf-441a-8658-5f1ffdea425b tempest-VolumesActionsTest-1451724932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:56:47 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-98876d96-cadf-441a-8658-5f1ffdea425b tempest-VolumesActionsTest-1451724932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:56:47 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-98876d96-cadf-441a-8658-5f1ffdea425b tempest-VolumesActionsTest-1451724932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:56:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-98876d96-cadf-441a-8658-5f1ffdea425b tempest-VolumesActionsTest-1451724932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:56:47 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-98876d96-cadf-441a-8658-5f1ffdea425b tempest-VolumesActionsTest-1451724932 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:56:47 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-98876d96-cadf-441a-8658-5f1ffdea425b tempest-VolumesActionsTest-1451724932 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 16:56:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-98876d96-cadf-441a-8658-5f1ffdea425b tempest-VolumesActionsTest-1451724932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c0c13484-7475-4eb8-83f7-9fd682e93e19 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:47 devstack sudo[97824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c0c13484-7475-4eb8-83f7-9fd682e93e19 1073741824 Jul 30 16:56:47 devstack sudo[97824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:47 devstack sudo[97824]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-98876d96-cadf-441a-8658-5f1ffdea425b tempest-VolumesActionsTest-1451724932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c0c13484-7475-4eb8-83f7-9fd682e93e19 1073741824" returned: 0 in 0.530s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-98876d96-cadf-441a-8658-5f1ffdea425b tempest-VolumesActionsTest-1451724932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c0c13484-7475-4eb8-83f7-9fd682e93e19 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:47 devstack sudo[97830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c0c13484-7475-4eb8-83f7-9fd682e93e19 Jul 30 16:56:47 devstack sudo[97830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:47 devstack sudo[97830]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-98876d96-cadf-441a-8658-5f1ffdea425b tempest-VolumesActionsTest-1451724932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c0c13484-7475-4eb8-83f7-9fd682e93e19" returned: 0 in 0.286s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:47 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-98876d96-cadf-441a-8658-5f1ffdea425b tempest-VolumesActionsTest-1451724932 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:56:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-98876d96-cadf-441a-8658-5f1ffdea425b tempest-VolumesActionsTest-1451724932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:56:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-98876d96-cadf-441a-8658-5f1ffdea425b tempest-VolumesActionsTest-1451724932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fead707b-8896-4d82-9fb6-8c1a2429ff32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0c13484-7475-4eb8-83f7-9fd682e93e19', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-98876d96-cadf-441a-8658-5f1ffdea425b tempest-VolumesActionsTest-1451724932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88e61c81-b62d-45d3-b3c6-d6bd4b8da4b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:47 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-98876d96-cadf-441a-8658-5f1ffdea425b tempest-VolumesActionsTest-1451724932 None] Volume volume-c0c13484-7475-4eb8-83f7-9fd682e93e19 (c0c13484-7475-4eb8-83f7-9fd682e93e19): created successfully Jul 30 16:56:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-98876d96-cadf-441a-8658-5f1ffdea425b tempest-VolumesActionsTest-1451724932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88e61c81-b62d-45d3-b3c6-d6bd4b8da4b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-98876d96-cadf-441a-8658-5f1ffdea425b tempest-VolumesActionsTest-1451724932 None] Flow 'volume_create_manager' (0f1cb163-c59e-48f1-9b6d-a72840706404) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:56:47 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-98876d96-cadf-441a-8658-5f1ffdea425b tempest-VolumesActionsTest-1451724932 None] Created volume successfully. Jul 30 16:56:49 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-22f89425-414a-4c1e-98e5-c3bfb036f767 tempest-VolumesActionsTest-373005339 None] Acquiring lock "cinder-c0c13484-7475-4eb8-83f7-9fd682e93e19-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:56:49 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-22f89425-414a-4c1e-98e5-c3bfb036f767 tempest-VolumesActionsTest-373005339 None] Lock "cinder-c0c13484-7475-4eb8-83f7-9fd682e93e19-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:56:49 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-22f89425-414a-4c1e-98e5-c3bfb036f767 tempest-VolumesActionsTest-373005339 None] Acquiring lock "cinder-quobyte-c0c13484-7475-4eb8-83f7-9fd682e93e19" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:56:49 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-22f89425-414a-4c1e-98e5-c3bfb036f767 tempest-VolumesActionsTest-373005339 None] Lock "cinder-quobyte-c0c13484-7475-4eb8-83f7-9fd682e93e19" acquired by "delete_volume" :: waited 0.032s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:56:49 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f942044-344b-4ec5-b639-92c63d9fac97]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:56:49 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-22f89425-414a-4c1e-98e5-c3bfb036f767 tempest-VolumesActionsTest-373005339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c0c13484-7475-4eb8-83f7-9fd682e93e19 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:49 devstack sudo[97833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c0c13484-7475-4eb8-83f7-9fd682e93e19 Jul 30 16:56:49 devstack sudo[97833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:49 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd6f6a81-364a-4e01-832d-03bbc8ceff6a tempest-VolumesImageMetadata-2053395508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:56:49 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fd6f6a81-364a-4e01-832d-03bbc8ceff6a tempest-VolumesImageMetadata-2053395508 None] Flow 'volume_create_manager' (05f32411-abbe-4e81-9dda-452022d83d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:56:49 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fd6f6a81-364a-4e01-832d-03bbc8ceff6a tempest-VolumesImageMetadata-2053395508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77599412-fc9d-4668-9977-51bf09027b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:49 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fd6f6a81-364a-4e01-832d-03bbc8ceff6a tempest-VolumesImageMetadata-2053395508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77599412-fc9d-4668-9977-51bf09027b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:56:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-267076997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb5a8c70-56ae-4a2c-bd39-114d3cc7d582,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71cf64b6717e4bc2b87c129332903856',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:56:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:56:50Z,use_quota=True,user_id='58f3a131b3da4a80a42aa58325761f13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:49 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fd6f6a81-364a-4e01-832d-03bbc8ceff6a tempest-VolumesImageMetadata-2053395508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd1fb419-cbd1-40ab-8ac5-d43cf1d269e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:49 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fd6f6a81-364a-4e01-832d-03bbc8ceff6a tempest-VolumesImageMetadata-2053395508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd1fb419-cbd1-40ab-8ac5-d43cf1d269e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:49 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fd6f6a81-364a-4e01-832d-03bbc8ceff6a tempest-VolumesImageMetadata-2053395508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cf2f85c-c79f-434d-adfe-673b78f7fe8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:49 devstack cinder-volume[88568]: DEBUG cinder.image.glance [None req-fd6f6a81-364a-4e01-832d-03bbc8ceff6a tempest-VolumesImageMetadata-2053395508 None] Creating Keystone auth plugin from conf {{(pid=88568) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 30 16:56:49 devstack sudo[97833]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:49 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-22f89425-414a-4c1e-98e5-c3bfb036f767 tempest-VolumesActionsTest-373005339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c0c13484-7475-4eb8-83f7-9fd682e93e19" returned: 0 in 0.395s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:49 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-22f89425-414a-4c1e-98e5-c3bfb036f767 tempest-VolumesActionsTest-373005339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c0c13484-7475-4eb8-83f7-9fd682e93e19 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:49 devstack sudo[97838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c0c13484-7475-4eb8-83f7-9fd682e93e19 Jul 30 16:56:49 devstack sudo[97838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:50 devstack sudo[97838]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-22f89425-414a-4c1e-98e5-c3bfb036f767 tempest-VolumesActionsTest-373005339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c0c13484-7475-4eb8-83f7-9fd682e93e19" returned: 0 in 0.284s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:50 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-22f89425-414a-4c1e-98e5-c3bfb036f767 tempest-VolumesActionsTest-373005339 None] Lock "cinder-quobyte-c0c13484-7475-4eb8-83f7-9fd682e93e19" released by "delete_volume" :: held 0.771s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:56:50 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-22f89425-414a-4c1e-98e5-c3bfb036f767 tempest-VolumesActionsTest-373005339 None] Created reservations ['2b701412-b23e-4357-9751-c18a3f504ac5', 'ca37f1f2-9ede-40c8-adda-c53f437377fa', '3858799c-34cf-42a6-8359-48e17d591192', '498256ed-90f3-458c-ab05-a6eed9ee92d3'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:56:50 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fd6f6a81-364a-4e01-832d-03bbc8ceff6a tempest-VolumesImageMetadata-2053395508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cf2f85c-c79f-434d-adfe-673b78f7fe8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cb5a8c70-56ae-4a2c-bd39-114d3cc7d582', 'volume_name': 'volume-cb5a8c70-56ae-4a2c-bd39-114d3cc7d582', 'volume_size': 1, 'image_id': '6126230f-0fba-48b9-943c-1885f4fc4be0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6126230f-0fba-48b9-943c-1885f4fc4be0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2802aa975ace4011a130c68c7a9c96bb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6126230f-0fba-48b9-943c-1885f4fc4be0', 'created_at': datetime.datetime(2026, 7, 30, 14, 43, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 43, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6126230f-0fba-48b9-943c-1885f4fc4be0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:50 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fd6f6a81-364a-4e01-832d-03bbc8ceff6a tempest-VolumesImageMetadata-2053395508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (712239fe-c3e7-4de5-811e-f902c76439e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:50 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fd6f6a81-364a-4e01-832d-03bbc8ceff6a tempest-VolumesImageMetadata-2053395508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (712239fe-c3e7-4de5-811e-f902c76439e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:50 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fd6f6a81-364a-4e01-832d-03bbc8ceff6a tempest-VolumesImageMetadata-2053395508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61321c42-b8c0-4641-a1b8-8b62fdb510f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:50 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-fd6f6a81-364a-4e01-832d-03bbc8ceff6a tempest-VolumesImageMetadata-2053395508 None] Volume cb5a8c70-56ae-4a2c-bd39-114d3cc7d582: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cb5a8c70-56ae-4a2c-bd39-114d3cc7d582', 'volume_size': 1, 'image_id': '6126230f-0fba-48b9-943c-1885f4fc4be0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6126230f-0fba-48b9-943c-1885f4fc4be0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2802aa975ace4011a130c68c7a9c96bb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6126230f-0fba-48b9-943c-1885f4fc4be0', 'created_at': datetime.datetime(2026, 7, 30, 14, 43, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 43, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6126230f-0fba-48b9-943c-1885f4fc4be0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 30 16:56:50 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd6f6a81-364a-4e01-832d-03bbc8ceff6a tempest-VolumesImageMetadata-2053395508 None] Trying to clone cb5a8c70-56ae-4a2c-bd39-114d3cc7d582 from image 6126230f-0fba-48b9-943c-1885f4fc4be0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6126230f-0fba-48b9-943c-1885f4fc4be0', 'metadata': {}}]). {{(pid=88568) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 30 16:56:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-22f89425-414a-4c1e-98e5-c3bfb036f767 tempest-VolumesActionsTest-373005339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:56:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-22f89425-414a-4c1e-98e5-c3bfb036f767 tempest-VolumesActionsTest-373005339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:56:50 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-22f89425-414a-4c1e-98e5-c3bfb036f767 tempest-VolumesActionsTest-373005339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:56:50 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-22f89425-414a-4c1e-98e5-c3bfb036f767 tempest-VolumesActionsTest-373005339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:56:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-22f89425-414a-4c1e-98e5-c3bfb036f767 tempest-VolumesActionsTest-373005339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:56:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-22f89425-414a-4c1e-98e5-c3bfb036f767 tempest-VolumesActionsTest-373005339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:50 devstack sudo[97841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:56:50 devstack sudo[97841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:50 devstack sudo[97841]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:50 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-08a65c04-9a8b-4205-aab2-871764a73550 tempest-VolumesTransfersV357Test-1400546377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:56:50 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-08a65c04-9a8b-4205-aab2-871764a73550 tempest-VolumesTransfersV357Test-1400546377 None] Flow 'volume_create_manager' (354b6cf2-f3b2-4cfe-bb84-62cd7dac9ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:56:50 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-08a65c04-9a8b-4205-aab2-871764a73550 tempest-VolumesTransfersV357Test-1400546377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88316b5a-84ec-4e83-aa07-6cd62ffc0489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-22f89425-414a-4c1e-98e5-c3bfb036f767 tempest-VolumesActionsTest-373005339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.433s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:50 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-22f89425-414a-4c1e-98e5-c3bfb036f767 tempest-VolumesActionsTest-373005339 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:56:50 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-22f89425-414a-4c1e-98e5-c3bfb036f767 tempest-VolumesActionsTest-373005339 None] Deleted volume successfully. Jul 30 16:56:50 devstack cinder-volume[88568]: DEBUG cinder.image.image_utils [None req-fd6f6a81-364a-4e01-832d-03bbc8ceff6a tempest-VolumesImageMetadata-2053395508 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6126230f-0fba-48b9-943c-1885f4fc4be0_6rpx2veudevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88568) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 30 16:56:50 devstack cinder-volume[88568]: INFO cinder.image.image_utils [None req-fd6f6a81-364a-4e01-832d-03bbc8ceff6a tempest-VolumesImageMetadata-2053395508 None] Image download 20.69 MB at 20.69 MB/s Jul 30 16:56:50 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-08a65c04-9a8b-4205-aab2-871764a73550 tempest-VolumesTransfersV357Test-1400546377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88316b5a-84ec-4e83-aa07-6cd62ffc0489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:56:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-130200015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c231fd2-5ab4-485b-8216-2cbbb0b1386d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d104a9f4cc74005b50536053fb6f5c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:56:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:56:51Z,use_quota=True,user_id='cfaa402de8a34ca2813080abf94ac3b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:50 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-08a65c04-9a8b-4205-aab2-871764a73550 tempest-VolumesTransfersV357Test-1400546377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d1ed57d-7ed7-4865-ac47-280c143b62a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:50 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-08a65c04-9a8b-4205-aab2-871764a73550 tempest-VolumesTransfersV357Test-1400546377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d1ed57d-7ed7-4865-ac47-280c143b62a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:50 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-08a65c04-9a8b-4205-aab2-871764a73550 tempest-VolumesTransfersV357Test-1400546377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1306093a-2218-43bd-94b6-5494c4516005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:50 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-08a65c04-9a8b-4205-aab2-871764a73550 tempest-VolumesTransfersV357Test-1400546377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1306093a-2218-43bd-94b6-5494c4516005) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c231fd2-5ab4-485b-8216-2cbbb0b1386d', 'volume_name': 'volume-5c231fd2-5ab4-485b-8216-2cbbb0b1386d', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:50 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-08a65c04-9a8b-4205-aab2-871764a73550 tempest-VolumesTransfersV357Test-1400546377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d3ba15b-e8f4-4969-95cd-dcac1b139e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:50 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-08a65c04-9a8b-4205-aab2-871764a73550 tempest-VolumesTransfersV357Test-1400546377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d3ba15b-e8f4-4969-95cd-dcac1b139e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:50 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-08a65c04-9a8b-4205-aab2-871764a73550 tempest-VolumesTransfersV357Test-1400546377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4065ca7-1a1d-4619-84bd-794cc86bde57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:50 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-08a65c04-9a8b-4205-aab2-871764a73550 tempest-VolumesTransfersV357Test-1400546377 None] Volume 5c231fd2-5ab4-485b-8216-2cbbb0b1386d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c231fd2-5ab4-485b-8216-2cbbb0b1386d', 'volume_size': 1} Jul 30 16:56:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-08a65c04-9a8b-4205-aab2-871764a73550 tempest-VolumesTransfersV357Test-1400546377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:56:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-08a65c04-9a8b-4205-aab2-871764a73550 tempest-VolumesTransfersV357Test-1400546377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:56:50 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-08a65c04-9a8b-4205-aab2-871764a73550 tempest-VolumesTransfersV357Test-1400546377 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:56:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-130200015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c231fd2-5ab4-485b-8216-2cbbb0b1386d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d104a9f4cc74005b50536053fb6f5c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:56:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:56:51Z,use_quota=True,user_id='cfaa402de8a34ca2813080abf94ac3b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:56:50 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-08a65c04-9a8b-4205-aab2-871764a73550 tempest-VolumesTransfersV357Test-1400546377 None] Creating volume 5c231fd2-5ab4-485b-8216-2cbbb0b1386d {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:56:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-08a65c04-9a8b-4205-aab2-871764a73550 tempest-VolumesTransfersV357Test-1400546377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:56:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-08a65c04-9a8b-4205-aab2-871764a73550 tempest-VolumesTransfersV357Test-1400546377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:56:50 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-08a65c04-9a8b-4205-aab2-871764a73550 tempest-VolumesTransfersV357Test-1400546377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:56:50 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-08a65c04-9a8b-4205-aab2-871764a73550 tempest-VolumesTransfersV357Test-1400546377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:56:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-08a65c04-9a8b-4205-aab2-871764a73550 tempest-VolumesTransfersV357Test-1400546377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:56:50 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-08a65c04-9a8b-4205-aab2-871764a73550 tempest-VolumesTransfersV357Test-1400546377 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:56:50 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-08a65c04-9a8b-4205-aab2-871764a73550 tempest-VolumesTransfersV357Test-1400546377 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 16:56:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-08a65c04-9a8b-4205-aab2-871764a73550 tempest-VolumesTransfersV357Test-1400546377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5c231fd2-5ab4-485b-8216-2cbbb0b1386d 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:50 devstack sudo[97865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5c231fd2-5ab4-485b-8216-2cbbb0b1386d 1073741824 Jul 30 16:56:50 devstack sudo[97865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:50 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-22f89425-414a-4c1e-98e5-c3bfb036f767 tempest-VolumesActionsTest-373005339 None] Lock "cinder-c0c13484-7475-4eb8-83f7-9fd682e93e19-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:56:50 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[9015753c-5716-4433-9db7-0b12adf8d9d2]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:56:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fd6f6a81-364a-4e01-832d-03bbc8ceff6a tempest-VolumesImageMetadata-2053395508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6126230f-0fba-48b9-943c-1885f4fc4be0_6rpx2veudevstack@QuobyteHD {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:51 devstack sudo[97867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6126230f-0fba-48b9-943c-1885f4fc4be0_6rpx2veudevstack@QuobyteHD Jul 30 16:56:51 devstack sudo[97867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:51 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-15466702-b2ad-467a-93dd-2d1dcb104b40 tempest-VolumesActionsTest-1451724932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:56:51 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-15466702-b2ad-467a-93dd-2d1dcb104b40 tempest-VolumesActionsTest-1451724932 None] Flow 'volume_create_manager' (076f87af-7b8a-4bce-8e71-9b6ed2d068dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:56:51 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-15466702-b2ad-467a-93dd-2d1dcb104b40 tempest-VolumesActionsTest-1451724932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ca17e2a-8add-4db7-9acd-825c5d9e8ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:51 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-15466702-b2ad-467a-93dd-2d1dcb104b40 tempest-VolumesActionsTest-1451724932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ca17e2a-8add-4db7-9acd-825c5d9e8ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:56:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-675220737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e98d1961-bad3-48b1-9dca-9a74229e5442,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d4cdc44a4d34072822865ed569a0be7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:56:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:56:51Z,use_quota=True,user_id='1cde7b4767cf4521bd2e65a15a371b3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:51 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-15466702-b2ad-467a-93dd-2d1dcb104b40 tempest-VolumesActionsTest-1451724932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4247d692-0b8e-4c14-ac5a-26e0e1c75025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:51 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-15466702-b2ad-467a-93dd-2d1dcb104b40 tempest-VolumesActionsTest-1451724932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4247d692-0b8e-4c14-ac5a-26e0e1c75025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:51 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-15466702-b2ad-467a-93dd-2d1dcb104b40 tempest-VolumesActionsTest-1451724932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fac5bb5d-3949-4a86-be64-257a5fc9ad45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:51 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-15466702-b2ad-467a-93dd-2d1dcb104b40 tempest-VolumesActionsTest-1451724932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fac5bb5d-3949-4a86-be64-257a5fc9ad45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e98d1961-bad3-48b1-9dca-9a74229e5442', 'volume_name': 'volume-e98d1961-bad3-48b1-9dca-9a74229e5442', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:51 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-15466702-b2ad-467a-93dd-2d1dcb104b40 tempest-VolumesActionsTest-1451724932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f0a69d9-c071-4ac1-88e8-fae0e03fd59b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:51 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-15466702-b2ad-467a-93dd-2d1dcb104b40 tempest-VolumesActionsTest-1451724932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f0a69d9-c071-4ac1-88e8-fae0e03fd59b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:51 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-15466702-b2ad-467a-93dd-2d1dcb104b40 tempest-VolumesActionsTest-1451724932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ac9c9e2-c64f-41b0-a852-668988b4f1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:51 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-15466702-b2ad-467a-93dd-2d1dcb104b40 tempest-VolumesActionsTest-1451724932 None] Volume e98d1961-bad3-48b1-9dca-9a74229e5442: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e98d1961-bad3-48b1-9dca-9a74229e5442', 'volume_size': 1} Jul 30 16:56:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-15466702-b2ad-467a-93dd-2d1dcb104b40 tempest-VolumesActionsTest-1451724932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:56:51 devstack sudo[97867]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fd6f6a81-364a-4e01-832d-03bbc8ceff6a tempest-VolumesImageMetadata-2053395508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6126230f-0fba-48b9-943c-1885f4fc4be0_6rpx2veudevstack@QuobyteHD" returned: 0 in 0.505s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:51 devstack cinder-volume[88568]: DEBUG cinder.image.image_utils [None req-fd6f6a81-364a-4e01-832d-03bbc8ceff6a tempest-VolumesImageMetadata-2053395508 None] Temporary image 6126230f-0fba-48b9-943c-1885f4fc4be0 is fetched for user 58f3a131b3da4a80a42aa58325761f13. {{(pid=88568) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 30 16:56:51 devstack sudo[97865]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-08a65c04-9a8b-4205-aab2-871764a73550 tempest-VolumesTransfersV357Test-1400546377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5c231fd2-5ab4-485b-8216-2cbbb0b1386d 1073741824" returned: 0 in 0.653s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:51 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[357a0cc8-be28-49f9-90b4-bd652c8f7ceb]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:56:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fd6f6a81-364a-4e01-832d-03bbc8ceff6a tempest-VolumesImageMetadata-2053395508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6126230f-0fba-48b9-943c-1885f4fc4be0_6rpx2veudevstack@QuobyteHD {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-08a65c04-9a8b-4205-aab2-871764a73550 tempest-VolumesTransfersV357Test-1400546377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5c231fd2-5ab4-485b-8216-2cbbb0b1386d {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:51 devstack sudo[97877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5c231fd2-5ab4-485b-8216-2cbbb0b1386d Jul 30 16:56:51 devstack sudo[97877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:51 devstack sudo[97876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6126230f-0fba-48b9-943c-1885f4fc4be0_6rpx2veudevstack@QuobyteHD Jul 30 16:56:51 devstack sudo[97876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:51 devstack sudo[97877]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-08a65c04-9a8b-4205-aab2-871764a73550 tempest-VolumesTransfersV357Test-1400546377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5c231fd2-5ab4-485b-8216-2cbbb0b1386d" returned: 0 in 0.289s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:51 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-08a65c04-9a8b-4205-aab2-871764a73550 tempest-VolumesTransfersV357Test-1400546377 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:56:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-08a65c04-9a8b-4205-aab2-871764a73550 tempest-VolumesTransfersV357Test-1400546377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:56:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-15466702-b2ad-467a-93dd-2d1dcb104b40 tempest-VolumesActionsTest-1451724932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.584s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:56:51 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-15466702-b2ad-467a-93dd-2d1dcb104b40 tempest-VolumesActionsTest-1451724932 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:56:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-675220737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e98d1961-bad3-48b1-9dca-9a74229e5442,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d4cdc44a4d34072822865ed569a0be7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:56:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:56:51Z,use_quota=True,user_id='1cde7b4767cf4521bd2e65a15a371b3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:56:51 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-15466702-b2ad-467a-93dd-2d1dcb104b40 tempest-VolumesActionsTest-1451724932 None] Creating volume e98d1961-bad3-48b1-9dca-9a74229e5442 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:56:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-15466702-b2ad-467a-93dd-2d1dcb104b40 tempest-VolumesActionsTest-1451724932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:56:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-15466702-b2ad-467a-93dd-2d1dcb104b40 tempest-VolumesActionsTest-1451724932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:56:51 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-15466702-b2ad-467a-93dd-2d1dcb104b40 tempest-VolumesActionsTest-1451724932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:56:51 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-15466702-b2ad-467a-93dd-2d1dcb104b40 tempest-VolumesActionsTest-1451724932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:56:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-15466702-b2ad-467a-93dd-2d1dcb104b40 tempest-VolumesActionsTest-1451724932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:56:51 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-15466702-b2ad-467a-93dd-2d1dcb104b40 tempest-VolumesActionsTest-1451724932 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:56:51 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-15466702-b2ad-467a-93dd-2d1dcb104b40 tempest-VolumesActionsTest-1451724932 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 16:56:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-15466702-b2ad-467a-93dd-2d1dcb104b40 tempest-VolumesActionsTest-1451724932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e98d1961-bad3-48b1-9dca-9a74229e5442 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:51 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-08a65c04-9a8b-4205-aab2-871764a73550 tempest-VolumesTransfersV357Test-1400546377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4065ca7-1a1d-4619-84bd-794cc86bde57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c231fd2-5ab4-485b-8216-2cbbb0b1386d', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:51 devstack sudo[97882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e98d1961-bad3-48b1-9dca-9a74229e5442 1073741824 Jul 30 16:56:51 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-08a65c04-9a8b-4205-aab2-871764a73550 tempest-VolumesTransfersV357Test-1400546377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c20895f-9c2e-4630-9000-8028783a9079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:51 devstack sudo[97882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:51 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-08a65c04-9a8b-4205-aab2-871764a73550 tempest-VolumesTransfersV357Test-1400546377 None] Volume volume-5c231fd2-5ab4-485b-8216-2cbbb0b1386d (5c231fd2-5ab4-485b-8216-2cbbb0b1386d): created successfully Jul 30 16:56:51 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-08a65c04-9a8b-4205-aab2-871764a73550 tempest-VolumesTransfersV357Test-1400546377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c20895f-9c2e-4630-9000-8028783a9079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:51 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-08a65c04-9a8b-4205-aab2-871764a73550 tempest-VolumesTransfersV357Test-1400546377 None] Flow 'volume_create_manager' (354b6cf2-f3b2-4cfe-bb84-62cd7dac9ec5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:56:51 devstack sudo[97876]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fd6f6a81-364a-4e01-832d-03bbc8ceff6a tempest-VolumesImageMetadata-2053395508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6126230f-0fba-48b9-943c-1885f4fc4be0_6rpx2veudevstack@QuobyteHD" returned: 0 in 0.389s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-fd6f6a81-364a-4e01-832d-03bbc8ceff6a tempest-VolumesImageMetadata-2053395508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:56:51 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-08a65c04-9a8b-4205-aab2-871764a73550 tempest-VolumesTransfersV357Test-1400546377 None] Created volume successfully. Jul 30 16:56:52 devstack sudo[97882]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-15466702-b2ad-467a-93dd-2d1dcb104b40 tempest-VolumesActionsTest-1451724932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e98d1961-bad3-48b1-9dca-9a74229e5442 1073741824" returned: 0 in 0.456s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-15466702-b2ad-467a-93dd-2d1dcb104b40 tempest-VolumesActionsTest-1451724932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e98d1961-bad3-48b1-9dca-9a74229e5442 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:52 devstack sudo[97889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e98d1961-bad3-48b1-9dca-9a74229e5442 Jul 30 16:56:52 devstack sudo[97889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:52 devstack cinder-volume[88568]: DEBUG oslo_service.periodic_task [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:56:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:56:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:56:52 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:56:52 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:56:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:56:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:52 devstack sudo[97891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:56:52 devstack sudo[97891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:52 devstack sudo[97889]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-15466702-b2ad-467a-93dd-2d1dcb104b40 tempest-VolumesActionsTest-1451724932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e98d1961-bad3-48b1-9dca-9a74229e5442" returned: 0 in 0.281s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:52 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-15466702-b2ad-467a-93dd-2d1dcb104b40 tempest-VolumesActionsTest-1451724932 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:56:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-15466702-b2ad-467a-93dd-2d1dcb104b40 tempest-VolumesActionsTest-1451724932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:56:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-fd6f6a81-364a-4e01-832d-03bbc8ceff6a tempest-VolumesImageMetadata-2053395508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.705s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:56:52 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-fd6f6a81-364a-4e01-832d-03bbc8ceff6a tempest-VolumesImageMetadata-2053395508 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:56:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-267076997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb5a8c70-56ae-4a2c-bd39-114d3cc7d582,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71cf64b6717e4bc2b87c129332903856',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:56:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:56:50Z,use_quota=True,user_id='58f3a131b3da4a80a42aa58325761f13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:56:52 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-fd6f6a81-364a-4e01-832d-03bbc8ceff6a tempest-VolumesImageMetadata-2053395508 None] Creating volume cb5a8c70-56ae-4a2c-bd39-114d3cc7d582 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:56:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-fd6f6a81-364a-4e01-832d-03bbc8ceff6a tempest-VolumesImageMetadata-2053395508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:56:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-fd6f6a81-364a-4e01-832d-03bbc8ceff6a tempest-VolumesImageMetadata-2053395508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:56:52 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-fd6f6a81-364a-4e01-832d-03bbc8ceff6a tempest-VolumesImageMetadata-2053395508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:56:52 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-fd6f6a81-364a-4e01-832d-03bbc8ceff6a tempest-VolumesImageMetadata-2053395508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:56:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-fd6f6a81-364a-4e01-832d-03bbc8ceff6a tempest-VolumesImageMetadata-2053395508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:56:52 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-fd6f6a81-364a-4e01-832d-03bbc8ceff6a tempest-VolumesImageMetadata-2053395508 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:56:52 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-fd6f6a81-364a-4e01-832d-03bbc8ceff6a tempest-VolumesImageMetadata-2053395508 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 16:56:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fd6f6a81-364a-4e01-832d-03bbc8ceff6a tempest-VolumesImageMetadata-2053395508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-cb5a8c70-56ae-4a2c-bd39-114d3cc7d582 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:52 devstack sudo[97894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-cb5a8c70-56ae-4a2c-bd39-114d3cc7d582 1073741824 Jul 30 16:56:52 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-15466702-b2ad-467a-93dd-2d1dcb104b40 tempest-VolumesActionsTest-1451724932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ac9c9e2-c64f-41b0-a852-668988b4f1d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e98d1961-bad3-48b1-9dca-9a74229e5442', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:52 devstack sudo[97894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:52 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-15466702-b2ad-467a-93dd-2d1dcb104b40 tempest-VolumesActionsTest-1451724932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea29e4b6-5052-44c7-88d7-c1deba6b9b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:52 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-15466702-b2ad-467a-93dd-2d1dcb104b40 tempest-VolumesActionsTest-1451724932 None] Volume volume-e98d1961-bad3-48b1-9dca-9a74229e5442 (e98d1961-bad3-48b1-9dca-9a74229e5442): created successfully Jul 30 16:56:52 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-15466702-b2ad-467a-93dd-2d1dcb104b40 tempest-VolumesActionsTest-1451724932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea29e4b6-5052-44c7-88d7-c1deba6b9b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:52 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-15466702-b2ad-467a-93dd-2d1dcb104b40 tempest-VolumesActionsTest-1451724932 None] Flow 'volume_create_manager' (076f87af-7b8a-4bce-8e71-9b6ed2d068dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:56:52 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-15466702-b2ad-467a-93dd-2d1dcb104b40 tempest-VolumesActionsTest-1451724932 None] Created volume successfully. Jul 30 16:56:53 devstack sudo[97891]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:53 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.475s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:53 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:56:53 devstack cinder-volume[88568]: DEBUG oslo_service.periodic_task [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Running periodic task VolumeManager._thread_info {{(pid=88568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:56:53 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] thread count: 28 {{(pid=88568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:56:53 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] thread info: [<_MainThread(MainThread, started 127406866608256)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:56:53 devstack sudo[97894]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:53 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fd6f6a81-364a-4e01-832d-03bbc8ceff6a tempest-VolumesImageMetadata-2053395508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-cb5a8c70-56ae-4a2c-bd39-114d3cc7d582 1073741824" returned: 0 in 0.625s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:53 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fd6f6a81-364a-4e01-832d-03bbc8ceff6a tempest-VolumesImageMetadata-2053395508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-cb5a8c70-56ae-4a2c-bd39-114d3cc7d582 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:53 devstack sudo[97901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-cb5a8c70-56ae-4a2c-bd39-114d3cc7d582 Jul 30 16:56:53 devstack sudo[97901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:53 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-cc9b1a60-eb7d-4a45-8fff-e538e03b75ba tempest-VolumesTransfersV357Test-873378848 None] Transfer volume completed successfully. Jul 30 16:56:53 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-79e59098-ba28-4dfd-a663-c42ae2238f2d tempest-VolumesActionsTest-373005339 None] Acquiring lock "cinder-e98d1961-bad3-48b1-9dca-9a74229e5442-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:56:53 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-79e59098-ba28-4dfd-a663-c42ae2238f2d tempest-VolumesActionsTest-373005339 None] Lock "cinder-e98d1961-bad3-48b1-9dca-9a74229e5442-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:56:53 devstack sudo[97901]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:53 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-79e59098-ba28-4dfd-a663-c42ae2238f2d tempest-VolumesActionsTest-373005339 None] Acquiring lock "cinder-quobyte-e98d1961-bad3-48b1-9dca-9a74229e5442" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:56:53 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fd6f6a81-364a-4e01-832d-03bbc8ceff6a tempest-VolumesImageMetadata-2053395508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-cb5a8c70-56ae-4a2c-bd39-114d3cc7d582" returned: 0 in 0.286s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:53 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-fd6f6a81-364a-4e01-832d-03bbc8ceff6a tempest-VolumesImageMetadata-2053395508 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:56:53 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-fd6f6a81-364a-4e01-832d-03bbc8ceff6a tempest-VolumesImageMetadata-2053395508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:56:53 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-79e59098-ba28-4dfd-a663-c42ae2238f2d tempest-VolumesActionsTest-373005339 None] Lock "cinder-quobyte-e98d1961-bad3-48b1-9dca-9a74229e5442" acquired by "delete_volume" :: waited 0.029s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:56:53 devstack cinder-volume[88568]: DEBUG cinder.volume.volume_utils [None req-fd6f6a81-364a-4e01-832d-03bbc8ceff6a tempest-VolumesImageMetadata-2053395508 None] Attempting download of 6126230f-0fba-48b9-943c-1885f4fc4be0 ((None, [{'url': 'file:///opt/stack/data/glance/images/6126230f-0fba-48b9-943c-1885f4fc4be0', 'metadata': {}}])) to volume cb5a8c70-56ae-4a2c-bd39-114d3cc7d582. {{(pid=88568) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 30 16:56:53 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a13d50c-cbf6-40ed-9913-1c111646e452]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:56:53 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-79e59098-ba28-4dfd-a663-c42ae2238f2d tempest-VolumesActionsTest-373005339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e98d1961-bad3-48b1-9dca-9a74229e5442 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:53 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7cb6c3-e3f1-4095-9f77-227de08292d4]: (4, 'raw') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:56:53 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fd6f6a81-364a-4e01-832d-03bbc8ceff6a tempest-VolumesImageMetadata-2053395508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6126230f-0fba-48b9-943c-1885f4fc4be0_1ntkg9oa {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:53 devstack sudo[97904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e98d1961-bad3-48b1-9dca-9a74229e5442 Jul 30 16:56:53 devstack sudo[97904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:53 devstack sudo[97905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6126230f-0fba-48b9-943c-1885f4fc4be0_1ntkg9oa Jul 30 16:56:53 devstack sudo[97905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:54 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-86fe20ee-f3ee-40b8-919f-faa2100da3bb tempest-VolumesTransfersV357Test-827037977 None] Acquiring lock "cinder-5c231fd2-5ab4-485b-8216-2cbbb0b1386d-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:56:54 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-86fe20ee-f3ee-40b8-919f-faa2100da3bb tempest-VolumesTransfersV357Test-827037977 None] Lock "cinder-5c231fd2-5ab4-485b-8216-2cbbb0b1386d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:56:54 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-86fe20ee-f3ee-40b8-919f-faa2100da3bb tempest-VolumesTransfersV357Test-827037977 None] Acquiring lock "cinder-quobyte-5c231fd2-5ab4-485b-8216-2cbbb0b1386d" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:56:54 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-86fe20ee-f3ee-40b8-919f-faa2100da3bb tempest-VolumesTransfersV357Test-827037977 None] Lock "cinder-quobyte-5c231fd2-5ab4-485b-8216-2cbbb0b1386d" acquired by "delete_volume" :: waited 0.023s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:56:54 devstack sudo[97905]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fd6f6a81-364a-4e01-832d-03bbc8ceff6a tempest-VolumesImageMetadata-2053395508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6126230f-0fba-48b9-943c-1885f4fc4be0_1ntkg9oa" returned: 0 in 0.442s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fd6f6a81-364a-4e01-832d-03bbc8ceff6a tempest-VolumesImageMetadata-2053395508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6126230f-0fba-48b9-943c-1885f4fc4be0_1ntkg9oa {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:54 devstack sudo[97904]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:54 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b1c84d-69a4-489b-b30c-cdcb642930c6]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:56:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-86fe20ee-f3ee-40b8-919f-faa2100da3bb tempest-VolumesTransfersV357Test-827037977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5c231fd2-5ab4-485b-8216-2cbbb0b1386d {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-79e59098-ba28-4dfd-a663-c42ae2238f2d tempest-VolumesActionsTest-373005339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e98d1961-bad3-48b1-9dca-9a74229e5442" returned: 0 in 0.538s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-79e59098-ba28-4dfd-a663-c42ae2238f2d tempest-VolumesActionsTest-373005339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e98d1961-bad3-48b1-9dca-9a74229e5442 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:54 devstack sudo[97917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e98d1961-bad3-48b1-9dca-9a74229e5442 Jul 30 16:56:54 devstack sudo[97917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:54 devstack sudo[97915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6126230f-0fba-48b9-943c-1885f4fc4be0_1ntkg9oa Jul 30 16:56:54 devstack sudo[97915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:54 devstack sudo[97916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5c231fd2-5ab4-485b-8216-2cbbb0b1386d Jul 30 16:56:54 devstack sudo[97916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:54 devstack sudo[97917]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-79e59098-ba28-4dfd-a663-c42ae2238f2d tempest-VolumesActionsTest-373005339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e98d1961-bad3-48b1-9dca-9a74229e5442" returned: 0 in 0.307s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:54 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-79e59098-ba28-4dfd-a663-c42ae2238f2d tempest-VolumesActionsTest-373005339 None] Lock "cinder-quobyte-e98d1961-bad3-48b1-9dca-9a74229e5442" released by "delete_volume" :: held 0.917s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:56:54 devstack sudo[97915]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fd6f6a81-364a-4e01-832d-03bbc8ceff6a tempest-VolumesImageMetadata-2053395508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6126230f-0fba-48b9-943c-1885f4fc4be0_1ntkg9oa" returned: 1 in 0.450s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fd6f6a81-364a-4e01-832d-03bbc8ceff6a tempest-VolumesImageMetadata-2053395508 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6126230f-0fba-48b9-943c-1885f4fc4be0_1ntkg9oa' failed. Not Retrying. {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 16:56:54 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-79e59098-ba28-4dfd-a663-c42ae2238f2d tempest-VolumesActionsTest-373005339 None] Created reservations ['7bacd158-0255-4331-abbb-44614cc22104', '6f99ca5f-cd50-4798-a715-56e6ac9fa247', '40dd8510-d9a5-43eb-9adc-e9885cb15181', '49fcbcff-403b-4745-a5f5-96906384e4d9'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:56:54 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[499c463b-b463-44c8-844b-b721318c09e9]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:56:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fd6f6a81-364a-4e01-832d-03bbc8ceff6a tempest-VolumesImageMetadata-2053395508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6126230f-0fba-48b9-943c-1885f4fc4be0_6rpx2veudevstack@QuobyteHD {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:54 devstack sudo[97916]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-86fe20ee-f3ee-40b8-919f-faa2100da3bb tempest-VolumesTransfersV357Test-827037977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5c231fd2-5ab4-485b-8216-2cbbb0b1386d" returned: 0 in 0.471s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-86fe20ee-f3ee-40b8-919f-faa2100da3bb tempest-VolumesTransfersV357Test-827037977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5c231fd2-5ab4-485b-8216-2cbbb0b1386d {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:54 devstack sudo[97930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5c231fd2-5ab4-485b-8216-2cbbb0b1386d Jul 30 16:56:54 devstack sudo[97930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-79e59098-ba28-4dfd-a663-c42ae2238f2d tempest-VolumesActionsTest-373005339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:56:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-79e59098-ba28-4dfd-a663-c42ae2238f2d tempest-VolumesActionsTest-373005339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:56:54 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-79e59098-ba28-4dfd-a663-c42ae2238f2d tempest-VolumesActionsTest-373005339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:56:54 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-79e59098-ba28-4dfd-a663-c42ae2238f2d tempest-VolumesActionsTest-373005339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:56:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-79e59098-ba28-4dfd-a663-c42ae2238f2d tempest-VolumesActionsTest-373005339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:56:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-79e59098-ba28-4dfd-a663-c42ae2238f2d tempest-VolumesActionsTest-373005339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:54 devstack sudo[97929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6126230f-0fba-48b9-943c-1885f4fc4be0_6rpx2veudevstack@QuobyteHD Jul 30 16:56:54 devstack sudo[97929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:54 devstack sudo[97933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:56:54 devstack sudo[97933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:55 devstack sudo[97929]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fd6f6a81-364a-4e01-832d-03bbc8ceff6a tempest-VolumesImageMetadata-2053395508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6126230f-0fba-48b9-943c-1885f4fc4be0_6rpx2veudevstack@QuobyteHD" returned: 0 in 0.465s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:55 devstack cinder-volume[88568]: DEBUG cinder.image.image_utils [None req-fd6f6a81-364a-4e01-832d-03bbc8ceff6a tempest-VolumesImageMetadata-2053395508 None] 6126230f-0fba-48b9-943c-1885f4fc4be0 was qcow2, converting to qcow2 {{(pid=88568) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 30 16:56:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fd6f6a81-364a-4e01-832d-03bbc8ceff6a tempest-VolumesImageMetadata-2053395508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6126230f-0fba-48b9-943c-1885f4fc4be0_6rpx2veudevstack@QuobyteHD /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-cb5a8c70-56ae-4a2c-bd39-114d3cc7d582 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:55 devstack sudo[97945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6126230f-0fba-48b9-943c-1885f4fc4be0_6rpx2veudevstack@QuobyteHD /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-cb5a8c70-56ae-4a2c-bd39-114d3cc7d582 Jul 30 16:56:55 devstack sudo[97945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:55 devstack sudo[97930]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-86fe20ee-f3ee-40b8-919f-faa2100da3bb tempest-VolumesTransfersV357Test-827037977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5c231fd2-5ab4-485b-8216-2cbbb0b1386d" returned: 0 in 0.500s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:55 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-86fe20ee-f3ee-40b8-919f-faa2100da3bb tempest-VolumesTransfersV357Test-827037977 None] Lock "cinder-quobyte-5c231fd2-5ab4-485b-8216-2cbbb0b1386d" released by "delete_volume" :: held 1.041s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:56:55 devstack sudo[97933]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-79e59098-ba28-4dfd-a663-c42ae2238f2d tempest-VolumesActionsTest-373005339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.469s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:55 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-79e59098-ba28-4dfd-a663-c42ae2238f2d tempest-VolumesActionsTest-373005339 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:56:55 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-79e59098-ba28-4dfd-a663-c42ae2238f2d tempest-VolumesActionsTest-373005339 None] Deleted volume successfully. Jul 30 16:56:55 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-79e59098-ba28-4dfd-a663-c42ae2238f2d tempest-VolumesActionsTest-373005339 None] Lock "cinder-e98d1961-bad3-48b1-9dca-9a74229e5442-delete_volume" released by "delete_volume" :: held 1.773s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:56:55 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-86fe20ee-f3ee-40b8-919f-faa2100da3bb tempest-VolumesTransfersV357Test-827037977 None] Created reservations ['e57e0314-715b-4ba5-a848-3d56820c979f', 'c20f5705-a89c-4102-9fcb-b2a4806417a0', 'a5cd2e7d-700d-426e-9568-98d93cb4aa21', 'c9c19ed5-60e5-47b8-b2aa-1fba4c629e47'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:56:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-86fe20ee-f3ee-40b8-919f-faa2100da3bb tempest-VolumesTransfersV357Test-827037977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:56:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-86fe20ee-f3ee-40b8-919f-faa2100da3bb tempest-VolumesTransfersV357Test-827037977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:56:55 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-86fe20ee-f3ee-40b8-919f-faa2100da3bb tempest-VolumesTransfersV357Test-827037977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:56:55 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-86fe20ee-f3ee-40b8-919f-faa2100da3bb tempest-VolumesTransfersV357Test-827037977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:56:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-86fe20ee-f3ee-40b8-919f-faa2100da3bb tempest-VolumesTransfersV357Test-827037977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:56:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-86fe20ee-f3ee-40b8-919f-faa2100da3bb tempest-VolumesTransfersV357Test-827037977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:55 devstack sudo[97961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:56:55 devstack sudo[97961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:55 devstack sudo[97961]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-86fe20ee-f3ee-40b8-919f-faa2100da3bb tempest-VolumesTransfersV357Test-827037977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.421s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:55 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-86fe20ee-f3ee-40b8-919f-faa2100da3bb tempest-VolumesTransfersV357Test-827037977 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:56:55 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-86fe20ee-f3ee-40b8-919f-faa2100da3bb tempest-VolumesTransfersV357Test-827037977 None] Deleted volume successfully. Jul 30 16:56:56 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-86fe20ee-f3ee-40b8-919f-faa2100da3bb tempest-VolumesTransfersV357Test-827037977 None] Lock "cinder-5c231fd2-5ab4-485b-8216-2cbbb0b1386d-delete_volume" released by "delete_volume" :: held 1.858s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:56:56 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e3edfa8-2a8e-4ea2-a741-df7481604184 tempest-VolumesActionsTest-1451724932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:56:56 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8e3edfa8-2a8e-4ea2-a741-df7481604184 tempest-VolumesActionsTest-1451724932 None] Flow 'volume_create_manager' (038a0c20-03ff-43ec-bbc6-542265c85133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:56:56 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8e3edfa8-2a8e-4ea2-a741-df7481604184 tempest-VolumesActionsTest-1451724932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d217e7d0-0c6b-496b-8ee9-4d5f90b2efd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:56 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8e3edfa8-2a8e-4ea2-a741-df7481604184 tempest-VolumesActionsTest-1451724932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d217e7d0-0c6b-496b-8ee9-4d5f90b2efd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:56:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-763506381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=073c2136-6af0-42dc-becb-eed0e3be9ffd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d4cdc44a4d34072822865ed569a0be7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:56:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:56:57Z,use_quota=True,user_id='1cde7b4767cf4521bd2e65a15a371b3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:56 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8e3edfa8-2a8e-4ea2-a741-df7481604184 tempest-VolumesActionsTest-1451724932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6e4d3d8-9045-4abe-b15a-b7957336c2bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:56 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8e3edfa8-2a8e-4ea2-a741-df7481604184 tempest-VolumesActionsTest-1451724932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6e4d3d8-9045-4abe-b15a-b7957336c2bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:56 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8e3edfa8-2a8e-4ea2-a741-df7481604184 tempest-VolumesActionsTest-1451724932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (700e3120-c6bf-4452-b2c2-27ed83b08c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:56 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8e3edfa8-2a8e-4ea2-a741-df7481604184 tempest-VolumesActionsTest-1451724932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (700e3120-c6bf-4452-b2c2-27ed83b08c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '073c2136-6af0-42dc-becb-eed0e3be9ffd', 'volume_name': 'volume-073c2136-6af0-42dc-becb-eed0e3be9ffd', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:56 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8e3edfa8-2a8e-4ea2-a741-df7481604184 tempest-VolumesActionsTest-1451724932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2428786-3170-4037-b2bd-b3561cbbd4c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:56 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8e3edfa8-2a8e-4ea2-a741-df7481604184 tempest-VolumesActionsTest-1451724932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2428786-3170-4037-b2bd-b3561cbbd4c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:56 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8e3edfa8-2a8e-4ea2-a741-df7481604184 tempest-VolumesActionsTest-1451724932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e636dd62-ea60-4ed6-bb7f-d52851faef2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:56 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-8e3edfa8-2a8e-4ea2-a741-df7481604184 tempest-VolumesActionsTest-1451724932 None] Volume 073c2136-6af0-42dc-becb-eed0e3be9ffd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-073c2136-6af0-42dc-becb-eed0e3be9ffd', 'volume_size': 1} Jul 30 16:56:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-8e3edfa8-2a8e-4ea2-a741-df7481604184 tempest-VolumesActionsTest-1451724932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:56:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-8e3edfa8-2a8e-4ea2-a741-df7481604184 tempest-VolumesActionsTest-1451724932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:56:56 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-8e3edfa8-2a8e-4ea2-a741-df7481604184 tempest-VolumesActionsTest-1451724932 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:56:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-763506381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=073c2136-6af0-42dc-becb-eed0e3be9ffd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d4cdc44a4d34072822865ed569a0be7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:56:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:56:57Z,use_quota=True,user_id='1cde7b4767cf4521bd2e65a15a371b3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:56:56 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-8e3edfa8-2a8e-4ea2-a741-df7481604184 tempest-VolumesActionsTest-1451724932 None] Creating volume 073c2136-6af0-42dc-becb-eed0e3be9ffd {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:56:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-8e3edfa8-2a8e-4ea2-a741-df7481604184 tempest-VolumesActionsTest-1451724932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:56:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-8e3edfa8-2a8e-4ea2-a741-df7481604184 tempest-VolumesActionsTest-1451724932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:56:56 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-8e3edfa8-2a8e-4ea2-a741-df7481604184 tempest-VolumesActionsTest-1451724932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:56:56 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-8e3edfa8-2a8e-4ea2-a741-df7481604184 tempest-VolumesActionsTest-1451724932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:56:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-8e3edfa8-2a8e-4ea2-a741-df7481604184 tempest-VolumesActionsTest-1451724932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:56:57 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-8e3edfa8-2a8e-4ea2-a741-df7481604184 tempest-VolumesActionsTest-1451724932 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:56:57 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-8e3edfa8-2a8e-4ea2-a741-df7481604184 tempest-VolumesActionsTest-1451724932 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 16:56:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8e3edfa8-2a8e-4ea2-a741-df7481604184 tempest-VolumesActionsTest-1451724932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-073c2136-6af0-42dc-becb-eed0e3be9ffd 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:57 devstack sudo[97988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-073c2136-6af0-42dc-becb-eed0e3be9ffd 1073741824 Jul 30 16:56:57 devstack sudo[97988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:57 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fd67100-15d3-4854-af07-c68b3a8a0c24 tempest-VolumesTransfersV357Test-1400546377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:56:57 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9fd67100-15d3-4854-af07-c68b3a8a0c24 tempest-VolumesTransfersV357Test-1400546377 None] Flow 'volume_create_manager' (bd633a8b-2032-4cee-9e75-116fb438ed8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:56:57 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9fd67100-15d3-4854-af07-c68b3a8a0c24 tempest-VolumesTransfersV357Test-1400546377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f9e3731-2f3b-463c-b30b-5a0d0161f732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:57 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9fd67100-15d3-4854-af07-c68b3a8a0c24 tempest-VolumesTransfersV357Test-1400546377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f9e3731-2f3b-463c-b30b-5a0d0161f732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:56:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1218420237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b6f46ea-9848-4a54-8a1f-f50ca227f0c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d104a9f4cc74005b50536053fb6f5c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:56:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:56:57Z,use_quota=True,user_id='cfaa402de8a34ca2813080abf94ac3b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:57 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9fd67100-15d3-4854-af07-c68b3a8a0c24 tempest-VolumesTransfersV357Test-1400546377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a181d068-7154-4632-8922-976f599616f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:57 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9fd67100-15d3-4854-af07-c68b3a8a0c24 tempest-VolumesTransfersV357Test-1400546377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a181d068-7154-4632-8922-976f599616f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:57 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9fd67100-15d3-4854-af07-c68b3a8a0c24 tempest-VolumesTransfersV357Test-1400546377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fc920f6-8103-4272-ad4b-aa374a2a214f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:57 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9fd67100-15d3-4854-af07-c68b3a8a0c24 tempest-VolumesTransfersV357Test-1400546377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fc920f6-8103-4272-ad4b-aa374a2a214f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b6f46ea-9848-4a54-8a1f-f50ca227f0c7', 'volume_name': 'volume-3b6f46ea-9848-4a54-8a1f-f50ca227f0c7', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:57 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9fd67100-15d3-4854-af07-c68b3a8a0c24 tempest-VolumesTransfersV357Test-1400546377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a0362f5-83ee-4241-9e4c-15cd27c388c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:57 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9fd67100-15d3-4854-af07-c68b3a8a0c24 tempest-VolumesTransfersV357Test-1400546377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a0362f5-83ee-4241-9e4c-15cd27c388c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:57 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9fd67100-15d3-4854-af07-c68b3a8a0c24 tempest-VolumesTransfersV357Test-1400546377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17f59ffe-0070-4ec6-89e0-8f35dab4331c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:57 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-9fd67100-15d3-4854-af07-c68b3a8a0c24 tempest-VolumesTransfersV357Test-1400546377 None] Volume 3b6f46ea-9848-4a54-8a1f-f50ca227f0c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b6f46ea-9848-4a54-8a1f-f50ca227f0c7', 'volume_size': 1} Jul 30 16:56:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-9fd67100-15d3-4854-af07-c68b3a8a0c24 tempest-VolumesTransfersV357Test-1400546377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:56:57 devstack sudo[97988]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8e3edfa8-2a8e-4ea2-a741-df7481604184 tempest-VolumesActionsTest-1451724932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-073c2136-6af0-42dc-becb-eed0e3be9ffd 1073741824" returned: 0 in 0.692s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8e3edfa8-2a8e-4ea2-a741-df7481604184 tempest-VolumesActionsTest-1451724932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-073c2136-6af0-42dc-becb-eed0e3be9ffd {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:57 devstack sudo[97996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-073c2136-6af0-42dc-becb-eed0e3be9ffd Jul 30 16:56:57 devstack sudo[97996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:58 devstack sudo[97996]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8e3edfa8-2a8e-4ea2-a741-df7481604184 tempest-VolumesActionsTest-1451724932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-073c2136-6af0-42dc-becb-eed0e3be9ffd" returned: 0 in 0.383s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:58 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-8e3edfa8-2a8e-4ea2-a741-df7481604184 tempest-VolumesActionsTest-1451724932 None] <== create_volume: return (1148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:56:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-8e3edfa8-2a8e-4ea2-a741-df7481604184 tempest-VolumesActionsTest-1451724932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.153s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:56:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-9fd67100-15d3-4854-af07-c68b3a8a0c24 tempest-VolumesTransfersV357Test-1400546377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.617s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:56:58 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-9fd67100-15d3-4854-af07-c68b3a8a0c24 tempest-VolumesTransfersV357Test-1400546377 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:56:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1218420237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b6f46ea-9848-4a54-8a1f-f50ca227f0c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d104a9f4cc74005b50536053fb6f5c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:56:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:56:57Z,use_quota=True,user_id='cfaa402de8a34ca2813080abf94ac3b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:56:58 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-9fd67100-15d3-4854-af07-c68b3a8a0c24 tempest-VolumesTransfersV357Test-1400546377 None] Creating volume 3b6f46ea-9848-4a54-8a1f-f50ca227f0c7 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:56:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-9fd67100-15d3-4854-af07-c68b3a8a0c24 tempest-VolumesTransfersV357Test-1400546377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:56:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-9fd67100-15d3-4854-af07-c68b3a8a0c24 tempest-VolumesTransfersV357Test-1400546377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:56:58 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-9fd67100-15d3-4854-af07-c68b3a8a0c24 tempest-VolumesTransfersV357Test-1400546377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:56:58 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-9fd67100-15d3-4854-af07-c68b3a8a0c24 tempest-VolumesTransfersV357Test-1400546377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:56:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-9fd67100-15d3-4854-af07-c68b3a8a0c24 tempest-VolumesTransfersV357Test-1400546377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:56:58 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-9fd67100-15d3-4854-af07-c68b3a8a0c24 tempest-VolumesTransfersV357Test-1400546377 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:56:58 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-9fd67100-15d3-4854-af07-c68b3a8a0c24 tempest-VolumesTransfersV357Test-1400546377 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 16:56:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9fd67100-15d3-4854-af07-c68b3a8a0c24 tempest-VolumesTransfersV357Test-1400546377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-3b6f46ea-9848-4a54-8a1f-f50ca227f0c7 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:58 devstack sudo[97945]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fd6f6a81-364a-4e01-832d-03bbc8ceff6a tempest-VolumesImageMetadata-2053395508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6126230f-0fba-48b9-943c-1885f4fc4be0_6rpx2veudevstack@QuobyteHD /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-cb5a8c70-56ae-4a2c-bd39-114d3cc7d582" returned: 0 in 3.044s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:58 devstack cinder-volume[88568]: DEBUG cinder.image.image_utils [None req-fd6f6a81-364a-4e01-832d-03bbc8ceff6a tempest-VolumesImageMetadata-2053395508 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6126230f-0fba-48b9-943c-1885f4fc4be0_6rpx2veudevstack@QuobyteHD, size 112.00 MB, duration 3.05 sec, destination /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-cb5a8c70-56ae-4a2c-bd39-114d3cc7d582 {{(pid=88568) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 16:56:58 devstack cinder-volume[88568]: INFO cinder.image.image_utils [None req-fd6f6a81-364a-4e01-832d-03bbc8ceff6a tempest-VolumesImageMetadata-2053395508 None] Converted 112.00 MB image at 36.70 MB/s Jul 30 16:56:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fd6f6a81-364a-4e01-832d-03bbc8ceff6a tempest-VolumesImageMetadata-2053395508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-cb5a8c70-56ae-4a2c-bd39-114d3cc7d582 1G {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:58 devstack sudo[98000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-3b6f46ea-9848-4a54-8a1f-f50ca227f0c7 1073741824 Jul 30 16:56:58 devstack sudo[98000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:58 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8e3edfa8-2a8e-4ea2-a741-df7481604184 tempest-VolumesActionsTest-1451724932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e636dd62-ea60-4ed6-bb7f-d52851faef2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-073c2136-6af0-42dc-becb-eed0e3be9ffd', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:58 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8e3edfa8-2a8e-4ea2-a741-df7481604184 tempest-VolumesActionsTest-1451724932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3359fa94-a666-4977-a393-1eb71ad633b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:58 devstack sudo[98001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-cb5a8c70-56ae-4a2c-bd39-114d3cc7d582 1G Jul 30 16:56:58 devstack sudo[98001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:58 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-8e3edfa8-2a8e-4ea2-a741-df7481604184 tempest-VolumesActionsTest-1451724932 None] Volume volume-073c2136-6af0-42dc-becb-eed0e3be9ffd (073c2136-6af0-42dc-becb-eed0e3be9ffd): created successfully Jul 30 16:56:58 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8e3edfa8-2a8e-4ea2-a741-df7481604184 tempest-VolumesActionsTest-1451724932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3359fa94-a666-4977-a393-1eb71ad633b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:58 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8e3edfa8-2a8e-4ea2-a741-df7481604184 tempest-VolumesActionsTest-1451724932 None] Flow 'volume_create_manager' (038a0c20-03ff-43ec-bbc6-542265c85133) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:56:58 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-8e3edfa8-2a8e-4ea2-a741-df7481604184 tempest-VolumesActionsTest-1451724932 None] Created volume successfully. Jul 30 16:56:58 devstack sudo[98001]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fd6f6a81-364a-4e01-832d-03bbc8ceff6a tempest-VolumesImageMetadata-2053395508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-cb5a8c70-56ae-4a2c-bd39-114d3cc7d582 1G" returned: 0 in 0.420s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:58 devstack cinder-volume[88568]: DEBUG cinder.volume.volume_utils [None req-fd6f6a81-364a-4e01-832d-03bbc8ceff6a tempest-VolumesImageMetadata-2053395508 None] Downloaded image 6126230f-0fba-48b9-943c-1885f4fc4be0 ((None, [{'url': 'file:///opt/stack/data/glance/images/6126230f-0fba-48b9-943c-1885f4fc4be0', 'metadata': {}}])) to volume cb5a8c70-56ae-4a2c-bd39-114d3cc7d582 successfully. {{(pid=88568) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 30 16:56:58 devstack cinder-volume[88568]: DEBUG cinder.image.image_utils [None req-fd6f6a81-364a-4e01-832d-03bbc8ceff6a tempest-VolumesImageMetadata-2053395508 None] Temporary image 6126230f-0fba-48b9-943c-1885f4fc4be0 for user 58f3a131b3da4a80a42aa58325761f13 is deleted. {{(pid=88568) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 30 16:56:58 devstack cinder-volume[88568]: DEBUG cinder.volume.volume_utils [None req-fd6f6a81-364a-4e01-832d-03bbc8ceff6a tempest-VolumesImageMetadata-2053395508 None] Marking volume cb5a8c70-56ae-4a2c-bd39-114d3cc7d582 as bootable. {{(pid=88568) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 30 16:56:58 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd6f6a81-364a-4e01-832d-03bbc8ceff6a tempest-VolumesImageMetadata-2053395508 None] Copying metadata from image 6126230f-0fba-48b9-943c-1885f4fc4be0 to cb5a8c70-56ae-4a2c-bd39-114d3cc7d582. {{(pid=88568) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 30 16:56:58 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd6f6a81-364a-4e01-832d-03bbc8ceff6a tempest-VolumesImageMetadata-2053395508 None] Creating volume glance metadata for volume cb5a8c70-56ae-4a2c-bd39-114d3cc7d582 backed by image 6126230f-0fba-48b9-943c-1885f4fc4be0 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6126230f-0fba-48b9-943c-1885f4fc4be0', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88568) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 30 16:56:58 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fd6f6a81-364a-4e01-832d-03bbc8ceff6a tempest-VolumesImageMetadata-2053395508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61321c42-b8c0-4641-a1b8-8b62fdb510f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb5a8c70-56ae-4a2c-bd39-114d3cc7d582', 'volume_size': 1, 'image_id': '6126230f-0fba-48b9-943c-1885f4fc4be0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6126230f-0fba-48b9-943c-1885f4fc4be0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2802aa975ace4011a130c68c7a9c96bb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6126230f-0fba-48b9-943c-1885f4fc4be0', 'created_at': datetime.datetime(2026, 7, 30, 14, 43, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 43, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6126230f-0fba-48b9-943c-1885f4fc4be0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:58 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fd6f6a81-364a-4e01-832d-03bbc8ceff6a tempest-VolumesImageMetadata-2053395508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ffae0d1-cd3f-4d6e-8f80-27938ce8fc21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:58 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-fd6f6a81-364a-4e01-832d-03bbc8ceff6a tempest-VolumesImageMetadata-2053395508 None] Volume volume-cb5a8c70-56ae-4a2c-bd39-114d3cc7d582 (cb5a8c70-56ae-4a2c-bd39-114d3cc7d582): created successfully Jul 30 16:56:58 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fd6f6a81-364a-4e01-832d-03bbc8ceff6a tempest-VolumesImageMetadata-2053395508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ffae0d1-cd3f-4d6e-8f80-27938ce8fc21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:58 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fd6f6a81-364a-4e01-832d-03bbc8ceff6a tempest-VolumesImageMetadata-2053395508 None] Flow 'volume_create_manager' (05f32411-abbe-4e81-9dda-452022d83d2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:56:58 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-fd6f6a81-364a-4e01-832d-03bbc8ceff6a tempest-VolumesImageMetadata-2053395508 None] Created volume successfully. Jul 30 16:56:58 devstack sudo[98000]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9fd67100-15d3-4854-af07-c68b3a8a0c24 tempest-VolumesTransfersV357Test-1400546377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-3b6f46ea-9848-4a54-8a1f-f50ca227f0c7 1073741824" returned: 0 in 0.713s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9fd67100-15d3-4854-af07-c68b3a8a0c24 tempest-VolumesTransfersV357Test-1400546377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-3b6f46ea-9848-4a54-8a1f-f50ca227f0c7 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:58 devstack sudo[98012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-3b6f46ea-9848-4a54-8a1f-f50ca227f0c7 Jul 30 16:56:58 devstack sudo[98012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:59 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-ed8c9404-74e2-419f-8ffb-51265ccff184 tempest-VolumesActionsTest-373005339 None] Acquiring lock "cinder-073c2136-6af0-42dc-becb-eed0e3be9ffd-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:56:59 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-ed8c9404-74e2-419f-8ffb-51265ccff184 tempest-VolumesActionsTest-373005339 None] Lock "cinder-073c2136-6af0-42dc-becb-eed0e3be9ffd-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:56:59 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-ed8c9404-74e2-419f-8ffb-51265ccff184 tempest-VolumesActionsTest-373005339 None] Acquiring lock "cinder-quobyte-073c2136-6af0-42dc-becb-eed0e3be9ffd" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:56:59 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-ed8c9404-74e2-419f-8ffb-51265ccff184 tempest-VolumesActionsTest-373005339 None] Lock "cinder-quobyte-073c2136-6af0-42dc-becb-eed0e3be9ffd" acquired by "delete_volume" :: waited 0.015s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:56:59 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a027fa-5f01-408f-8d4f-d067afa08a75]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:56:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-ed8c9404-74e2-419f-8ffb-51265ccff184 tempest-VolumesActionsTest-373005339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-073c2136-6af0-42dc-becb-eed0e3be9ffd {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:59 devstack sudo[98012]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9fd67100-15d3-4854-af07-c68b3a8a0c24 tempest-VolumesTransfersV357Test-1400546377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-3b6f46ea-9848-4a54-8a1f-f50ca227f0c7" returned: 0 in 0.283s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:59 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-9fd67100-15d3-4854-af07-c68b3a8a0c24 tempest-VolumesTransfersV357Test-1400546377 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:56:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-9fd67100-15d3-4854-af07-c68b3a8a0c24 tempest-VolumesTransfersV357Test-1400546377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:56:59 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9fd67100-15d3-4854-af07-c68b3a8a0c24 tempest-VolumesTransfersV357Test-1400546377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17f59ffe-0070-4ec6-89e0-8f35dab4331c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b6f46ea-9848-4a54-8a1f-f50ca227f0c7', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:59 devstack sudo[98014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-073c2136-6af0-42dc-becb-eed0e3be9ffd Jul 30 16:56:59 devstack sudo[98014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:59 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9fd67100-15d3-4854-af07-c68b3a8a0c24 tempest-VolumesTransfersV357Test-1400546377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa1c63d3-a1db-49fe-b8ff-1cb54a10ec29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:59 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-9fd67100-15d3-4854-af07-c68b3a8a0c24 tempest-VolumesTransfersV357Test-1400546377 None] Volume volume-3b6f46ea-9848-4a54-8a1f-f50ca227f0c7 (3b6f46ea-9848-4a54-8a1f-f50ca227f0c7): created successfully Jul 30 16:56:59 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9fd67100-15d3-4854-af07-c68b3a8a0c24 tempest-VolumesTransfersV357Test-1400546377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa1c63d3-a1db-49fe-b8ff-1cb54a10ec29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:59 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9fd67100-15d3-4854-af07-c68b3a8a0c24 tempest-VolumesTransfersV357Test-1400546377 None] Flow 'volume_create_manager' (bd633a8b-2032-4cee-9e75-116fb438ed8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:56:59 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-9fd67100-15d3-4854-af07-c68b3a8a0c24 tempest-VolumesTransfersV357Test-1400546377 None] Created volume successfully. Jul 30 16:56:59 devstack sudo[98014]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-ed8c9404-74e2-419f-8ffb-51265ccff184 tempest-VolumesActionsTest-373005339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-073c2136-6af0-42dc-becb-eed0e3be9ffd" returned: 0 in 0.513s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-ed8c9404-74e2-419f-8ffb-51265ccff184 tempest-VolumesActionsTest-373005339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-073c2136-6af0-42dc-becb-eed0e3be9ffd {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:59 devstack sudo[98021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-073c2136-6af0-42dc-becb-eed0e3be9ffd Jul 30 16:56:59 devstack sudo[98021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:59 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-38386d14-82e7-43d4-b25d-eafd0fef1b06 tempest-VolumesTransfersV357Test-827037977 None] Acquiring lock "cinder-3b6f46ea-9848-4a54-8a1f-f50ca227f0c7-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:56:59 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-38386d14-82e7-43d4-b25d-eafd0fef1b06 tempest-VolumesTransfersV357Test-827037977 None] Lock "cinder-3b6f46ea-9848-4a54-8a1f-f50ca227f0c7-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:56:59 devstack sudo[98021]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-ed8c9404-74e2-419f-8ffb-51265ccff184 tempest-VolumesActionsTest-373005339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-073c2136-6af0-42dc-becb-eed0e3be9ffd" returned: 0 in 0.347s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:59 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-ed8c9404-74e2-419f-8ffb-51265ccff184 tempest-VolumesActionsTest-373005339 None] Lock "cinder-quobyte-073c2136-6af0-42dc-becb-eed0e3be9ffd" released by "delete_volume" :: held 0.908s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:56:59 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-38386d14-82e7-43d4-b25d-eafd0fef1b06 tempest-VolumesTransfersV357Test-827037977 None] Acquiring lock "cinder-quobyte-3b6f46ea-9848-4a54-8a1f-f50ca227f0c7" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:57:00 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-38386d14-82e7-43d4-b25d-eafd0fef1b06 tempest-VolumesTransfersV357Test-827037977 None] Lock "cinder-quobyte-3b6f46ea-9848-4a54-8a1f-f50ca227f0c7" acquired by "delete_volume" :: waited 0.026s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:57:00 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cded696-663c-427c-921d-11db13ae6b9c]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:57:00 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-38386d14-82e7-43d4-b25d-eafd0fef1b06 tempest-VolumesTransfersV357Test-827037977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-3b6f46ea-9848-4a54-8a1f-f50ca227f0c7 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:00 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-ed8c9404-74e2-419f-8ffb-51265ccff184 tempest-VolumesActionsTest-373005339 None] Created reservations ['6abb50c3-70a8-404b-8978-4843acdf9cf1', '8e65db6e-a852-4cf2-90c6-5af086016856', 'bbf72244-30da-4ee9-9527-8801a4a85883', 'd7b1dc7a-d528-4106-9237-c94568825eb3'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:57:00 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-7606e909-0567-4d99-b9ae-38ff19684e67 tempest-VolumesImageMetadata-2053395508 None] Acquiring lock "cinder-cb5a8c70-56ae-4a2c-bd39-114d3cc7d582-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:57:00 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-7606e909-0567-4d99-b9ae-38ff19684e67 tempest-VolumesImageMetadata-2053395508 None] Lock "cinder-cb5a8c70-56ae-4a2c-bd39-114d3cc7d582-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:57:00 devstack sudo[98024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-3b6f46ea-9848-4a54-8a1f-f50ca227f0c7 Jul 30 16:57:00 devstack sudo[98024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:00 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-ed8c9404-74e2-419f-8ffb-51265ccff184 tempest-VolumesActionsTest-373005339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:57:00 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-ed8c9404-74e2-419f-8ffb-51265ccff184 tempest-VolumesActionsTest-373005339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:57:00 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-ed8c9404-74e2-419f-8ffb-51265ccff184 tempest-VolumesActionsTest-373005339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:57:00 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-ed8c9404-74e2-419f-8ffb-51265ccff184 tempest-VolumesActionsTest-373005339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:57:00 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-ed8c9404-74e2-419f-8ffb-51265ccff184 tempest-VolumesActionsTest-373005339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:57:00 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-ed8c9404-74e2-419f-8ffb-51265ccff184 tempest-VolumesActionsTest-373005339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:00 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-7606e909-0567-4d99-b9ae-38ff19684e67 tempest-VolumesImageMetadata-2053395508 None] Acquiring lock "cinder-quobyte-cb5a8c70-56ae-4a2c-bd39-114d3cc7d582" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:57:00 devstack sudo[98026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:57:00 devstack sudo[98026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:00 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-7606e909-0567-4d99-b9ae-38ff19684e67 tempest-VolumesImageMetadata-2053395508 None] Lock "cinder-quobyte-cb5a8c70-56ae-4a2c-bd39-114d3cc7d582" acquired by "delete_volume" :: waited 0.027s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:57:00 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[25563583-a9d4-43d1-b82f-8ca8147c77c5]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:57:00 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7606e909-0567-4d99-b9ae-38ff19684e67 tempest-VolumesImageMetadata-2053395508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-cb5a8c70-56ae-4a2c-bd39-114d3cc7d582 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:00 devstack sudo[98028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-cb5a8c70-56ae-4a2c-bd39-114d3cc7d582 Jul 30 16:57:00 devstack sudo[98028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:00 devstack sudo[98026]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:00 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-ed8c9404-74e2-419f-8ffb-51265ccff184 tempest-VolumesActionsTest-373005339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.345s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:00 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-ed8c9404-74e2-419f-8ffb-51265ccff184 tempest-VolumesActionsTest-373005339 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:57:00 devstack sudo[98024]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:00 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-ed8c9404-74e2-419f-8ffb-51265ccff184 tempest-VolumesActionsTest-373005339 None] Deleted volume successfully. Jul 30 16:57:00 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-38386d14-82e7-43d4-b25d-eafd0fef1b06 tempest-VolumesTransfersV357Test-827037977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-3b6f46ea-9848-4a54-8a1f-f50ca227f0c7" returned: 0 in 0.615s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:00 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-38386d14-82e7-43d4-b25d-eafd0fef1b06 tempest-VolumesTransfersV357Test-827037977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-3b6f46ea-9848-4a54-8a1f-f50ca227f0c7 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:00 devstack sudo[98034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-3b6f46ea-9848-4a54-8a1f-f50ca227f0c7 Jul 30 16:57:00 devstack sudo[98034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:00 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-ed8c9404-74e2-419f-8ffb-51265ccff184 tempest-VolumesActionsTest-373005339 None] Lock "cinder-073c2136-6af0-42dc-becb-eed0e3be9ffd-delete_volume" released by "delete_volume" :: held 1.701s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:57:00 devstack sudo[98028]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:00 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7606e909-0567-4d99-b9ae-38ff19684e67 tempest-VolumesImageMetadata-2053395508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-cb5a8c70-56ae-4a2c-bd39-114d3cc7d582" returned: 0 in 0.500s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:00 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7606e909-0567-4d99-b9ae-38ff19684e67 tempest-VolumesImageMetadata-2053395508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-cb5a8c70-56ae-4a2c-bd39-114d3cc7d582 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:00 devstack sudo[98040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-cb5a8c70-56ae-4a2c-bd39-114d3cc7d582 Jul 30 16:57:00 devstack sudo[98040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:01 devstack sudo[98034]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-38386d14-82e7-43d4-b25d-eafd0fef1b06 tempest-VolumesTransfersV357Test-827037977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-3b6f46ea-9848-4a54-8a1f-f50ca227f0c7" returned: 0 in 0.324s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:01 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-38386d14-82e7-43d4-b25d-eafd0fef1b06 tempest-VolumesTransfersV357Test-827037977 None] Lock "cinder-quobyte-3b6f46ea-9848-4a54-8a1f-f50ca227f0c7" released by "delete_volume" :: held 1.004s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:57:01 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-38386d14-82e7-43d4-b25d-eafd0fef1b06 tempest-VolumesTransfersV357Test-827037977 None] Created reservations ['1ce3c781-76dc-4a3e-821b-bbe1cc4c1988', 'e86800fb-f1d6-471c-b620-29f25e7e41e6', '0a9ebd5d-1615-46ad-b430-7dac0d90127a', '5f35b2b9-b431-4bf1-bebe-784f5266e1a0'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:57:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-38386d14-82e7-43d4-b25d-eafd0fef1b06 tempest-VolumesTransfersV357Test-827037977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:57:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-38386d14-82e7-43d4-b25d-eafd0fef1b06 tempest-VolumesTransfersV357Test-827037977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:57:01 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-38386d14-82e7-43d4-b25d-eafd0fef1b06 tempest-VolumesTransfersV357Test-827037977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:57:01 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-38386d14-82e7-43d4-b25d-eafd0fef1b06 tempest-VolumesTransfersV357Test-827037977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:57:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-38386d14-82e7-43d4-b25d-eafd0fef1b06 tempest-VolumesTransfersV357Test-827037977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:57:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-38386d14-82e7-43d4-b25d-eafd0fef1b06 tempest-VolumesTransfersV357Test-827037977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:01 devstack sudo[98046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:57:01 devstack sudo[98046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:01 devstack sudo[98040]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7606e909-0567-4d99-b9ae-38ff19684e67 tempest-VolumesImageMetadata-2053395508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-cb5a8c70-56ae-4a2c-bd39-114d3cc7d582" returned: 0 in 0.301s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:01 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-7606e909-0567-4d99-b9ae-38ff19684e67 tempest-VolumesImageMetadata-2053395508 None] Lock "cinder-quobyte-cb5a8c70-56ae-4a2c-bd39-114d3cc7d582" released by "delete_volume" :: held 0.879s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:57:01 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-7606e909-0567-4d99-b9ae-38ff19684e67 tempest-VolumesImageMetadata-2053395508 None] Created reservations ['e6ed003b-5c10-4bf7-8264-55a4e13792e2', '7c23f0e5-0804-4568-b91e-b898733bffe0', 'a5d07328-5139-4c30-89e6-81cad42f59b8', '1af5d0ec-3319-4efd-8531-df201330181a'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:57:01 devstack sudo[98046]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-38386d14-82e7-43d4-b25d-eafd0fef1b06 tempest-VolumesTransfersV357Test-827037977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.329s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:01 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-38386d14-82e7-43d4-b25d-eafd0fef1b06 tempest-VolumesTransfersV357Test-827037977 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:57:01 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-38386d14-82e7-43d4-b25d-eafd0fef1b06 tempest-VolumesTransfersV357Test-827037977 None] Deleted volume successfully. Jul 30 16:57:01 devstack cinder-volume[88568]: INFO cinder.volume.manager [req-94c6fcf7-fa15-4628-a9b9-e25ce159e2ab req-7c232e58-882e-418f-83d2-437eac4127cf tempest-AttachVolumeNegativeTest-1037417113 None] Terminate volume connection completed successfully. Jul 30 16:57:01 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [req-94c6fcf7-fa15-4628-a9b9-e25ce159e2ab req-7c232e58-882e-418f-83d2-437eac4127cf tempest-AttachVolumeNegativeTest-1037417113 None] Deleting attachment 700a0c61-6fa4-4b69-842f-968905c6d004. {{(pid=88568) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 16:57:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-7606e909-0567-4d99-b9ae-38ff19684e67 tempest-VolumesImageMetadata-2053395508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:57:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-7606e909-0567-4d99-b9ae-38ff19684e67 tempest-VolumesImageMetadata-2053395508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:57:01 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-7606e909-0567-4d99-b9ae-38ff19684e67 tempest-VolumesImageMetadata-2053395508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:57:01 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-7606e909-0567-4d99-b9ae-38ff19684e67 tempest-VolumesImageMetadata-2053395508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:57:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-7606e909-0567-4d99-b9ae-38ff19684e67 tempest-VolumesImageMetadata-2053395508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:57:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7606e909-0567-4d99-b9ae-38ff19684e67 tempest-VolumesImageMetadata-2053395508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:01 devstack sudo[98053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:57:01 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-38386d14-82e7-43d4-b25d-eafd0fef1b06 tempest-VolumesTransfersV357Test-827037977 None] Lock "cinder-3b6f46ea-9848-4a54-8a1f-f50ca227f0c7-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:57:01 devstack sudo[98053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:01 devstack sudo[98053]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7606e909-0567-4d99-b9ae-38ff19684e67 tempest-VolumesImageMetadata-2053395508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.368s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:01 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-7606e909-0567-4d99-b9ae-38ff19684e67 tempest-VolumesImageMetadata-2053395508 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:57:01 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-7606e909-0567-4d99-b9ae-38ff19684e67 tempest-VolumesImageMetadata-2053395508 None] Deleted volume successfully. Jul 30 16:57:01 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-7606e909-0567-4d99-b9ae-38ff19684e67 tempest-VolumesImageMetadata-2053395508 None] Lock "cinder-cb5a8c70-56ae-4a2c-bd39-114d3cc7d582-delete_volume" released by "delete_volume" :: held 1.710s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:57:02 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6b7830a-e2aa-46ac-923d-debbd9d13b01 tempest-VolumesActionsTest-1451724932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:57:02 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a6b7830a-e2aa-46ac-923d-debbd9d13b01 tempest-VolumesActionsTest-1451724932 None] Flow 'volume_create_manager' (76a844bc-6d21-41a3-9818-3cd586997af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:57:02 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a6b7830a-e2aa-46ac-923d-debbd9d13b01 tempest-VolumesActionsTest-1451724932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2ddfa76-02f9-42fe-967b-fc385be01473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:02 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a6b7830a-e2aa-46ac-923d-debbd9d13b01 tempest-VolumesActionsTest-1451724932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2ddfa76-02f9-42fe-967b-fc385be01473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:57:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1871397716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cce00bad-6637-419c-a26a-c5e19ebc1341,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d4cdc44a4d34072822865ed569a0be7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:57:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:57:02Z,use_quota=True,user_id='1cde7b4767cf4521bd2e65a15a371b3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:02 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a6b7830a-e2aa-46ac-923d-debbd9d13b01 tempest-VolumesActionsTest-1451724932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df9e41be-016d-48ef-8f74-6ccaaaee3e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:02 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a6b7830a-e2aa-46ac-923d-debbd9d13b01 tempest-VolumesActionsTest-1451724932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df9e41be-016d-48ef-8f74-6ccaaaee3e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:02 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a6b7830a-e2aa-46ac-923d-debbd9d13b01 tempest-VolumesActionsTest-1451724932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7efe8a8-6426-40b1-a607-cf780f55b3cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:02 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a6b7830a-e2aa-46ac-923d-debbd9d13b01 tempest-VolumesActionsTest-1451724932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7efe8a8-6426-40b1-a607-cf780f55b3cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cce00bad-6637-419c-a26a-c5e19ebc1341', 'volume_name': 'volume-cce00bad-6637-419c-a26a-c5e19ebc1341', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:02 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a6b7830a-e2aa-46ac-923d-debbd9d13b01 tempest-VolumesActionsTest-1451724932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c998da7e-abbe-458d-b369-6ca244a06c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:02 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a6b7830a-e2aa-46ac-923d-debbd9d13b01 tempest-VolumesActionsTest-1451724932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c998da7e-abbe-458d-b369-6ca244a06c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:02 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a6b7830a-e2aa-46ac-923d-debbd9d13b01 tempest-VolumesActionsTest-1451724932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89633548-f31a-44cf-99fc-46fc65f182ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:02 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-a6b7830a-e2aa-46ac-923d-debbd9d13b01 tempest-VolumesActionsTest-1451724932 None] Volume cce00bad-6637-419c-a26a-c5e19ebc1341: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cce00bad-6637-419c-a26a-c5e19ebc1341', 'volume_size': 1} Jul 30 16:57:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a6b7830a-e2aa-46ac-923d-debbd9d13b01 tempest-VolumesActionsTest-1451724932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:57:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a6b7830a-e2aa-46ac-923d-debbd9d13b01 tempest-VolumesActionsTest-1451724932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:57:02 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-a6b7830a-e2aa-46ac-923d-debbd9d13b01 tempest-VolumesActionsTest-1451724932 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:57:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1871397716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cce00bad-6637-419c-a26a-c5e19ebc1341,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d4cdc44a4d34072822865ed569a0be7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:57:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:57:02Z,use_quota=True,user_id='1cde7b4767cf4521bd2e65a15a371b3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:57:02 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-a6b7830a-e2aa-46ac-923d-debbd9d13b01 tempest-VolumesActionsTest-1451724932 None] Creating volume cce00bad-6637-419c-a26a-c5e19ebc1341 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:57:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a6b7830a-e2aa-46ac-923d-debbd9d13b01 tempest-VolumesActionsTest-1451724932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:57:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a6b7830a-e2aa-46ac-923d-debbd9d13b01 tempest-VolumesActionsTest-1451724932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:57:02 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-a6b7830a-e2aa-46ac-923d-debbd9d13b01 tempest-VolumesActionsTest-1451724932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:57:02 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-a6b7830a-e2aa-46ac-923d-debbd9d13b01 tempest-VolumesActionsTest-1451724932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:57:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a6b7830a-e2aa-46ac-923d-debbd9d13b01 tempest-VolumesActionsTest-1451724932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:57:02 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-a6b7830a-e2aa-46ac-923d-debbd9d13b01 tempest-VolumesActionsTest-1451724932 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:57:02 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-a6b7830a-e2aa-46ac-923d-debbd9d13b01 tempest-VolumesActionsTest-1451724932 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 16:57:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a6b7830a-e2aa-46ac-923d-debbd9d13b01 tempest-VolumesActionsTest-1451724932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-cce00bad-6637-419c-a26a-c5e19ebc1341 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:02 devstack sudo[98057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-cce00bad-6637-419c-a26a-c5e19ebc1341 1073741824 Jul 30 16:57:02 devstack sudo[98057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:03 devstack sudo[98057]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a6b7830a-e2aa-46ac-923d-debbd9d13b01 tempest-VolumesActionsTest-1451724932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-cce00bad-6637-419c-a26a-c5e19ebc1341 1073741824" returned: 0 in 0.936s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a6b7830a-e2aa-46ac-923d-debbd9d13b01 tempest-VolumesActionsTest-1451724932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-cce00bad-6637-419c-a26a-c5e19ebc1341 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:03 devstack sudo[98086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-cce00bad-6637-419c-a26a-c5e19ebc1341 Jul 30 16:57:03 devstack sudo[98086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:03 devstack sudo[98086]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a6b7830a-e2aa-46ac-923d-debbd9d13b01 tempest-VolumesActionsTest-1451724932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-cce00bad-6637-419c-a26a-c5e19ebc1341" returned: 0 in 0.386s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:03 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-a6b7830a-e2aa-46ac-923d-debbd9d13b01 tempest-VolumesActionsTest-1451724932 None] <== create_volume: return (1388ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:57:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a6b7830a-e2aa-46ac-923d-debbd9d13b01 tempest-VolumesActionsTest-1451724932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.392s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:57:03 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a6b7830a-e2aa-46ac-923d-debbd9d13b01 tempest-VolumesActionsTest-1451724932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89633548-f31a-44cf-99fc-46fc65f182ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cce00bad-6637-419c-a26a-c5e19ebc1341', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:03 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a6b7830a-e2aa-46ac-923d-debbd9d13b01 tempest-VolumesActionsTest-1451724932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (113060cc-c722-4a84-9b96-73a27a993f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:03 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-a6b7830a-e2aa-46ac-923d-debbd9d13b01 tempest-VolumesActionsTest-1451724932 None] Volume volume-cce00bad-6637-419c-a26a-c5e19ebc1341 (cce00bad-6637-419c-a26a-c5e19ebc1341): created successfully Jul 30 16:57:03 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a6b7830a-e2aa-46ac-923d-debbd9d13b01 tempest-VolumesActionsTest-1451724932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (113060cc-c722-4a84-9b96-73a27a993f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:03 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a6b7830a-e2aa-46ac-923d-debbd9d13b01 tempest-VolumesActionsTest-1451724932 None] Flow 'volume_create_manager' (76a844bc-6d21-41a3-9818-3cd586997af6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:57:03 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-a6b7830a-e2aa-46ac-923d-debbd9d13b01 tempest-VolumesActionsTest-1451724932 None] Created volume successfully. Jul 30 16:57:04 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-9942cbd1-1d9e-40dc-86ee-a61f5b49a5a3 tempest-VolumesActionsTest-373005339 None] Acquiring lock "cinder-cce00bad-6637-419c-a26a-c5e19ebc1341-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:57:04 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-9942cbd1-1d9e-40dc-86ee-a61f5b49a5a3 tempest-VolumesActionsTest-373005339 None] Lock "cinder-cce00bad-6637-419c-a26a-c5e19ebc1341-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:57:04 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-9942cbd1-1d9e-40dc-86ee-a61f5b49a5a3 tempest-VolumesActionsTest-373005339 None] Acquiring lock "cinder-quobyte-cce00bad-6637-419c-a26a-c5e19ebc1341" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:57:04 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-9942cbd1-1d9e-40dc-86ee-a61f5b49a5a3 tempest-VolumesActionsTest-373005339 None] Lock "cinder-quobyte-cce00bad-6637-419c-a26a-c5e19ebc1341" acquired by "delete_volume" :: waited 0.015s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:57:04 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[355f35c5-e544-4647-bfe9-cf76376aeeeb]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:57:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9942cbd1-1d9e-40dc-86ee-a61f5b49a5a3 tempest-VolumesActionsTest-373005339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-cce00bad-6637-419c-a26a-c5e19ebc1341 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:04 devstack sudo[98094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-cce00bad-6637-419c-a26a-c5e19ebc1341 Jul 30 16:57:04 devstack sudo[98094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:05 devstack sudo[98094]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:05 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9942cbd1-1d9e-40dc-86ee-a61f5b49a5a3 tempest-VolumesActionsTest-373005339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-cce00bad-6637-419c-a26a-c5e19ebc1341" returned: 0 in 0.481s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:05 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9942cbd1-1d9e-40dc-86ee-a61f5b49a5a3 tempest-VolumesActionsTest-373005339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-cce00bad-6637-419c-a26a-c5e19ebc1341 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:05 devstack sudo[98099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-cce00bad-6637-419c-a26a-c5e19ebc1341 Jul 30 16:57:05 devstack sudo[98099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:05 devstack sudo[98099]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:05 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9942cbd1-1d9e-40dc-86ee-a61f5b49a5a3 tempest-VolumesActionsTest-373005339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-cce00bad-6637-419c-a26a-c5e19ebc1341" returned: 0 in 0.296s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:05 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-9942cbd1-1d9e-40dc-86ee-a61f5b49a5a3 tempest-VolumesActionsTest-373005339 None] Lock "cinder-quobyte-cce00bad-6637-419c-a26a-c5e19ebc1341" released by "delete_volume" :: held 0.837s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:57:05 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-9942cbd1-1d9e-40dc-86ee-a61f5b49a5a3 tempest-VolumesActionsTest-373005339 None] Created reservations ['52205972-4d73-49e8-8a71-c543711afc48', '33d7c004-29e3-4877-bd4b-783091791b0f', 'b5b5a0d2-2698-4bf0-be26-1440ef847486', '240415e8-f688-4188-a608-049c9f7663f3'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:57:05 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-9942cbd1-1d9e-40dc-86ee-a61f5b49a5a3 tempest-VolumesActionsTest-373005339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:57:05 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-9942cbd1-1d9e-40dc-86ee-a61f5b49a5a3 tempest-VolumesActionsTest-373005339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:57:05 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-9942cbd1-1d9e-40dc-86ee-a61f5b49a5a3 tempest-VolumesActionsTest-373005339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:57:05 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-9942cbd1-1d9e-40dc-86ee-a61f5b49a5a3 tempest-VolumesActionsTest-373005339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:57:05 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-9942cbd1-1d9e-40dc-86ee-a61f5b49a5a3 tempest-VolumesActionsTest-373005339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:57:05 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9942cbd1-1d9e-40dc-86ee-a61f5b49a5a3 tempest-VolumesActionsTest-373005339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:05 devstack sudo[98102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:57:05 devstack sudo[98102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:06 devstack sudo[98102]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9942cbd1-1d9e-40dc-86ee-a61f5b49a5a3 tempest-VolumesActionsTest-373005339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.349s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:06 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-9942cbd1-1d9e-40dc-86ee-a61f5b49a5a3 tempest-VolumesActionsTest-373005339 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:57:06 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-9942cbd1-1d9e-40dc-86ee-a61f5b49a5a3 tempest-VolumesActionsTest-373005339 None] Deleted volume successfully. Jul 30 16:57:06 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-9942cbd1-1d9e-40dc-86ee-a61f5b49a5a3 tempest-VolumesActionsTest-373005339 None] Lock "cinder-cce00bad-6637-419c-a26a-c5e19ebc1341-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:57:06 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e84cf2d-7765-4e1e-917b-57d3215596e0 tempest-VolumesActionsTest-1451724932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:57:06 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4e84cf2d-7765-4e1e-917b-57d3215596e0 tempest-VolumesActionsTest-1451724932 None] Flow 'volume_create_manager' (8c177808-2cca-4db1-8700-ca0cc473a6be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:57:06 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4e84cf2d-7765-4e1e-917b-57d3215596e0 tempest-VolumesActionsTest-1451724932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76860ed4-2949-4e1d-b1e2-c5e749eb66ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:06 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4e84cf2d-7765-4e1e-917b-57d3215596e0 tempest-VolumesActionsTest-1451724932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76860ed4-2949-4e1d-b1e2-c5e749eb66ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:57:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-982992876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9aa032a9-7203-4779-bbfd-9330d85587fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d4cdc44a4d34072822865ed569a0be7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:57:07Z,use_quota=True,user_id='1cde7b4767cf4521bd2e65a15a371b3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:06 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4e84cf2d-7765-4e1e-917b-57d3215596e0 tempest-VolumesActionsTest-1451724932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (046150cc-b4e3-4085-b978-02946100848d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:06 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4e84cf2d-7765-4e1e-917b-57d3215596e0 tempest-VolumesActionsTest-1451724932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (046150cc-b4e3-4085-b978-02946100848d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:06 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4e84cf2d-7765-4e1e-917b-57d3215596e0 tempest-VolumesActionsTest-1451724932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (676b900a-4b83-4e40-a8a7-5f68685dd70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:06 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4e84cf2d-7765-4e1e-917b-57d3215596e0 tempest-VolumesActionsTest-1451724932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (676b900a-4b83-4e40-a8a7-5f68685dd70b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9aa032a9-7203-4779-bbfd-9330d85587fc', 'volume_name': 'volume-9aa032a9-7203-4779-bbfd-9330d85587fc', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:06 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4e84cf2d-7765-4e1e-917b-57d3215596e0 tempest-VolumesActionsTest-1451724932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90720764-218b-4f2f-91d9-0341672d8d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:06 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4e84cf2d-7765-4e1e-917b-57d3215596e0 tempest-VolumesActionsTest-1451724932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90720764-218b-4f2f-91d9-0341672d8d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:06 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4e84cf2d-7765-4e1e-917b-57d3215596e0 tempest-VolumesActionsTest-1451724932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04068eee-3061-4409-ba39-45395b0010af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:06 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-4e84cf2d-7765-4e1e-917b-57d3215596e0 tempest-VolumesActionsTest-1451724932 None] Volume 9aa032a9-7203-4779-bbfd-9330d85587fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9aa032a9-7203-4779-bbfd-9330d85587fc', 'volume_size': 1} Jul 30 16:57:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-4e84cf2d-7765-4e1e-917b-57d3215596e0 tempest-VolumesActionsTest-1451724932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:57:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-4e84cf2d-7765-4e1e-917b-57d3215596e0 tempest-VolumesActionsTest-1451724932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:57:06 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-4e84cf2d-7765-4e1e-917b-57d3215596e0 tempest-VolumesActionsTest-1451724932 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:57:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-982992876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9aa032a9-7203-4779-bbfd-9330d85587fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d4cdc44a4d34072822865ed569a0be7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:57:07Z,use_quota=True,user_id='1cde7b4767cf4521bd2e65a15a371b3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:57:06 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-4e84cf2d-7765-4e1e-917b-57d3215596e0 tempest-VolumesActionsTest-1451724932 None] Creating volume 9aa032a9-7203-4779-bbfd-9330d85587fc {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:57:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-4e84cf2d-7765-4e1e-917b-57d3215596e0 tempest-VolumesActionsTest-1451724932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:57:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-4e84cf2d-7765-4e1e-917b-57d3215596e0 tempest-VolumesActionsTest-1451724932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:57:06 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-4e84cf2d-7765-4e1e-917b-57d3215596e0 tempest-VolumesActionsTest-1451724932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:57:06 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-4e84cf2d-7765-4e1e-917b-57d3215596e0 tempest-VolumesActionsTest-1451724932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:57:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-4e84cf2d-7765-4e1e-917b-57d3215596e0 tempest-VolumesActionsTest-1451724932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:57:06 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-4e84cf2d-7765-4e1e-917b-57d3215596e0 tempest-VolumesActionsTest-1451724932 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:57:06 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-4e84cf2d-7765-4e1e-917b-57d3215596e0 tempest-VolumesActionsTest-1451724932 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 16:57:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-4e84cf2d-7765-4e1e-917b-57d3215596e0 tempest-VolumesActionsTest-1451724932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9aa032a9-7203-4779-bbfd-9330d85587fc 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:06 devstack sudo[98105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9aa032a9-7203-4779-bbfd-9330d85587fc 1073741824 Jul 30 16:57:06 devstack sudo[98105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:07 devstack sudo[98105]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:07 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-4e84cf2d-7765-4e1e-917b-57d3215596e0 tempest-VolumesActionsTest-1451724932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9aa032a9-7203-4779-bbfd-9330d85587fc 1073741824" returned: 0 in 0.597s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:07 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-4e84cf2d-7765-4e1e-917b-57d3215596e0 tempest-VolumesActionsTest-1451724932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9aa032a9-7203-4779-bbfd-9330d85587fc {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:07 devstack sudo[98111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9aa032a9-7203-4779-bbfd-9330d85587fc Jul 30 16:57:07 devstack sudo[98111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:07 devstack sudo[98111]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:07 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-4e84cf2d-7765-4e1e-917b-57d3215596e0 tempest-VolumesActionsTest-1451724932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9aa032a9-7203-4779-bbfd-9330d85587fc" returned: 0 in 0.340s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:07 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-4e84cf2d-7765-4e1e-917b-57d3215596e0 tempest-VolumesActionsTest-1451724932 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:57:07 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-4e84cf2d-7765-4e1e-917b-57d3215596e0 tempest-VolumesActionsTest-1451724932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:57:07 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4e84cf2d-7765-4e1e-917b-57d3215596e0 tempest-VolumesActionsTest-1451724932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04068eee-3061-4409-ba39-45395b0010af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9aa032a9-7203-4779-bbfd-9330d85587fc', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:07 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4e84cf2d-7765-4e1e-917b-57d3215596e0 tempest-VolumesActionsTest-1451724932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01b15ff8-63f6-4dbd-8800-a6a3335ee16d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:07 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-4e84cf2d-7765-4e1e-917b-57d3215596e0 tempest-VolumesActionsTest-1451724932 None] Volume volume-9aa032a9-7203-4779-bbfd-9330d85587fc (9aa032a9-7203-4779-bbfd-9330d85587fc): created successfully Jul 30 16:57:07 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4e84cf2d-7765-4e1e-917b-57d3215596e0 tempest-VolumesActionsTest-1451724932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01b15ff8-63f6-4dbd-8800-a6a3335ee16d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:07 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4e84cf2d-7765-4e1e-917b-57d3215596e0 tempest-VolumesActionsTest-1451724932 None] Flow 'volume_create_manager' (8c177808-2cca-4db1-8700-ca0cc473a6be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:57:07 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-4e84cf2d-7765-4e1e-917b-57d3215596e0 tempest-VolumesActionsTest-1451724932 None] Created volume successfully. Jul 30 16:57:09 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-37fdec87-0332-49fb-85e2-fa7072a7dbf5 tempest-VolumesActionsTest-1451724932 None] Acquiring lock "cinder-9aa032a9-7203-4779-bbfd-9330d85587fc-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:57:09 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-37fdec87-0332-49fb-85e2-fa7072a7dbf5 tempest-VolumesActionsTest-1451724932 None] Lock "cinder-9aa032a9-7203-4779-bbfd-9330d85587fc-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:57:09 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-37fdec87-0332-49fb-85e2-fa7072a7dbf5 tempest-VolumesActionsTest-1451724932 None] Acquiring lock "cinder-quobyte-9aa032a9-7203-4779-bbfd-9330d85587fc" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:57:09 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-37fdec87-0332-49fb-85e2-fa7072a7dbf5 tempest-VolumesActionsTest-1451724932 None] Lock "cinder-quobyte-9aa032a9-7203-4779-bbfd-9330d85587fc" acquired by "delete_volume" :: waited 0.018s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:57:09 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[e41162f1-d32d-4273-8803-4c2a21988894]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:57:09 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-37fdec87-0332-49fb-85e2-fa7072a7dbf5 tempest-VolumesActionsTest-1451724932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9aa032a9-7203-4779-bbfd-9330d85587fc {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:09 devstack sudo[98114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9aa032a9-7203-4779-bbfd-9330d85587fc Jul 30 16:57:09 devstack sudo[98114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:10 devstack sudo[98114]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:10 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-37fdec87-0332-49fb-85e2-fa7072a7dbf5 tempest-VolumesActionsTest-1451724932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9aa032a9-7203-4779-bbfd-9330d85587fc" returned: 0 in 0.476s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:10 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-37fdec87-0332-49fb-85e2-fa7072a7dbf5 tempest-VolumesActionsTest-1451724932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9aa032a9-7203-4779-bbfd-9330d85587fc {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:10 devstack sudo[98121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9aa032a9-7203-4779-bbfd-9330d85587fc Jul 30 16:57:10 devstack sudo[98121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:10 devstack sudo[98121]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:10 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-37fdec87-0332-49fb-85e2-fa7072a7dbf5 tempest-VolumesActionsTest-1451724932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9aa032a9-7203-4779-bbfd-9330d85587fc" returned: 0 in 0.299s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:10 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-37fdec87-0332-49fb-85e2-fa7072a7dbf5 tempest-VolumesActionsTest-1451724932 None] Lock "cinder-quobyte-9aa032a9-7203-4779-bbfd-9330d85587fc" released by "delete_volume" :: held 0.833s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:57:10 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-37fdec87-0332-49fb-85e2-fa7072a7dbf5 tempest-VolumesActionsTest-1451724932 None] Created reservations ['3e97d264-2c52-496f-99ae-84913efb55da', '12b66e1a-3f21-453c-addb-e16623c7adc6', '9210cf75-7aab-449c-b131-829099b83251', '571fb572-2511-4ec4-a13b-af9d2d0ef688'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:57:10 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-37fdec87-0332-49fb-85e2-fa7072a7dbf5 tempest-VolumesActionsTest-1451724932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:57:10 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-37fdec87-0332-49fb-85e2-fa7072a7dbf5 tempest-VolumesActionsTest-1451724932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:57:10 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-37fdec87-0332-49fb-85e2-fa7072a7dbf5 tempest-VolumesActionsTest-1451724932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:57:10 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-37fdec87-0332-49fb-85e2-fa7072a7dbf5 tempest-VolumesActionsTest-1451724932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:57:10 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-37fdec87-0332-49fb-85e2-fa7072a7dbf5 tempest-VolumesActionsTest-1451724932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:57:10 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-37fdec87-0332-49fb-85e2-fa7072a7dbf5 tempest-VolumesActionsTest-1451724932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:10 devstack sudo[98124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:57:10 devstack sudo[98124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:10 devstack sudo[98124]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:10 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-37fdec87-0332-49fb-85e2-fa7072a7dbf5 tempest-VolumesActionsTest-1451724932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.322s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:10 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-37fdec87-0332-49fb-85e2-fa7072a7dbf5 tempest-VolumesActionsTest-1451724932 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:57:10 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-37fdec87-0332-49fb-85e2-fa7072a7dbf5 tempest-VolumesActionsTest-1451724932 None] Deleted volume successfully. Jul 30 16:57:10 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-37fdec87-0332-49fb-85e2-fa7072a7dbf5 tempest-VolumesActionsTest-1451724932 None] Lock "cinder-9aa032a9-7203-4779-bbfd-9330d85587fc-delete_volume" released by "delete_volume" :: held 1.446s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:57:11 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-3167f943-e7b9-4618-ba12-7c1bfaaa3deb tempest-VolumesNegativeTest-1747898349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:57:11 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-3167f943-e7b9-4618-ba12-7c1bfaaa3deb tempest-VolumesNegativeTest-1747898349 None] Flow 'volume_create_manager' (0620112a-0022-4ac5-85e6-7cc36ecc9c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:57:11 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-3167f943-e7b9-4618-ba12-7c1bfaaa3deb tempest-VolumesNegativeTest-1747898349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75a29e0e-fd1e-4005-a711-bc49578ff654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:11 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-3167f943-e7b9-4618-ba12-7c1bfaaa3deb tempest-VolumesNegativeTest-1747898349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75a29e0e-fd1e-4005-a711-bc49578ff654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:57:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1139401684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78ad9ec4-5502-430a-bd9b-0d8cac6f502f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a79a494e2d24916b9a4415131939354',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:57:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:57:12Z,use_quota=True,user_id='735b6697bf7048e68256547adb284bb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:11 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-3167f943-e7b9-4618-ba12-7c1bfaaa3deb tempest-VolumesNegativeTest-1747898349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8a5d591-4b56-4dc2-9040-7f6e9f6c6bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:11 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-3167f943-e7b9-4618-ba12-7c1bfaaa3deb tempest-VolumesNegativeTest-1747898349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8a5d591-4b56-4dc2-9040-7f6e9f6c6bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:11 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-3167f943-e7b9-4618-ba12-7c1bfaaa3deb tempest-VolumesNegativeTest-1747898349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (749563d3-c10a-411b-ab5e-a6bf0eb61f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:11 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-3167f943-e7b9-4618-ba12-7c1bfaaa3deb tempest-VolumesNegativeTest-1747898349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (749563d3-c10a-411b-ab5e-a6bf0eb61f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78ad9ec4-5502-430a-bd9b-0d8cac6f502f', 'volume_name': 'volume-78ad9ec4-5502-430a-bd9b-0d8cac6f502f', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:11 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-3167f943-e7b9-4618-ba12-7c1bfaaa3deb tempest-VolumesNegativeTest-1747898349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c8c21e0-2863-4709-a55c-38243009493c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:11 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-3167f943-e7b9-4618-ba12-7c1bfaaa3deb tempest-VolumesNegativeTest-1747898349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c8c21e0-2863-4709-a55c-38243009493c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:12 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-3167f943-e7b9-4618-ba12-7c1bfaaa3deb tempest-VolumesNegativeTest-1747898349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (799c7127-1c91-4d8c-88c8-e0b73b3ed1e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:12 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-3167f943-e7b9-4618-ba12-7c1bfaaa3deb tempest-VolumesNegativeTest-1747898349 None] Volume 78ad9ec4-5502-430a-bd9b-0d8cac6f502f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78ad9ec4-5502-430a-bd9b-0d8cac6f502f', 'volume_size': 1} Jul 30 16:57:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-3167f943-e7b9-4618-ba12-7c1bfaaa3deb tempest-VolumesNegativeTest-1747898349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:57:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-3167f943-e7b9-4618-ba12-7c1bfaaa3deb tempest-VolumesNegativeTest-1747898349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:57:12 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-3167f943-e7b9-4618-ba12-7c1bfaaa3deb tempest-VolumesNegativeTest-1747898349 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:57:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1139401684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78ad9ec4-5502-430a-bd9b-0d8cac6f502f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a79a494e2d24916b9a4415131939354',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:57:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:57:12Z,use_quota=True,user_id='735b6697bf7048e68256547adb284bb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:57:12 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-3167f943-e7b9-4618-ba12-7c1bfaaa3deb tempest-VolumesNegativeTest-1747898349 None] Creating volume 78ad9ec4-5502-430a-bd9b-0d8cac6f502f {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:57:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-3167f943-e7b9-4618-ba12-7c1bfaaa3deb tempest-VolumesNegativeTest-1747898349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:57:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-3167f943-e7b9-4618-ba12-7c1bfaaa3deb tempest-VolumesNegativeTest-1747898349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:57:12 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-3167f943-e7b9-4618-ba12-7c1bfaaa3deb tempest-VolumesNegativeTest-1747898349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:57:12 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-3167f943-e7b9-4618-ba12-7c1bfaaa3deb tempest-VolumesNegativeTest-1747898349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:57:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-3167f943-e7b9-4618-ba12-7c1bfaaa3deb tempest-VolumesNegativeTest-1747898349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:57:12 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-3167f943-e7b9-4618-ba12-7c1bfaaa3deb tempest-VolumesNegativeTest-1747898349 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:57:12 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-3167f943-e7b9-4618-ba12-7c1bfaaa3deb tempest-VolumesNegativeTest-1747898349 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 16:57:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-3167f943-e7b9-4618-ba12-7c1bfaaa3deb tempest-VolumesNegativeTest-1747898349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-78ad9ec4-5502-430a-bd9b-0d8cac6f502f 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:12 devstack sudo[98132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-78ad9ec4-5502-430a-bd9b-0d8cac6f502f 1073741824 Jul 30 16:57:12 devstack sudo[98132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:12 devstack sudo[98132]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-3167f943-e7b9-4618-ba12-7c1bfaaa3deb tempest-VolumesNegativeTest-1747898349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-78ad9ec4-5502-430a-bd9b-0d8cac6f502f 1073741824" returned: 0 in 0.696s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-3167f943-e7b9-4618-ba12-7c1bfaaa3deb tempest-VolumesNegativeTest-1747898349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-78ad9ec4-5502-430a-bd9b-0d8cac6f502f {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:12 devstack sudo[98141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-78ad9ec4-5502-430a-bd9b-0d8cac6f502f Jul 30 16:57:12 devstack sudo[98141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:13 devstack sudo[98141]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-3167f943-e7b9-4618-ba12-7c1bfaaa3deb tempest-VolumesNegativeTest-1747898349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-78ad9ec4-5502-430a-bd9b-0d8cac6f502f" returned: 0 in 0.387s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:13 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-3167f943-e7b9-4618-ba12-7c1bfaaa3deb tempest-VolumesNegativeTest-1747898349 None] <== create_volume: return (1166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:57:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-3167f943-e7b9-4618-ba12-7c1bfaaa3deb tempest-VolumesNegativeTest-1747898349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.172s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:57:13 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-3167f943-e7b9-4618-ba12-7c1bfaaa3deb tempest-VolumesNegativeTest-1747898349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (799c7127-1c91-4d8c-88c8-e0b73b3ed1e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78ad9ec4-5502-430a-bd9b-0d8cac6f502f', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:13 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-3167f943-e7b9-4618-ba12-7c1bfaaa3deb tempest-VolumesNegativeTest-1747898349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56c9216b-3ae2-40c8-a176-f56f4de9ca70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:13 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-3167f943-e7b9-4618-ba12-7c1bfaaa3deb tempest-VolumesNegativeTest-1747898349 None] Volume volume-78ad9ec4-5502-430a-bd9b-0d8cac6f502f (78ad9ec4-5502-430a-bd9b-0d8cac6f502f): created successfully Jul 30 16:57:13 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-3167f943-e7b9-4618-ba12-7c1bfaaa3deb tempest-VolumesNegativeTest-1747898349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56c9216b-3ae2-40c8-a176-f56f4de9ca70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:13 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-3167f943-e7b9-4618-ba12-7c1bfaaa3deb tempest-VolumesNegativeTest-1747898349 None] Flow 'volume_create_manager' (0620112a-0022-4ac5-85e6-7cc36ecc9c1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:57:13 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-3167f943-e7b9-4618-ba12-7c1bfaaa3deb tempest-VolumesNegativeTest-1747898349 None] Created volume successfully. Jul 30 16:57:13 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8a4b8b7-e55c-4581-a843-1c77cc07e5e6 tempest-VolumesTransfersTest-1797082131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:57:13 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b8a4b8b7-e55c-4581-a843-1c77cc07e5e6 tempest-VolumesTransfersTest-1797082131 None] Flow 'volume_create_manager' (4675516a-d95f-4ba9-94e6-c94366679318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:57:13 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b8a4b8b7-e55c-4581-a843-1c77cc07e5e6 tempest-VolumesTransfersTest-1797082131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02030a8b-78db-43e7-8a50-934d8f9f12a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:13 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b8a4b8b7-e55c-4581-a843-1c77cc07e5e6 tempest-VolumesTransfersTest-1797082131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02030a8b-78db-43e7-8a50-934d8f9f12a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:57:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1157520416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56c6094c-12ea-472f-9aa3-851f66738b8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60b9ae1132174fd98a13e4c128b8ba02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:57:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:57:13Z,use_quota=True,user_id='efc8fbc185da471289d9cdb6359772fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:13 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b8a4b8b7-e55c-4581-a843-1c77cc07e5e6 tempest-VolumesTransfersTest-1797082131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3f2c3f2-213f-4205-a35c-b31285a3590d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:13 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b8a4b8b7-e55c-4581-a843-1c77cc07e5e6 tempest-VolumesTransfersTest-1797082131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3f2c3f2-213f-4205-a35c-b31285a3590d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:13 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b8a4b8b7-e55c-4581-a843-1c77cc07e5e6 tempest-VolumesTransfersTest-1797082131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11ec6453-7599-4afa-8976-65670cd63309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:13 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b8a4b8b7-e55c-4581-a843-1c77cc07e5e6 tempest-VolumesTransfersTest-1797082131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11ec6453-7599-4afa-8976-65670cd63309) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56c6094c-12ea-472f-9aa3-851f66738b8c', 'volume_name': 'volume-56c6094c-12ea-472f-9aa3-851f66738b8c', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:13 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b8a4b8b7-e55c-4581-a843-1c77cc07e5e6 tempest-VolumesTransfersTest-1797082131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd18d8f5-f6eb-45cb-9994-13e796543825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:13 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b8a4b8b7-e55c-4581-a843-1c77cc07e5e6 tempest-VolumesTransfersTest-1797082131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd18d8f5-f6eb-45cb-9994-13e796543825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:13 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b8a4b8b7-e55c-4581-a843-1c77cc07e5e6 tempest-VolumesTransfersTest-1797082131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc83a485-4019-4e62-bf31-3debf435d7bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:13 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-b8a4b8b7-e55c-4581-a843-1c77cc07e5e6 tempest-VolumesTransfersTest-1797082131 None] Volume 56c6094c-12ea-472f-9aa3-851f66738b8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56c6094c-12ea-472f-9aa3-851f66738b8c', 'volume_size': 1} Jul 30 16:57:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-b8a4b8b7-e55c-4581-a843-1c77cc07e5e6 tempest-VolumesTransfersTest-1797082131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:57:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-b8a4b8b7-e55c-4581-a843-1c77cc07e5e6 tempest-VolumesTransfersTest-1797082131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:57:13 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-b8a4b8b7-e55c-4581-a843-1c77cc07e5e6 tempest-VolumesTransfersTest-1797082131 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:57:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1157520416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56c6094c-12ea-472f-9aa3-851f66738b8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60b9ae1132174fd98a13e4c128b8ba02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:57:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:57:13Z,use_quota=True,user_id='efc8fbc185da471289d9cdb6359772fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:57:13 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-b8a4b8b7-e55c-4581-a843-1c77cc07e5e6 tempest-VolumesTransfersTest-1797082131 None] Creating volume 56c6094c-12ea-472f-9aa3-851f66738b8c {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:57:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-b8a4b8b7-e55c-4581-a843-1c77cc07e5e6 tempest-VolumesTransfersTest-1797082131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:57:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-b8a4b8b7-e55c-4581-a843-1c77cc07e5e6 tempest-VolumesTransfersTest-1797082131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:57:13 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-b8a4b8b7-e55c-4581-a843-1c77cc07e5e6 tempest-VolumesTransfersTest-1797082131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:57:13 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-b8a4b8b7-e55c-4581-a843-1c77cc07e5e6 tempest-VolumesTransfersTest-1797082131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:57:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-b8a4b8b7-e55c-4581-a843-1c77cc07e5e6 tempest-VolumesTransfersTest-1797082131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:57:13 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-b8a4b8b7-e55c-4581-a843-1c77cc07e5e6 tempest-VolumesTransfersTest-1797082131 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:57:13 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-b8a4b8b7-e55c-4581-a843-1c77cc07e5e6 tempest-VolumesTransfersTest-1797082131 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 16:57:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-b8a4b8b7-e55c-4581-a843-1c77cc07e5e6 tempest-VolumesTransfersTest-1797082131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-56c6094c-12ea-472f-9aa3-851f66738b8c 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:13 devstack sudo[98145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-56c6094c-12ea-472f-9aa3-851f66738b8c 1073741824 Jul 30 16:57:13 devstack sudo[98145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:14 devstack sudo[98145]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-b8a4b8b7-e55c-4581-a843-1c77cc07e5e6 tempest-VolumesTransfersTest-1797082131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-56c6094c-12ea-472f-9aa3-851f66738b8c 1073741824" returned: 0 in 0.645s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-b8a4b8b7-e55c-4581-a843-1c77cc07e5e6 tempest-VolumesTransfersTest-1797082131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-56c6094c-12ea-472f-9aa3-851f66738b8c {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:14 devstack sudo[98164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-56c6094c-12ea-472f-9aa3-851f66738b8c Jul 30 16:57:14 devstack sudo[98164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:14 devstack sudo[98164]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-b8a4b8b7-e55c-4581-a843-1c77cc07e5e6 tempest-VolumesTransfersTest-1797082131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-56c6094c-12ea-472f-9aa3-851f66738b8c" returned: 0 in 0.376s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:14 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-b8a4b8b7-e55c-4581-a843-1c77cc07e5e6 tempest-VolumesTransfersTest-1797082131 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:57:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-b8a4b8b7-e55c-4581-a843-1c77cc07e5e6 tempest-VolumesTransfersTest-1797082131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:57:14 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b8a4b8b7-e55c-4581-a843-1c77cc07e5e6 tempest-VolumesTransfersTest-1797082131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc83a485-4019-4e62-bf31-3debf435d7bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56c6094c-12ea-472f-9aa3-851f66738b8c', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:14 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b8a4b8b7-e55c-4581-a843-1c77cc07e5e6 tempest-VolumesTransfersTest-1797082131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d8ab2a2-859a-4ae9-b3bb-26b38bd85ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:14 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-b8a4b8b7-e55c-4581-a843-1c77cc07e5e6 tempest-VolumesTransfersTest-1797082131 None] Volume volume-56c6094c-12ea-472f-9aa3-851f66738b8c (56c6094c-12ea-472f-9aa3-851f66738b8c): created successfully Jul 30 16:57:14 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b8a4b8b7-e55c-4581-a843-1c77cc07e5e6 tempest-VolumesTransfersTest-1797082131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d8ab2a2-859a-4ae9-b3bb-26b38bd85ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:14 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b8a4b8b7-e55c-4581-a843-1c77cc07e5e6 tempest-VolumesTransfersTest-1797082131 None] Flow 'volume_create_manager' (4675516a-d95f-4ba9-94e6-c94366679318) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:57:14 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-b8a4b8b7-e55c-4581-a843-1c77cc07e5e6 tempest-VolumesTransfersTest-1797082131 None] Created volume successfully. Jul 30 16:57:16 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-4b860e1a-fa93-4c27-a47c-3698b576c345 tempest-VolumesTransfersTest-2041880588 None] Transfer volume completed successfully. Jul 30 16:57:17 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-be5cb9c6-736a-48d3-92f8-f977a03ffb39 tempest-VolumesTransfersTest-2114185166 None] Acquiring lock "cinder-56c6094c-12ea-472f-9aa3-851f66738b8c-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:57:17 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-be5cb9c6-736a-48d3-92f8-f977a03ffb39 tempest-VolumesTransfersTest-2114185166 None] Lock "cinder-56c6094c-12ea-472f-9aa3-851f66738b8c-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:57:17 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-be5cb9c6-736a-48d3-92f8-f977a03ffb39 tempest-VolumesTransfersTest-2114185166 None] Acquiring lock "cinder-quobyte-56c6094c-12ea-472f-9aa3-851f66738b8c" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:57:17 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-be5cb9c6-736a-48d3-92f8-f977a03ffb39 tempest-VolumesTransfersTest-2114185166 None] Lock "cinder-quobyte-56c6094c-12ea-472f-9aa3-851f66738b8c" acquired by "delete_volume" :: waited 0.057s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:57:17 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d83b85b-1a74-4cae-9677-16e4ac504948]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:57:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-be5cb9c6-736a-48d3-92f8-f977a03ffb39 tempest-VolumesTransfersTest-2114185166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-56c6094c-12ea-472f-9aa3-851f66738b8c {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:17 devstack sudo[98210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-56c6094c-12ea-472f-9aa3-851f66738b8c Jul 30 16:57:17 devstack sudo[98210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:18 devstack sudo[98210]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-be5cb9c6-736a-48d3-92f8-f977a03ffb39 tempest-VolumesTransfersTest-2114185166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-56c6094c-12ea-472f-9aa3-851f66738b8c" returned: 0 in 0.818s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-be5cb9c6-736a-48d3-92f8-f977a03ffb39 tempest-VolumesTransfersTest-2114185166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-56c6094c-12ea-472f-9aa3-851f66738b8c {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:18 devstack sudo[98242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-56c6094c-12ea-472f-9aa3-851f66738b8c Jul 30 16:57:18 devstack sudo[98242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:18 devstack sudo[98242]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-be5cb9c6-736a-48d3-92f8-f977a03ffb39 tempest-VolumesTransfersTest-2114185166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-56c6094c-12ea-472f-9aa3-851f66738b8c" returned: 0 in 0.473s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:18 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-be5cb9c6-736a-48d3-92f8-f977a03ffb39 tempest-VolumesTransfersTest-2114185166 None] Lock "cinder-quobyte-56c6094c-12ea-472f-9aa3-851f66738b8c" released by "delete_volume" :: held 1.377s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:57:18 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-be5cb9c6-736a-48d3-92f8-f977a03ffb39 tempest-VolumesTransfersTest-2114185166 None] Created reservations ['1001e2d4-0f45-4f17-8d3a-87b212a1761a', '9831c293-4c75-4c38-9eaa-bcd8c69d1914', 'd67961c7-3d98-4a2e-b643-cc8cf8e1c0d4', '9c851de4-3e82-4e19-bf4e-7638a627fdca'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:57:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-be5cb9c6-736a-48d3-92f8-f977a03ffb39 tempest-VolumesTransfersTest-2114185166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:57:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-be5cb9c6-736a-48d3-92f8-f977a03ffb39 tempest-VolumesTransfersTest-2114185166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:57:18 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-be5cb9c6-736a-48d3-92f8-f977a03ffb39 tempest-VolumesTransfersTest-2114185166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:57:19 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-be5cb9c6-736a-48d3-92f8-f977a03ffb39 tempest-VolumesTransfersTest-2114185166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:57:19 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-be5cb9c6-736a-48d3-92f8-f977a03ffb39 tempest-VolumesTransfersTest-2114185166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:57:19 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-be5cb9c6-736a-48d3-92f8-f977a03ffb39 tempest-VolumesTransfersTest-2114185166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:19 devstack sudo[98266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:57:19 devstack sudo[98266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:19 devstack sudo[98266]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:19 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-be5cb9c6-736a-48d3-92f8-f977a03ffb39 tempest-VolumesTransfersTest-2114185166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.419s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:19 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-be5cb9c6-736a-48d3-92f8-f977a03ffb39 tempest-VolumesTransfersTest-2114185166 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:57:19 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-be5cb9c6-736a-48d3-92f8-f977a03ffb39 tempest-VolumesTransfersTest-2114185166 None] Deleted volume successfully. Jul 30 16:57:19 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-be5cb9c6-736a-48d3-92f8-f977a03ffb39 tempest-VolumesTransfersTest-2114185166 None] Lock "cinder-56c6094c-12ea-472f-9aa3-851f66738b8c-delete_volume" released by "delete_volume" :: held 2.388s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:57:20 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-20e6f3be-395d-4ea0-9e54-fea1bcf11321 tempest-VolumesTransfersTest-1797082131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:57:20 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-20e6f3be-395d-4ea0-9e54-fea1bcf11321 tempest-VolumesTransfersTest-1797082131 None] Flow 'volume_create_manager' (f3454cb7-06f4-4660-bbc2-dde9c0cf9924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:57:20 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-20e6f3be-395d-4ea0-9e54-fea1bcf11321 tempest-VolumesTransfersTest-1797082131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec6bfb9d-8181-4ef5-ac3f-a3c18b17e1bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:20 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-20e6f3be-395d-4ea0-9e54-fea1bcf11321 tempest-VolumesTransfersTest-1797082131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec6bfb9d-8181-4ef5-ac3f-a3c18b17e1bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:57:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1041686556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2a12cf9-aee8-442a-aced-aa358e2d0189,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60b9ae1132174fd98a13e4c128b8ba02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:57:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:57:21Z,use_quota=True,user_id='efc8fbc185da471289d9cdb6359772fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:20 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-20e6f3be-395d-4ea0-9e54-fea1bcf11321 tempest-VolumesTransfersTest-1797082131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e7409ce-f803-4c5e-9c69-04855d0f705d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:20 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-20e6f3be-395d-4ea0-9e54-fea1bcf11321 tempest-VolumesTransfersTest-1797082131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e7409ce-f803-4c5e-9c69-04855d0f705d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:20 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-20e6f3be-395d-4ea0-9e54-fea1bcf11321 tempest-VolumesTransfersTest-1797082131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b2b9b1a-5cc7-48df-8e53-67101a6912ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:20 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-20e6f3be-395d-4ea0-9e54-fea1bcf11321 tempest-VolumesTransfersTest-1797082131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b2b9b1a-5cc7-48df-8e53-67101a6912ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2a12cf9-aee8-442a-aced-aa358e2d0189', 'volume_name': 'volume-b2a12cf9-aee8-442a-aced-aa358e2d0189', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:20 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-20e6f3be-395d-4ea0-9e54-fea1bcf11321 tempest-VolumesTransfersTest-1797082131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bacc53f9-0124-40f9-94d1-6ad3ec7f07b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:20 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-20e6f3be-395d-4ea0-9e54-fea1bcf11321 tempest-VolumesTransfersTest-1797082131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bacc53f9-0124-40f9-94d1-6ad3ec7f07b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:20 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-20e6f3be-395d-4ea0-9e54-fea1bcf11321 tempest-VolumesTransfersTest-1797082131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f892299a-bd7b-4782-a5fd-de55d343b595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:20 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-20e6f3be-395d-4ea0-9e54-fea1bcf11321 tempest-VolumesTransfersTest-1797082131 None] Volume b2a12cf9-aee8-442a-aced-aa358e2d0189: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2a12cf9-aee8-442a-aced-aa358e2d0189', 'volume_size': 1} Jul 30 16:57:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-20e6f3be-395d-4ea0-9e54-fea1bcf11321 tempest-VolumesTransfersTest-1797082131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:57:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-20e6f3be-395d-4ea0-9e54-fea1bcf11321 tempest-VolumesTransfersTest-1797082131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:57:20 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-20e6f3be-395d-4ea0-9e54-fea1bcf11321 tempest-VolumesTransfersTest-1797082131 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:57:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1041686556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2a12cf9-aee8-442a-aced-aa358e2d0189,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60b9ae1132174fd98a13e4c128b8ba02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:57:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:57:21Z,use_quota=True,user_id='efc8fbc185da471289d9cdb6359772fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:57:20 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-20e6f3be-395d-4ea0-9e54-fea1bcf11321 tempest-VolumesTransfersTest-1797082131 None] Creating volume b2a12cf9-aee8-442a-aced-aa358e2d0189 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:57:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-20e6f3be-395d-4ea0-9e54-fea1bcf11321 tempest-VolumesTransfersTest-1797082131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:57:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-20e6f3be-395d-4ea0-9e54-fea1bcf11321 tempest-VolumesTransfersTest-1797082131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:57:20 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-20e6f3be-395d-4ea0-9e54-fea1bcf11321 tempest-VolumesTransfersTest-1797082131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:57:20 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-20e6f3be-395d-4ea0-9e54-fea1bcf11321 tempest-VolumesTransfersTest-1797082131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:57:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-20e6f3be-395d-4ea0-9e54-fea1bcf11321 tempest-VolumesTransfersTest-1797082131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:57:20 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-20e6f3be-395d-4ea0-9e54-fea1bcf11321 tempest-VolumesTransfersTest-1797082131 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:57:20 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-20e6f3be-395d-4ea0-9e54-fea1bcf11321 tempest-VolumesTransfersTest-1797082131 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 16:57:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-20e6f3be-395d-4ea0-9e54-fea1bcf11321 tempest-VolumesTransfersTest-1797082131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b2a12cf9-aee8-442a-aced-aa358e2d0189 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:20 devstack sudo[98287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b2a12cf9-aee8-442a-aced-aa358e2d0189 1073741824 Jul 30 16:57:20 devstack sudo[98287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:21 devstack sudo[98287]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:21 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-20e6f3be-395d-4ea0-9e54-fea1bcf11321 tempest-VolumesTransfersTest-1797082131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b2a12cf9-aee8-442a-aced-aa358e2d0189 1073741824" returned: 0 in 0.753s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:21 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-20e6f3be-395d-4ea0-9e54-fea1bcf11321 tempest-VolumesTransfersTest-1797082131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b2a12cf9-aee8-442a-aced-aa358e2d0189 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:21 devstack sudo[98294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b2a12cf9-aee8-442a-aced-aa358e2d0189 Jul 30 16:57:21 devstack sudo[98294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:21 devstack sudo[98294]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:21 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-20e6f3be-395d-4ea0-9e54-fea1bcf11321 tempest-VolumesTransfersTest-1797082131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b2a12cf9-aee8-442a-aced-aa358e2d0189" returned: 0 in 0.315s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:21 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-20e6f3be-395d-4ea0-9e54-fea1bcf11321 tempest-VolumesTransfersTest-1797082131 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:57:21 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-20e6f3be-395d-4ea0-9e54-fea1bcf11321 tempest-VolumesTransfersTest-1797082131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:57:21 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-20e6f3be-395d-4ea0-9e54-fea1bcf11321 tempest-VolumesTransfersTest-1797082131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f892299a-bd7b-4782-a5fd-de55d343b595) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2a12cf9-aee8-442a-aced-aa358e2d0189', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:21 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-20e6f3be-395d-4ea0-9e54-fea1bcf11321 tempest-VolumesTransfersTest-1797082131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1ed9db4-0658-4cae-b56d-43a167f447ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:21 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-20e6f3be-395d-4ea0-9e54-fea1bcf11321 tempest-VolumesTransfersTest-1797082131 None] Volume volume-b2a12cf9-aee8-442a-aced-aa358e2d0189 (b2a12cf9-aee8-442a-aced-aa358e2d0189): created successfully Jul 30 16:57:22 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-20e6f3be-395d-4ea0-9e54-fea1bcf11321 tempest-VolumesTransfersTest-1797082131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1ed9db4-0658-4cae-b56d-43a167f447ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:22 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-20e6f3be-395d-4ea0-9e54-fea1bcf11321 tempest-VolumesTransfersTest-1797082131 None] Flow 'volume_create_manager' (f3454cb7-06f4-4660-bbc2-dde9c0cf9924) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:57:22 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-20e6f3be-395d-4ea0-9e54-fea1bcf11321 tempest-VolumesTransfersTest-1797082131 None] Created volume successfully. Jul 30 16:57:23 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-293d5533-1158-4484-a455-8d0d3d68bcf8 tempest-VolumesTransfersTest-2114185166 None] Acquiring lock "cinder-b2a12cf9-aee8-442a-aced-aa358e2d0189-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:57:23 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-293d5533-1158-4484-a455-8d0d3d68bcf8 tempest-VolumesTransfersTest-2114185166 None] Lock "cinder-b2a12cf9-aee8-442a-aced-aa358e2d0189-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:57:23 devstack cinder-volume[88568]: DEBUG dbcounter [-] [88568] Writing DB stats cinder:SELECT=113,cinder:UPDATE=157,cinder:INSERT=40,cinder:DELETE=18 {{(pid=88568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:57:23 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-293d5533-1158-4484-a455-8d0d3d68bcf8 tempest-VolumesTransfersTest-2114185166 None] Acquiring lock "cinder-quobyte-b2a12cf9-aee8-442a-aced-aa358e2d0189" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:57:23 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-293d5533-1158-4484-a455-8d0d3d68bcf8 tempest-VolumesTransfersTest-2114185166 None] Lock "cinder-quobyte-b2a12cf9-aee8-442a-aced-aa358e2d0189" acquired by "delete_volume" :: waited 0.031s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:57:23 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[520ace9e-15ac-4656-9d81-ddcc1fe187cc]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:57:23 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-293d5533-1158-4484-a455-8d0d3d68bcf8 tempest-VolumesTransfersTest-2114185166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b2a12cf9-aee8-442a-aced-aa358e2d0189 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:23 devstack sudo[98297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b2a12cf9-aee8-442a-aced-aa358e2d0189 Jul 30 16:57:23 devstack sudo[98297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:23 devstack sudo[98297]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:23 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-293d5533-1158-4484-a455-8d0d3d68bcf8 tempest-VolumesTransfersTest-2114185166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b2a12cf9-aee8-442a-aced-aa358e2d0189" returned: 0 in 0.616s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:23 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-293d5533-1158-4484-a455-8d0d3d68bcf8 tempest-VolumesTransfersTest-2114185166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b2a12cf9-aee8-442a-aced-aa358e2d0189 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:24 devstack sudo[98303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b2a12cf9-aee8-442a-aced-aa358e2d0189 Jul 30 16:57:24 devstack sudo[98303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:24 devstack sudo[98303]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-293d5533-1158-4484-a455-8d0d3d68bcf8 tempest-VolumesTransfersTest-2114185166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b2a12cf9-aee8-442a-aced-aa358e2d0189" returned: 0 in 0.485s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:24 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-293d5533-1158-4484-a455-8d0d3d68bcf8 tempest-VolumesTransfersTest-2114185166 None] Lock "cinder-quobyte-b2a12cf9-aee8-442a-aced-aa358e2d0189" released by "delete_volume" :: held 1.167s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:57:24 devstack cinder-volume[88568]: DEBUG dbcounter [-] [88568] Writing DB stats cinder:SELECT=116,cinder:UPDATE=153,cinder:DELETE=10,cinder:INSERT=42 {{(pid=88568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:57:24 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-293d5533-1158-4484-a455-8d0d3d68bcf8 tempest-VolumesTransfersTest-2114185166 None] Created reservations ['867dc882-1a6e-45e8-8b7b-5f81038d6782', '98a13c67-9f24-4c95-bb8b-1f3b3154d87b', '2285f8be-d6e7-43a8-ab21-caf3dca4c740', '839eb402-6e44-4455-9b99-968cff4dc229'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:57:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-293d5533-1158-4484-a455-8d0d3d68bcf8 tempest-VolumesTransfersTest-2114185166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:57:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-293d5533-1158-4484-a455-8d0d3d68bcf8 tempest-VolumesTransfersTest-2114185166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:57:24 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-293d5533-1158-4484-a455-8d0d3d68bcf8 tempest-VolumesTransfersTest-2114185166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:57:24 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-293d5533-1158-4484-a455-8d0d3d68bcf8 tempest-VolumesTransfersTest-2114185166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:57:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-293d5533-1158-4484-a455-8d0d3d68bcf8 tempest-VolumesTransfersTest-2114185166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:57:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-293d5533-1158-4484-a455-8d0d3d68bcf8 tempest-VolumesTransfersTest-2114185166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:24 devstack sudo[98308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:57:24 devstack sudo[98308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:25 devstack sudo[98308]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:25 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-293d5533-1158-4484-a455-8d0d3d68bcf8 tempest-VolumesTransfersTest-2114185166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.351s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:25 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-293d5533-1158-4484-a455-8d0d3d68bcf8 tempest-VolumesTransfersTest-2114185166 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:57:25 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-293d5533-1158-4484-a455-8d0d3d68bcf8 tempest-VolumesTransfersTest-2114185166 None] Deleted volume successfully. Jul 30 16:57:25 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-293d5533-1158-4484-a455-8d0d3d68bcf8 tempest-VolumesTransfersTest-2114185166 None] Lock "cinder-b2a12cf9-aee8-442a-aced-aa358e2d0189-delete_volume" released by "delete_volume" :: held 1.996s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:57:33 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab4a04b9-5015-42c9-a466-5124315d820b tempest-VolumesListAdminTestJSON-581800604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:57:33 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ab4a04b9-5015-42c9-a466-5124315d820b tempest-VolumesListAdminTestJSON-581800604 None] Flow 'volume_create_manager' (fae58239-001c-4a66-9c2f-0904b6dfa7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:57:33 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ab4a04b9-5015-42c9-a466-5124315d820b tempest-VolumesListAdminTestJSON-581800604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3efbab3d-b93e-4fe5-9ce8-5cd5c9011cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:33 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ab4a04b9-5015-42c9-a466-5124315d820b tempest-VolumesListAdminTestJSON-581800604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3efbab3d-b93e-4fe5-9ce8-5cd5c9011cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:57:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1790744050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65b1f227-3baa-4121-8b70-c691d6e9b5cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a47771043d5457b841330f61496635a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:57:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:57:33Z,use_quota=True,user_id='26949ba2d5b641b585efe9551163a594',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:33 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ab4a04b9-5015-42c9-a466-5124315d820b tempest-VolumesListAdminTestJSON-581800604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b07131e6-7d0c-42f9-84d9-fee683c1806a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:33 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ab4a04b9-5015-42c9-a466-5124315d820b tempest-VolumesListAdminTestJSON-581800604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b07131e6-7d0c-42f9-84d9-fee683c1806a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:33 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ab4a04b9-5015-42c9-a466-5124315d820b tempest-VolumesListAdminTestJSON-581800604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7754c20c-c33b-4e84-8e20-c6378377409e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:33 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ab4a04b9-5015-42c9-a466-5124315d820b tempest-VolumesListAdminTestJSON-581800604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7754c20c-c33b-4e84-8e20-c6378377409e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65b1f227-3baa-4121-8b70-c691d6e9b5cd', 'volume_name': 'volume-65b1f227-3baa-4121-8b70-c691d6e9b5cd', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:33 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ab4a04b9-5015-42c9-a466-5124315d820b tempest-VolumesListAdminTestJSON-581800604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ea671fd-5147-4b72-9366-48d5a8b1a2d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:33 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ab4a04b9-5015-42c9-a466-5124315d820b tempest-VolumesListAdminTestJSON-581800604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ea671fd-5147-4b72-9366-48d5a8b1a2d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:33 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ab4a04b9-5015-42c9-a466-5124315d820b tempest-VolumesListAdminTestJSON-581800604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a85116f1-ee47-4bd0-bc16-6764e2f7d849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:33 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-ab4a04b9-5015-42c9-a466-5124315d820b tempest-VolumesListAdminTestJSON-581800604 None] Volume 65b1f227-3baa-4121-8b70-c691d6e9b5cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65b1f227-3baa-4121-8b70-c691d6e9b5cd', 'volume_size': 1} Jul 30 16:57:33 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-ab4a04b9-5015-42c9-a466-5124315d820b tempest-VolumesListAdminTestJSON-581800604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:57:33 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-ab4a04b9-5015-42c9-a466-5124315d820b tempest-VolumesListAdminTestJSON-581800604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:57:33 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-ab4a04b9-5015-42c9-a466-5124315d820b tempest-VolumesListAdminTestJSON-581800604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:57:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1790744050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65b1f227-3baa-4121-8b70-c691d6e9b5cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a47771043d5457b841330f61496635a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:57:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:57:33Z,use_quota=True,user_id='26949ba2d5b641b585efe9551163a594',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:57:33 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-ab4a04b9-5015-42c9-a466-5124315d820b tempest-VolumesListAdminTestJSON-581800604 None] Creating volume 65b1f227-3baa-4121-8b70-c691d6e9b5cd {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:57:33 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-ab4a04b9-5015-42c9-a466-5124315d820b tempest-VolumesListAdminTestJSON-581800604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:57:33 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-ab4a04b9-5015-42c9-a466-5124315d820b tempest-VolumesListAdminTestJSON-581800604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:57:33 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-ab4a04b9-5015-42c9-a466-5124315d820b tempest-VolumesListAdminTestJSON-581800604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:57:33 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-ab4a04b9-5015-42c9-a466-5124315d820b tempest-VolumesListAdminTestJSON-581800604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:57:33 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-ab4a04b9-5015-42c9-a466-5124315d820b tempest-VolumesListAdminTestJSON-581800604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:57:33 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-ab4a04b9-5015-42c9-a466-5124315d820b tempest-VolumesListAdminTestJSON-581800604 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:57:33 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-ab4a04b9-5015-42c9-a466-5124315d820b tempest-VolumesListAdminTestJSON-581800604 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 16:57:33 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-ab4a04b9-5015-42c9-a466-5124315d820b tempest-VolumesListAdminTestJSON-581800604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-65b1f227-3baa-4121-8b70-c691d6e9b5cd 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:33 devstack sudo[98477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-65b1f227-3baa-4121-8b70-c691d6e9b5cd 1073741824 Jul 30 16:57:33 devstack sudo[98477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:34 devstack sudo[98477]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:34 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-ab4a04b9-5015-42c9-a466-5124315d820b tempest-VolumesListAdminTestJSON-581800604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-65b1f227-3baa-4121-8b70-c691d6e9b5cd 1073741824" returned: 0 in 0.756s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:34 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-ab4a04b9-5015-42c9-a466-5124315d820b tempest-VolumesListAdminTestJSON-581800604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-65b1f227-3baa-4121-8b70-c691d6e9b5cd {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:34 devstack sudo[98488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-65b1f227-3baa-4121-8b70-c691d6e9b5cd Jul 30 16:57:34 devstack sudo[98488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:34 devstack sudo[98488]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:34 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-ab4a04b9-5015-42c9-a466-5124315d820b tempest-VolumesListAdminTestJSON-581800604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-65b1f227-3baa-4121-8b70-c691d6e9b5cd" returned: 0 in 0.308s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:34 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-ab4a04b9-5015-42c9-a466-5124315d820b tempest-VolumesListAdminTestJSON-581800604 None] <== create_volume: return (1146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:57:34 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-ab4a04b9-5015-42c9-a466-5124315d820b tempest-VolumesListAdminTestJSON-581800604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:57:34 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ab4a04b9-5015-42c9-a466-5124315d820b tempest-VolumesListAdminTestJSON-581800604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a85116f1-ee47-4bd0-bc16-6764e2f7d849) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65b1f227-3baa-4121-8b70-c691d6e9b5cd', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:34 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ab4a04b9-5015-42c9-a466-5124315d820b tempest-VolumesListAdminTestJSON-581800604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41e19ca5-add0-444f-99f7-feb3027a8067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:34 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-ab4a04b9-5015-42c9-a466-5124315d820b tempest-VolumesListAdminTestJSON-581800604 None] Volume volume-65b1f227-3baa-4121-8b70-c691d6e9b5cd (65b1f227-3baa-4121-8b70-c691d6e9b5cd): created successfully Jul 30 16:57:34 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ab4a04b9-5015-42c9-a466-5124315d820b tempest-VolumesListAdminTestJSON-581800604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41e19ca5-add0-444f-99f7-feb3027a8067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:34 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ab4a04b9-5015-42c9-a466-5124315d820b tempest-VolumesListAdminTestJSON-581800604 None] Flow 'volume_create_manager' (fae58239-001c-4a66-9c2f-0904b6dfa7c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:57:34 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-ab4a04b9-5015-42c9-a466-5124315d820b tempest-VolumesListAdminTestJSON-581800604 None] Created volume successfully. Jul 30 16:57:36 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8d6dd74-6506-41d0-9c4e-db7a6582d90f tempest-VolumesGetTest-1105605191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:57:36 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f8d6dd74-6506-41d0-9c4e-db7a6582d90f tempest-VolumesGetTest-1105605191 None] Flow 'volume_create_manager' (f2087155-a435-4ce7-bd37-ff44f4f6dc22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:57:36 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f8d6dd74-6506-41d0-9c4e-db7a6582d90f tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a40cec92-1300-4705-8e04-fa2719cefb46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:36 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f8d6dd74-6506-41d0-9c4e-db7a6582d90f tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a40cec92-1300-4705-8e04-fa2719cefb46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:57:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-833611242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb117abb-baa4-4399-b111-905737ffb092,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0bea33560340472bac2e4927a1080f4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:57:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:57:36Z,use_quota=True,user_id='7079e6f8867c456bbafdd16180e334f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:36 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f8d6dd74-6506-41d0-9c4e-db7a6582d90f tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86e5557f-9f3e-49e0-959d-e18e5ec7f6ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:36 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f8d6dd74-6506-41d0-9c4e-db7a6582d90f tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86e5557f-9f3e-49e0-959d-e18e5ec7f6ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:36 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f8d6dd74-6506-41d0-9c4e-db7a6582d90f tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42b4ba72-441e-4b12-948b-fac3fedc5a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:36 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f8d6dd74-6506-41d0-9c4e-db7a6582d90f tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42b4ba72-441e-4b12-948b-fac3fedc5a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb117abb-baa4-4399-b111-905737ffb092', 'volume_name': 'volume-bb117abb-baa4-4399-b111-905737ffb092', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:36 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f8d6dd74-6506-41d0-9c4e-db7a6582d90f tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (342f277b-9eba-4af9-832b-2725ccaf5caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:36 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f8d6dd74-6506-41d0-9c4e-db7a6582d90f tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (342f277b-9eba-4af9-832b-2725ccaf5caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:36 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f8d6dd74-6506-41d0-9c4e-db7a6582d90f tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d864ac77-3dca-45f4-bcff-8b7adc232af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:36 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-f8d6dd74-6506-41d0-9c4e-db7a6582d90f tempest-VolumesGetTest-1105605191 None] Volume bb117abb-baa4-4399-b111-905737ffb092: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb117abb-baa4-4399-b111-905737ffb092', 'volume_size': 1} Jul 30 16:57:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-f8d6dd74-6506-41d0-9c4e-db7a6582d90f tempest-VolumesGetTest-1105605191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:57:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-f8d6dd74-6506-41d0-9c4e-db7a6582d90f tempest-VolumesGetTest-1105605191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:57:36 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-f8d6dd74-6506-41d0-9c4e-db7a6582d90f tempest-VolumesGetTest-1105605191 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:57:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-833611242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb117abb-baa4-4399-b111-905737ffb092,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0bea33560340472bac2e4927a1080f4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:57:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:57:36Z,use_quota=True,user_id='7079e6f8867c456bbafdd16180e334f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:57:36 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-f8d6dd74-6506-41d0-9c4e-db7a6582d90f tempest-VolumesGetTest-1105605191 None] Creating volume bb117abb-baa4-4399-b111-905737ffb092 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:57:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-f8d6dd74-6506-41d0-9c4e-db7a6582d90f tempest-VolumesGetTest-1105605191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:57:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-f8d6dd74-6506-41d0-9c4e-db7a6582d90f tempest-VolumesGetTest-1105605191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:57:36 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-f8d6dd74-6506-41d0-9c4e-db7a6582d90f tempest-VolumesGetTest-1105605191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:57:36 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-f8d6dd74-6506-41d0-9c4e-db7a6582d90f tempest-VolumesGetTest-1105605191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:57:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-f8d6dd74-6506-41d0-9c4e-db7a6582d90f tempest-VolumesGetTest-1105605191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:57:36 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-f8d6dd74-6506-41d0-9c4e-db7a6582d90f tempest-VolumesGetTest-1105605191 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:57:36 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-f8d6dd74-6506-41d0-9c4e-db7a6582d90f tempest-VolumesGetTest-1105605191 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 16:57:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f8d6dd74-6506-41d0-9c4e-db7a6582d90f tempest-VolumesGetTest-1105605191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bb117abb-baa4-4399-b111-905737ffb092 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:36 devstack sudo[98492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bb117abb-baa4-4399-b111-905737ffb092 1073741824 Jul 30 16:57:36 devstack sudo[98492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:36 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-817f1ccb-7d6f-4688-8707-ecc25fe7c138 tempest-VolumesListAdminTestJSON-581800604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:57:36 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-817f1ccb-7d6f-4688-8707-ecc25fe7c138 tempest-VolumesListAdminTestJSON-581800604 None] Flow 'volume_create_manager' (363e1be5-6b25-4027-80ab-e07d1c23029e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:57:36 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-817f1ccb-7d6f-4688-8707-ecc25fe7c138 tempest-VolumesListAdminTestJSON-581800604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00f964a9-b4b3-474e-8968-83e6ce38e4a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:36 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-817f1ccb-7d6f-4688-8707-ecc25fe7c138 tempest-VolumesListAdminTestJSON-581800604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00f964a9-b4b3-474e-8968-83e6ce38e4a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:57:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1073616990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d437fe76-02f0-4576-b7db-cac1d096c3d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a47771043d5457b841330f61496635a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:57:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:57:36Z,use_quota=True,user_id='26949ba2d5b641b585efe9551163a594',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:36 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-817f1ccb-7d6f-4688-8707-ecc25fe7c138 tempest-VolumesListAdminTestJSON-581800604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c100465-1be2-4a8a-afb8-c2b0bc339edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:36 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-817f1ccb-7d6f-4688-8707-ecc25fe7c138 tempest-VolumesListAdminTestJSON-581800604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c100465-1be2-4a8a-afb8-c2b0bc339edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:36 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-817f1ccb-7d6f-4688-8707-ecc25fe7c138 tempest-VolumesListAdminTestJSON-581800604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (357e6722-0fd1-4411-9530-daed425ac020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:36 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-817f1ccb-7d6f-4688-8707-ecc25fe7c138 tempest-VolumesListAdminTestJSON-581800604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (357e6722-0fd1-4411-9530-daed425ac020) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd437fe76-02f0-4576-b7db-cac1d096c3d2', 'volume_name': 'volume-d437fe76-02f0-4576-b7db-cac1d096c3d2', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:36 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-817f1ccb-7d6f-4688-8707-ecc25fe7c138 tempest-VolumesListAdminTestJSON-581800604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d871875-27c0-4c2a-b579-df9c8e65c822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:36 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-817f1ccb-7d6f-4688-8707-ecc25fe7c138 tempest-VolumesListAdminTestJSON-581800604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d871875-27c0-4c2a-b579-df9c8e65c822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:36 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-817f1ccb-7d6f-4688-8707-ecc25fe7c138 tempest-VolumesListAdminTestJSON-581800604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10fdff45-e6dc-4b44-bbf9-c103bee4e5d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:36 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-817f1ccb-7d6f-4688-8707-ecc25fe7c138 tempest-VolumesListAdminTestJSON-581800604 None] Volume d437fe76-02f0-4576-b7db-cac1d096c3d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d437fe76-02f0-4576-b7db-cac1d096c3d2', 'volume_size': 1} Jul 30 16:57:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-817f1ccb-7d6f-4688-8707-ecc25fe7c138 tempest-VolumesListAdminTestJSON-581800604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:57:36 devstack sudo[98492]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f8d6dd74-6506-41d0-9c4e-db7a6582d90f tempest-VolumesGetTest-1105605191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bb117abb-baa4-4399-b111-905737ffb092 1073741824" returned: 0 in 0.494s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f8d6dd74-6506-41d0-9c4e-db7a6582d90f tempest-VolumesGetTest-1105605191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bb117abb-baa4-4399-b111-905737ffb092 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:36 devstack sudo[98498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bb117abb-baa4-4399-b111-905737ffb092 Jul 30 16:57:36 devstack sudo[98498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:37 devstack sudo[98498]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:37 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f8d6dd74-6506-41d0-9c4e-db7a6582d90f tempest-VolumesGetTest-1105605191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bb117abb-baa4-4399-b111-905737ffb092" returned: 0 in 0.282s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:37 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-f8d6dd74-6506-41d0-9c4e-db7a6582d90f tempest-VolumesGetTest-1105605191 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:57:37 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-f8d6dd74-6506-41d0-9c4e-db7a6582d90f tempest-VolumesGetTest-1105605191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:57:37 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-817f1ccb-7d6f-4688-8707-ecc25fe7c138 tempest-VolumesListAdminTestJSON-581800604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.677s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:57:37 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-817f1ccb-7d6f-4688-8707-ecc25fe7c138 tempest-VolumesListAdminTestJSON-581800604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:57:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1073616990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d437fe76-02f0-4576-b7db-cac1d096c3d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a47771043d5457b841330f61496635a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:57:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:57:36Z,use_quota=True,user_id='26949ba2d5b641b585efe9551163a594',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:57:37 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-817f1ccb-7d6f-4688-8707-ecc25fe7c138 tempest-VolumesListAdminTestJSON-581800604 None] Creating volume d437fe76-02f0-4576-b7db-cac1d096c3d2 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:57:37 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-817f1ccb-7d6f-4688-8707-ecc25fe7c138 tempest-VolumesListAdminTestJSON-581800604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:57:37 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-817f1ccb-7d6f-4688-8707-ecc25fe7c138 tempest-VolumesListAdminTestJSON-581800604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:57:37 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-817f1ccb-7d6f-4688-8707-ecc25fe7c138 tempest-VolumesListAdminTestJSON-581800604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:57:37 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-817f1ccb-7d6f-4688-8707-ecc25fe7c138 tempest-VolumesListAdminTestJSON-581800604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:57:37 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-817f1ccb-7d6f-4688-8707-ecc25fe7c138 tempest-VolumesListAdminTestJSON-581800604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:57:37 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-817f1ccb-7d6f-4688-8707-ecc25fe7c138 tempest-VolumesListAdminTestJSON-581800604 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:57:37 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-817f1ccb-7d6f-4688-8707-ecc25fe7c138 tempest-VolumesListAdminTestJSON-581800604 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 16:57:37 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-817f1ccb-7d6f-4688-8707-ecc25fe7c138 tempest-VolumesListAdminTestJSON-581800604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d437fe76-02f0-4576-b7db-cac1d096c3d2 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:37 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f8d6dd74-6506-41d0-9c4e-db7a6582d90f tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d864ac77-3dca-45f4-bcff-8b7adc232af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb117abb-baa4-4399-b111-905737ffb092', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:37 devstack sudo[98501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d437fe76-02f0-4576-b7db-cac1d096c3d2 1073741824 Jul 30 16:57:37 devstack sudo[98501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:37 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f8d6dd74-6506-41d0-9c4e-db7a6582d90f tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16da4c92-4fe1-4dac-a8ad-c56baa331460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:37 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-f8d6dd74-6506-41d0-9c4e-db7a6582d90f tempest-VolumesGetTest-1105605191 None] Volume volume-bb117abb-baa4-4399-b111-905737ffb092 (bb117abb-baa4-4399-b111-905737ffb092): created successfully Jul 30 16:57:37 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f8d6dd74-6506-41d0-9c4e-db7a6582d90f tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16da4c92-4fe1-4dac-a8ad-c56baa331460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:37 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f8d6dd74-6506-41d0-9c4e-db7a6582d90f tempest-VolumesGetTest-1105605191 None] Flow 'volume_create_manager' (f2087155-a435-4ce7-bd37-ff44f4f6dc22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:57:37 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-f8d6dd74-6506-41d0-9c4e-db7a6582d90f tempest-VolumesGetTest-1105605191 None] Created volume successfully. Jul 30 16:57:37 devstack sudo[98501]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:37 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-817f1ccb-7d6f-4688-8707-ecc25fe7c138 tempest-VolumesListAdminTestJSON-581800604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d437fe76-02f0-4576-b7db-cac1d096c3d2 1073741824" returned: 0 in 0.464s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:37 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-817f1ccb-7d6f-4688-8707-ecc25fe7c138 tempest-VolumesListAdminTestJSON-581800604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d437fe76-02f0-4576-b7db-cac1d096c3d2 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:37 devstack sudo[98507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d437fe76-02f0-4576-b7db-cac1d096c3d2 Jul 30 16:57:37 devstack sudo[98507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:37 devstack sudo[98507]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:37 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-817f1ccb-7d6f-4688-8707-ecc25fe7c138 tempest-VolumesListAdminTestJSON-581800604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d437fe76-02f0-4576-b7db-cac1d096c3d2" returned: 0 in 0.281s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:37 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-817f1ccb-7d6f-4688-8707-ecc25fe7c138 tempest-VolumesListAdminTestJSON-581800604 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:57:37 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-817f1ccb-7d6f-4688-8707-ecc25fe7c138 tempest-VolumesListAdminTestJSON-581800604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:57:37 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-817f1ccb-7d6f-4688-8707-ecc25fe7c138 tempest-VolumesListAdminTestJSON-581800604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10fdff45-e6dc-4b44-bbf9-c103bee4e5d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d437fe76-02f0-4576-b7db-cac1d096c3d2', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:37 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-817f1ccb-7d6f-4688-8707-ecc25fe7c138 tempest-VolumesListAdminTestJSON-581800604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95cbd276-f1a9-4344-8ceb-6b1b87853634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:37 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-817f1ccb-7d6f-4688-8707-ecc25fe7c138 tempest-VolumesListAdminTestJSON-581800604 None] Volume volume-d437fe76-02f0-4576-b7db-cac1d096c3d2 (d437fe76-02f0-4576-b7db-cac1d096c3d2): created successfully Jul 30 16:57:37 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-817f1ccb-7d6f-4688-8707-ecc25fe7c138 tempest-VolumesListAdminTestJSON-581800604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95cbd276-f1a9-4344-8ceb-6b1b87853634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:37 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-817f1ccb-7d6f-4688-8707-ecc25fe7c138 tempest-VolumesListAdminTestJSON-581800604 None] Flow 'volume_create_manager' (363e1be5-6b25-4027-80ab-e07d1c23029e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:57:37 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-817f1ccb-7d6f-4688-8707-ecc25fe7c138 tempest-VolumesListAdminTestJSON-581800604 None] Created volume successfully. Jul 30 16:57:38 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-d08a8323-7f1f-46b7-aacd-9e01b0051a8e tempest-VolumesListAdminTestJSON-581800604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:57:38 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-d08a8323-7f1f-46b7-aacd-9e01b0051a8e tempest-VolumesListAdminTestJSON-581800604 None] Flow 'volume_create_manager' (78108fc8-2836-4681-91e6-a523d6c4bdbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:57:38 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-d08a8323-7f1f-46b7-aacd-9e01b0051a8e tempest-VolumesListAdminTestJSON-581800604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfc71e91-fe95-419a-932a-04b04bdef0ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:38 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-d08a8323-7f1f-46b7-aacd-9e01b0051a8e tempest-VolumesListAdminTestJSON-581800604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfc71e91-fe95-419a-932a-04b04bdef0ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:57:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-94359893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=325a7115-99ac-4782-9a33-92ad52f0d21a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a47771043d5457b841330f61496635a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:57:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:57:39Z,use_quota=True,user_id='26949ba2d5b641b585efe9551163a594',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:38 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-d08a8323-7f1f-46b7-aacd-9e01b0051a8e tempest-VolumesListAdminTestJSON-581800604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbf0d49e-3003-4076-8201-88a4cac79553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:38 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-d08a8323-7f1f-46b7-aacd-9e01b0051a8e tempest-VolumesListAdminTestJSON-581800604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbf0d49e-3003-4076-8201-88a4cac79553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:38 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-d08a8323-7f1f-46b7-aacd-9e01b0051a8e tempest-VolumesListAdminTestJSON-581800604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc19edab-73b0-4fe7-9d2b-d864404c1af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:38 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-d08a8323-7f1f-46b7-aacd-9e01b0051a8e tempest-VolumesListAdminTestJSON-581800604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc19edab-73b0-4fe7-9d2b-d864404c1af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '325a7115-99ac-4782-9a33-92ad52f0d21a', 'volume_name': 'volume-325a7115-99ac-4782-9a33-92ad52f0d21a', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:38 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-d08a8323-7f1f-46b7-aacd-9e01b0051a8e tempest-VolumesListAdminTestJSON-581800604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee4398a6-4672-4b1e-8663-c33f30192de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:38 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-d08a8323-7f1f-46b7-aacd-9e01b0051a8e tempest-VolumesListAdminTestJSON-581800604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee4398a6-4672-4b1e-8663-c33f30192de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:38 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-d08a8323-7f1f-46b7-aacd-9e01b0051a8e tempest-VolumesListAdminTestJSON-581800604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa768bf5-373a-471f-9787-773156becdc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:38 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-d08a8323-7f1f-46b7-aacd-9e01b0051a8e tempest-VolumesListAdminTestJSON-581800604 None] Volume 325a7115-99ac-4782-9a33-92ad52f0d21a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-325a7115-99ac-4782-9a33-92ad52f0d21a', 'volume_size': 1} Jul 30 16:57:38 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-d08a8323-7f1f-46b7-aacd-9e01b0051a8e tempest-VolumesListAdminTestJSON-581800604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:57:38 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-d08a8323-7f1f-46b7-aacd-9e01b0051a8e tempest-VolumesListAdminTestJSON-581800604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:57:38 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-d08a8323-7f1f-46b7-aacd-9e01b0051a8e tempest-VolumesListAdminTestJSON-581800604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:57:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-94359893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=325a7115-99ac-4782-9a33-92ad52f0d21a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a47771043d5457b841330f61496635a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:57:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:57:39Z,use_quota=True,user_id='26949ba2d5b641b585efe9551163a594',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:57:38 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-d08a8323-7f1f-46b7-aacd-9e01b0051a8e tempest-VolumesListAdminTestJSON-581800604 None] Creating volume 325a7115-99ac-4782-9a33-92ad52f0d21a {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:57:38 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-d08a8323-7f1f-46b7-aacd-9e01b0051a8e tempest-VolumesListAdminTestJSON-581800604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:57:38 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-d08a8323-7f1f-46b7-aacd-9e01b0051a8e tempest-VolumesListAdminTestJSON-581800604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:57:38 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-d08a8323-7f1f-46b7-aacd-9e01b0051a8e tempest-VolumesListAdminTestJSON-581800604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:57:38 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-d08a8323-7f1f-46b7-aacd-9e01b0051a8e tempest-VolumesListAdminTestJSON-581800604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:57:38 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-d08a8323-7f1f-46b7-aacd-9e01b0051a8e tempest-VolumesListAdminTestJSON-581800604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:57:38 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-d08a8323-7f1f-46b7-aacd-9e01b0051a8e tempest-VolumesListAdminTestJSON-581800604 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:57:38 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-d08a8323-7f1f-46b7-aacd-9e01b0051a8e tempest-VolumesListAdminTestJSON-581800604 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 16:57:38 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d08a8323-7f1f-46b7-aacd-9e01b0051a8e tempest-VolumesListAdminTestJSON-581800604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-325a7115-99ac-4782-9a33-92ad52f0d21a 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:38 devstack sudo[98513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-325a7115-99ac-4782-9a33-92ad52f0d21a 1073741824 Jul 30 16:57:38 devstack sudo[98513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:39 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-64e7aad4-ccf6-4a16-a1fd-018ba590e97d tempest-VolumesGetTest-1105605191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:57:39 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-64e7aad4-ccf6-4a16-a1fd-018ba590e97d tempest-VolumesGetTest-1105605191 None] Flow 'volume_create_manager' (0d426127-82b7-480d-9065-821c8652470b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:57:39 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-64e7aad4-ccf6-4a16-a1fd-018ba590e97d tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2755adf8-7b07-4616-8456-665a6309c12c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:39 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-64e7aad4-ccf6-4a16-a1fd-018ba590e97d tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2755adf8-7b07-4616-8456-665a6309c12c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:57:39Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-54119825',display_name='tempest-VolumesGetTest-Volume-1807632151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bef14126-8e04-48ba-818b-adcd8e2314f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bea33560340472bac2e4927a1080f4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:57:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:57:39Z,use_quota=True,user_id='7079e6f8867c456bbafdd16180e334f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:39 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-64e7aad4-ccf6-4a16-a1fd-018ba590e97d tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34682719-9166-48f3-aeb7-7315db451a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:39 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-64e7aad4-ccf6-4a16-a1fd-018ba590e97d tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34682719-9166-48f3-aeb7-7315db451a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:39 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-64e7aad4-ccf6-4a16-a1fd-018ba590e97d tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b1a7898-86da-428e-a7f1-032d18c1bf71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:39 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-64e7aad4-ccf6-4a16-a1fd-018ba590e97d tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b1a7898-86da-428e-a7f1-032d18c1bf71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bef14126-8e04-48ba-818b-adcd8e2314f5', 'volume_name': 'volume-bef14126-8e04-48ba-818b-adcd8e2314f5', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:39 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-64e7aad4-ccf6-4a16-a1fd-018ba590e97d tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6a0ad6a-b4af-4b0d-b5c2-461da350698a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:39 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-64e7aad4-ccf6-4a16-a1fd-018ba590e97d tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6a0ad6a-b4af-4b0d-b5c2-461da350698a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:39 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-64e7aad4-ccf6-4a16-a1fd-018ba590e97d tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53ab591e-f784-424f-8d12-2618842b4d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:39 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-64e7aad4-ccf6-4a16-a1fd-018ba590e97d tempest-VolumesGetTest-1105605191 None] Volume bef14126-8e04-48ba-818b-adcd8e2314f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bef14126-8e04-48ba-818b-adcd8e2314f5', 'volume_size': 1} Jul 30 16:57:39 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-64e7aad4-ccf6-4a16-a1fd-018ba590e97d tempest-VolumesGetTest-1105605191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:57:39 devstack sudo[98513]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:39 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d08a8323-7f1f-46b7-aacd-9e01b0051a8e tempest-VolumesListAdminTestJSON-581800604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-325a7115-99ac-4782-9a33-92ad52f0d21a 1073741824" returned: 0 in 0.488s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:39 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d08a8323-7f1f-46b7-aacd-9e01b0051a8e tempest-VolumesListAdminTestJSON-581800604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-325a7115-99ac-4782-9a33-92ad52f0d21a {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:39 devstack sudo[98519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-325a7115-99ac-4782-9a33-92ad52f0d21a Jul 30 16:57:39 devstack sudo[98519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:39 devstack sudo[98519]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:39 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d08a8323-7f1f-46b7-aacd-9e01b0051a8e tempest-VolumesListAdminTestJSON-581800604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-325a7115-99ac-4782-9a33-92ad52f0d21a" returned: 0 in 0.288s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:39 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-d08a8323-7f1f-46b7-aacd-9e01b0051a8e tempest-VolumesListAdminTestJSON-581800604 None] <== create_volume: return (827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:57:39 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-d08a8323-7f1f-46b7-aacd-9e01b0051a8e tempest-VolumesListAdminTestJSON-581800604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:57:39 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-64e7aad4-ccf6-4a16-a1fd-018ba590e97d tempest-VolumesGetTest-1105605191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.694s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:57:39 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-64e7aad4-ccf6-4a16-a1fd-018ba590e97d tempest-VolumesGetTest-1105605191 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:57:39Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-54119825',display_name='tempest-VolumesGetTest-Volume-1807632151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bef14126-8e04-48ba-818b-adcd8e2314f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bea33560340472bac2e4927a1080f4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:57:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:57:39Z,use_quota=True,user_id='7079e6f8867c456bbafdd16180e334f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:57:39 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-64e7aad4-ccf6-4a16-a1fd-018ba590e97d tempest-VolumesGetTest-1105605191 None] Creating volume bef14126-8e04-48ba-818b-adcd8e2314f5 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:57:39 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-64e7aad4-ccf6-4a16-a1fd-018ba590e97d tempest-VolumesGetTest-1105605191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:57:39 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-64e7aad4-ccf6-4a16-a1fd-018ba590e97d tempest-VolumesGetTest-1105605191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:57:39 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-64e7aad4-ccf6-4a16-a1fd-018ba590e97d tempest-VolumesGetTest-1105605191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:57:39 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-64e7aad4-ccf6-4a16-a1fd-018ba590e97d tempest-VolumesGetTest-1105605191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:57:39 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-64e7aad4-ccf6-4a16-a1fd-018ba590e97d tempest-VolumesGetTest-1105605191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:57:39 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-64e7aad4-ccf6-4a16-a1fd-018ba590e97d tempest-VolumesGetTest-1105605191 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:57:39 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-64e7aad4-ccf6-4a16-a1fd-018ba590e97d tempest-VolumesGetTest-1105605191 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 16:57:39 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-64e7aad4-ccf6-4a16-a1fd-018ba590e97d tempest-VolumesGetTest-1105605191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bef14126-8e04-48ba-818b-adcd8e2314f5 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:39 devstack sudo[98522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bef14126-8e04-48ba-818b-adcd8e2314f5 1073741824 Jul 30 16:57:39 devstack sudo[98522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:39 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-d08a8323-7f1f-46b7-aacd-9e01b0051a8e tempest-VolumesListAdminTestJSON-581800604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa768bf5-373a-471f-9787-773156becdc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-325a7115-99ac-4782-9a33-92ad52f0d21a', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:39 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-d08a8323-7f1f-46b7-aacd-9e01b0051a8e tempest-VolumesListAdminTestJSON-581800604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f711048-ac3a-4f88-bc59-9928efcca44d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:39 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-d08a8323-7f1f-46b7-aacd-9e01b0051a8e tempest-VolumesListAdminTestJSON-581800604 None] Volume volume-325a7115-99ac-4782-9a33-92ad52f0d21a (325a7115-99ac-4782-9a33-92ad52f0d21a): created successfully Jul 30 16:57:39 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-d08a8323-7f1f-46b7-aacd-9e01b0051a8e tempest-VolumesListAdminTestJSON-581800604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f711048-ac3a-4f88-bc59-9928efcca44d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:39 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-d08a8323-7f1f-46b7-aacd-9e01b0051a8e tempest-VolumesListAdminTestJSON-581800604 None] Flow 'volume_create_manager' (78108fc8-2836-4681-91e6-a523d6c4bdbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:57:39 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-d08a8323-7f1f-46b7-aacd-9e01b0051a8e tempest-VolumesListAdminTestJSON-581800604 None] Created volume successfully. Jul 30 16:57:40 devstack sudo[98522]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:40 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-64e7aad4-ccf6-4a16-a1fd-018ba590e97d tempest-VolumesGetTest-1105605191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bef14126-8e04-48ba-818b-adcd8e2314f5 1073741824" returned: 0 in 0.524s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:40 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-64e7aad4-ccf6-4a16-a1fd-018ba590e97d tempest-VolumesGetTest-1105605191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bef14126-8e04-48ba-818b-adcd8e2314f5 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:40 devstack sudo[98527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bef14126-8e04-48ba-818b-adcd8e2314f5 Jul 30 16:57:40 devstack sudo[98527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:40 devstack sudo[98527]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:40 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-64e7aad4-ccf6-4a16-a1fd-018ba590e97d tempest-VolumesGetTest-1105605191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bef14126-8e04-48ba-818b-adcd8e2314f5" returned: 0 in 0.316s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:40 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-64e7aad4-ccf6-4a16-a1fd-018ba590e97d tempest-VolumesGetTest-1105605191 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:57:40 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-64e7aad4-ccf6-4a16-a1fd-018ba590e97d tempest-VolumesGetTest-1105605191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:57:40 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-64e7aad4-ccf6-4a16-a1fd-018ba590e97d tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53ab591e-f784-424f-8d12-2618842b4d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bef14126-8e04-48ba-818b-adcd8e2314f5', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:40 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-64e7aad4-ccf6-4a16-a1fd-018ba590e97d tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (975264b1-75e1-431f-bcc9-d3d580026596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:40 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-64e7aad4-ccf6-4a16-a1fd-018ba590e97d tempest-VolumesGetTest-1105605191 None] Volume volume-bef14126-8e04-48ba-818b-adcd8e2314f5 (bef14126-8e04-48ba-818b-adcd8e2314f5): created successfully Jul 30 16:57:40 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-64e7aad4-ccf6-4a16-a1fd-018ba590e97d tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (975264b1-75e1-431f-bcc9-d3d580026596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:40 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-64e7aad4-ccf6-4a16-a1fd-018ba590e97d tempest-VolumesGetTest-1105605191 None] Flow 'volume_create_manager' (0d426127-82b7-480d-9065-821c8652470b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:57:40 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-64e7aad4-ccf6-4a16-a1fd-018ba590e97d tempest-VolumesGetTest-1105605191 None] Created volume successfully. Jul 30 16:57:41 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-b891aa5a-bdf7-4580-8374-7acb3cf26224 tempest-VolumesGetTest-1105605191 None] Acquiring lock "cinder-bef14126-8e04-48ba-818b-adcd8e2314f5-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:57:41 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-b891aa5a-bdf7-4580-8374-7acb3cf26224 tempest-VolumesGetTest-1105605191 None] Lock "cinder-bef14126-8e04-48ba-818b-adcd8e2314f5-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:57:41 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-b891aa5a-bdf7-4580-8374-7acb3cf26224 tempest-VolumesGetTest-1105605191 None] Acquiring lock "cinder-quobyte-bef14126-8e04-48ba-818b-adcd8e2314f5" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:57:41 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-b891aa5a-bdf7-4580-8374-7acb3cf26224 tempest-VolumesGetTest-1105605191 None] Lock "cinder-quobyte-bef14126-8e04-48ba-818b-adcd8e2314f5" acquired by "delete_volume" :: waited 0.023s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:57:41 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[af870f16-acf5-4529-95a9-6bf4a7f105da]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:57:41 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-b891aa5a-bdf7-4580-8374-7acb3cf26224 tempest-VolumesGetTest-1105605191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bef14126-8e04-48ba-818b-adcd8e2314f5 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:41 devstack sudo[98530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bef14126-8e04-48ba-818b-adcd8e2314f5 Jul 30 16:57:41 devstack sudo[98530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:41 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-2aca384e-4744-4e6b-8619-15f105740bc1 tempest-VolumesListAdminTestJSON-173451031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:57:41 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-2aca384e-4744-4e6b-8619-15f105740bc1 tempest-VolumesListAdminTestJSON-173451031 None] Flow 'volume_create_manager' (90d95a73-fc21-4b66-8547-efaf0bebe682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:57:41 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-2aca384e-4744-4e6b-8619-15f105740bc1 tempest-VolumesListAdminTestJSON-173451031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30223daa-3907-4608-99df-eb2153b1999a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:41 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-2aca384e-4744-4e6b-8619-15f105740bc1 tempest-VolumesListAdminTestJSON-173451031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30223daa-3907-4608-99df-eb2153b1999a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:57:41Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=315509ff-c99e-4067-938e-2d9390a82f49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bfa89868beb4226ac7e657070062fae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:57:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:57:42Z,use_quota=True,user_id='c64cc20647e14043bc3ac753e8d6cdfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:41 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-2aca384e-4744-4e6b-8619-15f105740bc1 tempest-VolumesListAdminTestJSON-173451031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6af70f6c-9b14-49a3-97f4-6f0afe9e9e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:41 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-2aca384e-4744-4e6b-8619-15f105740bc1 tempest-VolumesListAdminTestJSON-173451031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6af70f6c-9b14-49a3-97f4-6f0afe9e9e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:41 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-2aca384e-4744-4e6b-8619-15f105740bc1 tempest-VolumesListAdminTestJSON-173451031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d8c8ed1-c0a7-4911-92d8-9a1db35f7f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:41 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-2aca384e-4744-4e6b-8619-15f105740bc1 tempest-VolumesListAdminTestJSON-173451031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d8c8ed1-c0a7-4911-92d8-9a1db35f7f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '315509ff-c99e-4067-938e-2d9390a82f49', 'volume_name': 'volume-315509ff-c99e-4067-938e-2d9390a82f49', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:41 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-2aca384e-4744-4e6b-8619-15f105740bc1 tempest-VolumesListAdminTestJSON-173451031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dac3ab88-cbf1-4bc9-b36d-d008fa2a2f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:41 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-2aca384e-4744-4e6b-8619-15f105740bc1 tempest-VolumesListAdminTestJSON-173451031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dac3ab88-cbf1-4bc9-b36d-d008fa2a2f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:41 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-2aca384e-4744-4e6b-8619-15f105740bc1 tempest-VolumesListAdminTestJSON-173451031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d31a0db-6596-4556-b3c4-aeaf8d1201a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:41 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-2aca384e-4744-4e6b-8619-15f105740bc1 tempest-VolumesListAdminTestJSON-173451031 None] Volume 315509ff-c99e-4067-938e-2d9390a82f49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-315509ff-c99e-4067-938e-2d9390a82f49', 'volume_size': 1} Jul 30 16:57:41 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-2aca384e-4744-4e6b-8619-15f105740bc1 tempest-VolumesListAdminTestJSON-173451031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:57:41 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-2aca384e-4744-4e6b-8619-15f105740bc1 tempest-VolumesListAdminTestJSON-173451031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:57:41 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-2aca384e-4744-4e6b-8619-15f105740bc1 tempest-VolumesListAdminTestJSON-173451031 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:57:41Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=315509ff-c99e-4067-938e-2d9390a82f49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bfa89868beb4226ac7e657070062fae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:57:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:57:42Z,use_quota=True,user_id='c64cc20647e14043bc3ac753e8d6cdfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:57:42 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-2aca384e-4744-4e6b-8619-15f105740bc1 tempest-VolumesListAdminTestJSON-173451031 None] Creating volume 315509ff-c99e-4067-938e-2d9390a82f49 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:57:42 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-2aca384e-4744-4e6b-8619-15f105740bc1 tempest-VolumesListAdminTestJSON-173451031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:57:42 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-2aca384e-4744-4e6b-8619-15f105740bc1 tempest-VolumesListAdminTestJSON-173451031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:57:42 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-2aca384e-4744-4e6b-8619-15f105740bc1 tempest-VolumesListAdminTestJSON-173451031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:57:42 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-2aca384e-4744-4e6b-8619-15f105740bc1 tempest-VolumesListAdminTestJSON-173451031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:57:42 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-2aca384e-4744-4e6b-8619-15f105740bc1 tempest-VolumesListAdminTestJSON-173451031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:57:42 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-2aca384e-4744-4e6b-8619-15f105740bc1 tempest-VolumesListAdminTestJSON-173451031 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:57:42 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-2aca384e-4744-4e6b-8619-15f105740bc1 tempest-VolumesListAdminTestJSON-173451031 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 16:57:42 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2aca384e-4744-4e6b-8619-15f105740bc1 tempest-VolumesListAdminTestJSON-173451031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-315509ff-c99e-4067-938e-2d9390a82f49 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:42 devstack sudo[98532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-315509ff-c99e-4067-938e-2d9390a82f49 1073741824 Jul 30 16:57:42 devstack sudo[98532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:42 devstack sudo[98530]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:42 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-b891aa5a-bdf7-4580-8374-7acb3cf26224 tempest-VolumesGetTest-1105605191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bef14126-8e04-48ba-818b-adcd8e2314f5" returned: 0 in 0.458s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:42 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-b891aa5a-bdf7-4580-8374-7acb3cf26224 tempest-VolumesGetTest-1105605191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bef14126-8e04-48ba-818b-adcd8e2314f5 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:42 devstack sudo[98537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bef14126-8e04-48ba-818b-adcd8e2314f5 Jul 30 16:57:42 devstack sudo[98537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:42 devstack sudo[98537]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:42 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-b891aa5a-bdf7-4580-8374-7acb3cf26224 tempest-VolumesGetTest-1105605191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bef14126-8e04-48ba-818b-adcd8e2314f5" returned: 0 in 0.296s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:42 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-b891aa5a-bdf7-4580-8374-7acb3cf26224 tempest-VolumesGetTest-1105605191 None] Lock "cinder-quobyte-bef14126-8e04-48ba-818b-adcd8e2314f5" released by "delete_volume" :: held 0.818s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:57:42 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-b891aa5a-bdf7-4580-8374-7acb3cf26224 tempest-VolumesGetTest-1105605191 None] Created reservations ['d9896794-e0bb-483e-97a2-1ee2f8ffba73', '58a4fa31-e271-48d5-ab8d-c4350b6cffe2', 'f3c68be7-46fc-49a6-aed8-5d9240081cb9', 'dd29991e-c663-497b-a4b0-eaee67104a6c'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:57:42 devstack sudo[98532]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:42 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2aca384e-4744-4e6b-8619-15f105740bc1 tempest-VolumesListAdminTestJSON-173451031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-315509ff-c99e-4067-938e-2d9390a82f49 1073741824" returned: 0 in 0.579s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:42 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-b891aa5a-bdf7-4580-8374-7acb3cf26224 tempest-VolumesGetTest-1105605191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:57:42 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-b891aa5a-bdf7-4580-8374-7acb3cf26224 tempest-VolumesGetTest-1105605191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:57:42 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-b891aa5a-bdf7-4580-8374-7acb3cf26224 tempest-VolumesGetTest-1105605191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:57:42 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-b891aa5a-bdf7-4580-8374-7acb3cf26224 tempest-VolumesGetTest-1105605191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:57:42 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-b891aa5a-bdf7-4580-8374-7acb3cf26224 tempest-VolumesGetTest-1105605191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:57:42 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-b891aa5a-bdf7-4580-8374-7acb3cf26224 tempest-VolumesGetTest-1105605191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:42 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2aca384e-4744-4e6b-8619-15f105740bc1 tempest-VolumesListAdminTestJSON-173451031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-315509ff-c99e-4067-938e-2d9390a82f49 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:42 devstack sudo[98544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:57:42 devstack sudo[98544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:42 devstack sudo[98545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-315509ff-c99e-4067-938e-2d9390a82f49 Jul 30 16:57:42 devstack sudo[98545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:42 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-2be6a265-bc16-42ba-9c1b-71a933be341e tempest-VolumesGetTest-1105605191 None] Acquiring lock "cinder-bb117abb-baa4-4399-b111-905737ffb092-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:57:42 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-2be6a265-bc16-42ba-9c1b-71a933be341e tempest-VolumesGetTest-1105605191 None] Lock "cinder-bb117abb-baa4-4399-b111-905737ffb092-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:57:42 devstack sudo[98545]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:42 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2aca384e-4744-4e6b-8619-15f105740bc1 tempest-VolumesListAdminTestJSON-173451031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-315509ff-c99e-4067-938e-2d9390a82f49" returned: 0 in 0.319s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:42 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-2aca384e-4744-4e6b-8619-15f105740bc1 tempest-VolumesListAdminTestJSON-173451031 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:57:42 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-2aca384e-4744-4e6b-8619-15f105740bc1 tempest-VolumesListAdminTestJSON-173451031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:57:42 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-2aca384e-4744-4e6b-8619-15f105740bc1 tempest-VolumesListAdminTestJSON-173451031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d31a0db-6596-4556-b3c4-aeaf8d1201a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-315509ff-c99e-4067-938e-2d9390a82f49', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:42 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-2aca384e-4744-4e6b-8619-15f105740bc1 tempest-VolumesListAdminTestJSON-173451031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67518360-7b50-4819-bf47-deb72829a996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:43 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-3296a19b-e8bc-4d2a-8d1e-aa02811fedcd tempest-VolumesNegativeTest-1747898349 None] Acquiring lock "cinder-78ad9ec4-5502-430a-bd9b-0d8cac6f502f-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:57:43 devstack sudo[98544]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:43 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-2be6a265-bc16-42ba-9c1b-71a933be341e tempest-VolumesGetTest-1105605191 None] Acquiring lock "cinder-quobyte-bb117abb-baa4-4399-b111-905737ffb092" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:57:43 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-2aca384e-4744-4e6b-8619-15f105740bc1 tempest-VolumesListAdminTestJSON-173451031 None] Volume volume-315509ff-c99e-4067-938e-2d9390a82f49 (315509ff-c99e-4067-938e-2d9390a82f49): created successfully Jul 30 16:57:43 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-2aca384e-4744-4e6b-8619-15f105740bc1 tempest-VolumesListAdminTestJSON-173451031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67518360-7b50-4819-bf47-deb72829a996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:43 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-2aca384e-4744-4e6b-8619-15f105740bc1 tempest-VolumesListAdminTestJSON-173451031 None] Flow 'volume_create_manager' (90d95a73-fc21-4b66-8547-efaf0bebe682) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:57:43 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-b891aa5a-bdf7-4580-8374-7acb3cf26224 tempest-VolumesGetTest-1105605191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.416s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:43 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-b891aa5a-bdf7-4580-8374-7acb3cf26224 tempest-VolumesGetTest-1105605191 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:57:43 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-b891aa5a-bdf7-4580-8374-7acb3cf26224 tempest-VolumesGetTest-1105605191 None] Deleted volume successfully. Jul 30 16:57:43 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-3296a19b-e8bc-4d2a-8d1e-aa02811fedcd tempest-VolumesNegativeTest-1747898349 None] Lock "cinder-78ad9ec4-5502-430a-bd9b-0d8cac6f502f-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:57:43 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-2be6a265-bc16-42ba-9c1b-71a933be341e tempest-VolumesGetTest-1105605191 None] Lock "cinder-quobyte-bb117abb-baa4-4399-b111-905737ffb092" acquired by "delete_volume" :: waited 0.050s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:57:43 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-2aca384e-4744-4e6b-8619-15f105740bc1 tempest-VolumesListAdminTestJSON-173451031 None] Created volume successfully. Jul 30 16:57:43 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[f177ca93-59ec-4cd6-a9aa-f0ff3b9b7166]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:57:43 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2be6a265-bc16-42ba-9c1b-71a933be341e tempest-VolumesGetTest-1105605191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bb117abb-baa4-4399-b111-905737ffb092 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:43 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-b891aa5a-bdf7-4580-8374-7acb3cf26224 tempest-VolumesGetTest-1105605191 None] Lock "cinder-bef14126-8e04-48ba-818b-adcd8e2314f5-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:57:43 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-3296a19b-e8bc-4d2a-8d1e-aa02811fedcd tempest-VolumesNegativeTest-1747898349 None] Acquiring lock "cinder-quobyte-78ad9ec4-5502-430a-bd9b-0d8cac6f502f" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:57:43 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-3296a19b-e8bc-4d2a-8d1e-aa02811fedcd tempest-VolumesNegativeTest-1747898349 None] Lock "cinder-quobyte-78ad9ec4-5502-430a-bd9b-0d8cac6f502f" acquired by "delete_volume" :: waited 0.017s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:57:43 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d2b2cd-49d5-4f53-b7a5-85c571637a1e]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:57:43 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-3296a19b-e8bc-4d2a-8d1e-aa02811fedcd tempest-VolumesNegativeTest-1747898349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-78ad9ec4-5502-430a-bd9b-0d8cac6f502f {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:43 devstack sudo[98550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bb117abb-baa4-4399-b111-905737ffb092 Jul 30 16:57:43 devstack sudo[98550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:43 devstack sudo[98551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-78ad9ec4-5502-430a-bd9b-0d8cac6f502f Jul 30 16:57:43 devstack sudo[98551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:43 devstack sudo[98550]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:43 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2be6a265-bc16-42ba-9c1b-71a933be341e tempest-VolumesGetTest-1105605191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bb117abb-baa4-4399-b111-905737ffb092" returned: 0 in 0.393s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:43 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2be6a265-bc16-42ba-9c1b-71a933be341e tempest-VolumesGetTest-1105605191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bb117abb-baa4-4399-b111-905737ffb092 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:43 devstack sudo[98558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bb117abb-baa4-4399-b111-905737ffb092 Jul 30 16:57:43 devstack sudo[98558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:43 devstack sudo[98551]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:43 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-3296a19b-e8bc-4d2a-8d1e-aa02811fedcd tempest-VolumesNegativeTest-1747898349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-78ad9ec4-5502-430a-bd9b-0d8cac6f502f" returned: 0 in 0.406s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:43 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-3296a19b-e8bc-4d2a-8d1e-aa02811fedcd tempest-VolumesNegativeTest-1747898349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-78ad9ec4-5502-430a-bd9b-0d8cac6f502f {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:43 devstack sudo[98562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-78ad9ec4-5502-430a-bd9b-0d8cac6f502f Jul 30 16:57:43 devstack sudo[98562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:43 devstack sudo[98558]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:43 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2be6a265-bc16-42ba-9c1b-71a933be341e tempest-VolumesGetTest-1105605191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bb117abb-baa4-4399-b111-905737ffb092" returned: 0 in 0.283s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:43 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-2be6a265-bc16-42ba-9c1b-71a933be341e tempest-VolumesGetTest-1105605191 None] Lock "cinder-quobyte-bb117abb-baa4-4399-b111-905737ffb092" released by "delete_volume" :: held 0.726s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:57:43 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-2be6a265-bc16-42ba-9c1b-71a933be341e tempest-VolumesGetTest-1105605191 None] Created reservations ['3ea4896a-a1ef-420c-bd68-1fd4f3a94de0', '7cc0a4e6-9f7d-4e36-9f00-4e8f5789df9a', '059a7778-adfc-48b3-b44c-13b40cdaecfc', '97a5e3b7-f450-4fc3-9b63-282f2b2d1f68'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:57:43 devstack sudo[98562]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:43 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-3296a19b-e8bc-4d2a-8d1e-aa02811fedcd tempest-VolumesNegativeTest-1747898349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-78ad9ec4-5502-430a-bd9b-0d8cac6f502f" returned: 0 in 0.301s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:43 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-3296a19b-e8bc-4d2a-8d1e-aa02811fedcd tempest-VolumesNegativeTest-1747898349 None] Lock "cinder-quobyte-78ad9ec4-5502-430a-bd9b-0d8cac6f502f" released by "delete_volume" :: held 0.759s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:57:43 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-2be6a265-bc16-42ba-9c1b-71a933be341e tempest-VolumesGetTest-1105605191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:57:43 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-2be6a265-bc16-42ba-9c1b-71a933be341e tempest-VolumesGetTest-1105605191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:57:43 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-2be6a265-bc16-42ba-9c1b-71a933be341e tempest-VolumesGetTest-1105605191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:57:43 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-2be6a265-bc16-42ba-9c1b-71a933be341e tempest-VolumesGetTest-1105605191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:57:43 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-2be6a265-bc16-42ba-9c1b-71a933be341e tempest-VolumesGetTest-1105605191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:57:43 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2be6a265-bc16-42ba-9c1b-71a933be341e tempest-VolumesGetTest-1105605191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:43 devstack sudo[98566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:57:43 devstack sudo[98566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:44 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-3296a19b-e8bc-4d2a-8d1e-aa02811fedcd tempest-VolumesNegativeTest-1747898349 None] Created reservations ['dc23c50b-4fcb-466f-a5e5-8072f082aa84', '2f75f255-a80d-45fb-a2d2-e1142f0062fc', '85456a55-064a-4540-bea3-6ee872ffb719', '13fea602-6049-493e-89a7-384ff9cc9e24'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:57:44 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-187dd0c6-6b82-41fe-a085-d7df9468ed07 tempest-VolumesListAdminTestJSON-173451031 None] Acquiring lock "cinder-315509ff-c99e-4067-938e-2d9390a82f49-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:57:44 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-187dd0c6-6b82-41fe-a085-d7df9468ed07 tempest-VolumesListAdminTestJSON-173451031 None] Lock "cinder-315509ff-c99e-4067-938e-2d9390a82f49-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:57:44 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-187dd0c6-6b82-41fe-a085-d7df9468ed07 tempest-VolumesListAdminTestJSON-173451031 None] Acquiring lock "cinder-quobyte-315509ff-c99e-4067-938e-2d9390a82f49" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:57:44 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-3296a19b-e8bc-4d2a-8d1e-aa02811fedcd tempest-VolumesNegativeTest-1747898349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:57:44 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-3296a19b-e8bc-4d2a-8d1e-aa02811fedcd tempest-VolumesNegativeTest-1747898349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:57:44 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-3296a19b-e8bc-4d2a-8d1e-aa02811fedcd tempest-VolumesNegativeTest-1747898349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:57:44 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-3296a19b-e8bc-4d2a-8d1e-aa02811fedcd tempest-VolumesNegativeTest-1747898349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:57:44 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-3296a19b-e8bc-4d2a-8d1e-aa02811fedcd tempest-VolumesNegativeTest-1747898349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:57:44 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-3296a19b-e8bc-4d2a-8d1e-aa02811fedcd tempest-VolumesNegativeTest-1747898349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:44 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-187dd0c6-6b82-41fe-a085-d7df9468ed07 tempest-VolumesListAdminTestJSON-173451031 None] Lock "cinder-quobyte-315509ff-c99e-4067-938e-2d9390a82f49" acquired by "delete_volume" :: waited 0.064s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:57:44 devstack sudo[98568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:57:44 devstack sudo[98568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:44 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-d257d53a-43f9-46af-899b-64d6a93bd5d7 tempest-VolumesListAdminTestJSON-581800604 None] Acquiring lock "cinder-325a7115-99ac-4782-9a33-92ad52f0d21a-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:57:44 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e74e4ef-776e-449f-b44d-158549c6282f]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:57:44 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-187dd0c6-6b82-41fe-a085-d7df9468ed07 tempest-VolumesListAdminTestJSON-173451031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-315509ff-c99e-4067-938e-2d9390a82f49 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:44 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-d257d53a-43f9-46af-899b-64d6a93bd5d7 tempest-VolumesListAdminTestJSON-581800604 None] Lock "cinder-325a7115-99ac-4782-9a33-92ad52f0d21a-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:57:44 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-d257d53a-43f9-46af-899b-64d6a93bd5d7 tempest-VolumesListAdminTestJSON-581800604 None] Acquiring lock "cinder-quobyte-325a7115-99ac-4782-9a33-92ad52f0d21a" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:57:44 devstack sudo[98566]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:44 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-d257d53a-43f9-46af-899b-64d6a93bd5d7 tempest-VolumesListAdminTestJSON-581800604 None] Lock "cinder-quobyte-325a7115-99ac-4782-9a33-92ad52f0d21a" acquired by "delete_volume" :: waited 0.028s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:57:44 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2be6a265-bc16-42ba-9c1b-71a933be341e tempest-VolumesGetTest-1105605191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.482s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:44 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-2be6a265-bc16-42ba-9c1b-71a933be341e tempest-VolumesGetTest-1105605191 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:57:44 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-2be6a265-bc16-42ba-9c1b-71a933be341e tempest-VolumesGetTest-1105605191 None] Deleted volume successfully. Jul 30 16:57:44 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6a5a9d-1c9d-452a-b208-2a39d3b50ef7]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:57:44 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d257d53a-43f9-46af-899b-64d6a93bd5d7 tempest-VolumesListAdminTestJSON-581800604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-325a7115-99ac-4782-9a33-92ad52f0d21a {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:44 devstack sudo[98570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-315509ff-c99e-4067-938e-2d9390a82f49 Jul 30 16:57:44 devstack sudo[98570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:44 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-2be6a265-bc16-42ba-9c1b-71a933be341e tempest-VolumesGetTest-1105605191 None] Lock "cinder-bb117abb-baa4-4399-b111-905737ffb092-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:57:44 devstack sudo[98568]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:44 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-3296a19b-e8bc-4d2a-8d1e-aa02811fedcd tempest-VolumesNegativeTest-1747898349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.464s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:44 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-3296a19b-e8bc-4d2a-8d1e-aa02811fedcd tempest-VolumesNegativeTest-1747898349 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:57:44 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-3296a19b-e8bc-4d2a-8d1e-aa02811fedcd tempest-VolumesNegativeTest-1747898349 None] Deleted volume successfully. Jul 30 16:57:44 devstack sudo[98573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-325a7115-99ac-4782-9a33-92ad52f0d21a Jul 30 16:57:44 devstack sudo[98573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:44 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-3296a19b-e8bc-4d2a-8d1e-aa02811fedcd tempest-VolumesNegativeTest-1747898349 None] Lock "cinder-78ad9ec4-5502-430a-bd9b-0d8cac6f502f-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:57:44 devstack sudo[98570]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:44 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-187dd0c6-6b82-41fe-a085-d7df9468ed07 tempest-VolumesListAdminTestJSON-173451031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-315509ff-c99e-4067-938e-2d9390a82f49" returned: 0 in 0.600s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:44 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-187dd0c6-6b82-41fe-a085-d7df9468ed07 tempest-VolumesListAdminTestJSON-173451031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-315509ff-c99e-4067-938e-2d9390a82f49 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:44 devstack sudo[98580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-315509ff-c99e-4067-938e-2d9390a82f49 Jul 30 16:57:44 devstack sudo[98580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:44 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3976166-a5fa-49b6-b5f6-66e2ceb8ebe4 tempest-VolumesGetTest-1105605191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:57:44 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b3976166-a5fa-49b6-b5f6-66e2ceb8ebe4 tempest-VolumesGetTest-1105605191 None] Flow 'volume_create_manager' (b6057f5a-26fe-487c-ae2f-de96d133e959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:57:44 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b3976166-a5fa-49b6-b5f6-66e2ceb8ebe4 tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50c84363-65b5-4cec-b891-88a0c8a5d5f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:45 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b3976166-a5fa-49b6-b5f6-66e2ceb8ebe4 tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50c84363-65b5-4cec-b891-88a0c8a5d5f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:57:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2018336913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b8dc950-4be8-4cc8-93aa-c3f832fa961f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bea33560340472bac2e4927a1080f4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:57:45Z,use_quota=True,user_id='7079e6f8867c456bbafdd16180e334f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:45 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b3976166-a5fa-49b6-b5f6-66e2ceb8ebe4 tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6a33797-5d84-4eb1-a80a-3c345520bd44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:45 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b3976166-a5fa-49b6-b5f6-66e2ceb8ebe4 tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6a33797-5d84-4eb1-a80a-3c345520bd44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:45 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b3976166-a5fa-49b6-b5f6-66e2ceb8ebe4 tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2da27a4e-db5c-4bf2-9e07-492db6a5882a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:45 devstack sudo[98573]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:45 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b3976166-a5fa-49b6-b5f6-66e2ceb8ebe4 tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2da27a4e-db5c-4bf2-9e07-492db6a5882a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b8dc950-4be8-4cc8-93aa-c3f832fa961f', 'volume_name': 'volume-0b8dc950-4be8-4cc8-93aa-c3f832fa961f', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:45 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b3976166-a5fa-49b6-b5f6-66e2ceb8ebe4 tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c19beef3-7221-4bf9-9722-078a6af6305c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:45 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b3976166-a5fa-49b6-b5f6-66e2ceb8ebe4 tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c19beef3-7221-4bf9-9722-078a6af6305c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:45 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b3976166-a5fa-49b6-b5f6-66e2ceb8ebe4 tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a9acbfe-288b-4f90-9749-21c6dcf7eea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:45 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-b3976166-a5fa-49b6-b5f6-66e2ceb8ebe4 tempest-VolumesGetTest-1105605191 None] Volume 0b8dc950-4be8-4cc8-93aa-c3f832fa961f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b8dc950-4be8-4cc8-93aa-c3f832fa961f', 'volume_size': 1} Jul 30 16:57:45 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-b3976166-a5fa-49b6-b5f6-66e2ceb8ebe4 tempest-VolumesGetTest-1105605191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:57:45 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-b3976166-a5fa-49b6-b5f6-66e2ceb8ebe4 tempest-VolumesGetTest-1105605191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:57:45 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-b3976166-a5fa-49b6-b5f6-66e2ceb8ebe4 tempest-VolumesGetTest-1105605191 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:57:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2018336913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b8dc950-4be8-4cc8-93aa-c3f832fa961f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bea33560340472bac2e4927a1080f4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:57:45Z,use_quota=True,user_id='7079e6f8867c456bbafdd16180e334f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:57:45 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-b3976166-a5fa-49b6-b5f6-66e2ceb8ebe4 tempest-VolumesGetTest-1105605191 None] Creating volume 0b8dc950-4be8-4cc8-93aa-c3f832fa961f {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:57:45 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-b3976166-a5fa-49b6-b5f6-66e2ceb8ebe4 tempest-VolumesGetTest-1105605191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:57:45 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-b3976166-a5fa-49b6-b5f6-66e2ceb8ebe4 tempest-VolumesGetTest-1105605191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:57:45 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-b3976166-a5fa-49b6-b5f6-66e2ceb8ebe4 tempest-VolumesGetTest-1105605191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:57:45 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-b3976166-a5fa-49b6-b5f6-66e2ceb8ebe4 tempest-VolumesGetTest-1105605191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:57:45 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-b3976166-a5fa-49b6-b5f6-66e2ceb8ebe4 tempest-VolumesGetTest-1105605191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:57:45 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-b3976166-a5fa-49b6-b5f6-66e2ceb8ebe4 tempest-VolumesGetTest-1105605191 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:57:45 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-b3976166-a5fa-49b6-b5f6-66e2ceb8ebe4 tempest-VolumesGetTest-1105605191 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 16:57:45 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-b3976166-a5fa-49b6-b5f6-66e2ceb8ebe4 tempest-VolumesGetTest-1105605191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0b8dc950-4be8-4cc8-93aa-c3f832fa961f 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:45 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d257d53a-43f9-46af-899b-64d6a93bd5d7 tempest-VolumesListAdminTestJSON-581800604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-325a7115-99ac-4782-9a33-92ad52f0d21a" returned: 0 in 0.597s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:45 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d257d53a-43f9-46af-899b-64d6a93bd5d7 tempest-VolumesListAdminTestJSON-581800604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-325a7115-99ac-4782-9a33-92ad52f0d21a {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:45 devstack sudo[98585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0b8dc950-4be8-4cc8-93aa-c3f832fa961f 1073741824 Jul 30 16:57:45 devstack sudo[98585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:45 devstack sudo[98586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-325a7115-99ac-4782-9a33-92ad52f0d21a Jul 30 16:57:45 devstack sudo[98586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:45 devstack sudo[98580]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:45 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-187dd0c6-6b82-41fe-a085-d7df9468ed07 tempest-VolumesListAdminTestJSON-173451031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-315509ff-c99e-4067-938e-2d9390a82f49" returned: 0 in 0.342s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:45 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-187dd0c6-6b82-41fe-a085-d7df9468ed07 tempest-VolumesListAdminTestJSON-173451031 None] Lock "cinder-quobyte-315509ff-c99e-4067-938e-2d9390a82f49" released by "delete_volume" :: held 1.034s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:57:45 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-187dd0c6-6b82-41fe-a085-d7df9468ed07 tempest-VolumesListAdminTestJSON-173451031 None] Created reservations ['9ec57bc3-f956-472d-9fd3-63d87ec992b3', '2175402b-f8c6-4266-8a49-8683c05472fe', 'bc6fbc09-072e-4dfc-a876-689d680f1e93', 'db8f6633-caff-4a60-ac61-ab0e9a9235db'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:57:45 devstack sudo[98586]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:45 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d257d53a-43f9-46af-899b-64d6a93bd5d7 tempest-VolumesListAdminTestJSON-581800604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-325a7115-99ac-4782-9a33-92ad52f0d21a" returned: 0 in 0.292s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:45 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-d257d53a-43f9-46af-899b-64d6a93bd5d7 tempest-VolumesListAdminTestJSON-581800604 None] Lock "cinder-quobyte-325a7115-99ac-4782-9a33-92ad52f0d21a" released by "delete_volume" :: held 0.967s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:57:45 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-187dd0c6-6b82-41fe-a085-d7df9468ed07 tempest-VolumesListAdminTestJSON-173451031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:57:45 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-187dd0c6-6b82-41fe-a085-d7df9468ed07 tempest-VolumesListAdminTestJSON-173451031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:57:45 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-187dd0c6-6b82-41fe-a085-d7df9468ed07 tempest-VolumesListAdminTestJSON-173451031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:57:45 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-187dd0c6-6b82-41fe-a085-d7df9468ed07 tempest-VolumesListAdminTestJSON-173451031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:57:45 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-187dd0c6-6b82-41fe-a085-d7df9468ed07 tempest-VolumesListAdminTestJSON-173451031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:57:45 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-187dd0c6-6b82-41fe-a085-d7df9468ed07 tempest-VolumesListAdminTestJSON-173451031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:45 devstack sudo[98594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:57:45 devstack sudo[98594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:45 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-d257d53a-43f9-46af-899b-64d6a93bd5d7 tempest-VolumesListAdminTestJSON-581800604 None] Created reservations ['0c0360c1-1930-4042-bb4b-1a7fc1f1e604', 'a27d4aa8-fd51-4a0a-9ee9-3510a9b82162', '1f010086-aac3-4d4e-91bb-813fbd63a019', 'd5cf16f2-8600-49f2-ba41-852350f691bc'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:57:45 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-d257d53a-43f9-46af-899b-64d6a93bd5d7 tempest-VolumesListAdminTestJSON-581800604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:57:45 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-d257d53a-43f9-46af-899b-64d6a93bd5d7 tempest-VolumesListAdminTestJSON-581800604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:57:45 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-d257d53a-43f9-46af-899b-64d6a93bd5d7 tempest-VolumesListAdminTestJSON-581800604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:57:45 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-d257d53a-43f9-46af-899b-64d6a93bd5d7 tempest-VolumesListAdminTestJSON-581800604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:57:45 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-d257d53a-43f9-46af-899b-64d6a93bd5d7 tempest-VolumesListAdminTestJSON-581800604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:57:45 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d257d53a-43f9-46af-899b-64d6a93bd5d7 tempest-VolumesListAdminTestJSON-581800604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:45 devstack sudo[98597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:57:45 devstack sudo[98597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:45 devstack sudo[98585]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:45 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-b3976166-a5fa-49b6-b5f6-66e2ceb8ebe4 tempest-VolumesGetTest-1105605191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0b8dc950-4be8-4cc8-93aa-c3f832fa961f 1073741824" returned: 0 in 0.693s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:45 devstack sudo[98594]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:45 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-b3976166-a5fa-49b6-b5f6-66e2ceb8ebe4 tempest-VolumesGetTest-1105605191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0b8dc950-4be8-4cc8-93aa-c3f832fa961f {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:45 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-187dd0c6-6b82-41fe-a085-d7df9468ed07 tempest-VolumesListAdminTestJSON-173451031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.396s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:45 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-187dd0c6-6b82-41fe-a085-d7df9468ed07 tempest-VolumesListAdminTestJSON-173451031 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:57:45 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-187dd0c6-6b82-41fe-a085-d7df9468ed07 tempest-VolumesListAdminTestJSON-173451031 None] Deleted volume successfully. Jul 30 16:57:45 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-187dd0c6-6b82-41fe-a085-d7df9468ed07 tempest-VolumesListAdminTestJSON-173451031 None] Lock "cinder-315509ff-c99e-4067-938e-2d9390a82f49-delete_volume" released by "delete_volume" :: held 1.772s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:57:45 devstack sudo[98600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0b8dc950-4be8-4cc8-93aa-c3f832fa961f Jul 30 16:57:45 devstack sudo[98600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:45 devstack sudo[98597]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:45 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d257d53a-43f9-46af-899b-64d6a93bd5d7 tempest-VolumesListAdminTestJSON-581800604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.334s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:45 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-d257d53a-43f9-46af-899b-64d6a93bd5d7 tempest-VolumesListAdminTestJSON-581800604 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:57:46 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-d257d53a-43f9-46af-899b-64d6a93bd5d7 tempest-VolumesListAdminTestJSON-581800604 None] Deleted volume successfully. Jul 30 16:57:46 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-d257d53a-43f9-46af-899b-64d6a93bd5d7 tempest-VolumesListAdminTestJSON-581800604 None] Lock "cinder-325a7115-99ac-4782-9a33-92ad52f0d21a-delete_volume" released by "delete_volume" :: held 1.714s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:57:46 devstack sudo[98600]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:46 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-b3976166-a5fa-49b6-b5f6-66e2ceb8ebe4 tempest-VolumesGetTest-1105605191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0b8dc950-4be8-4cc8-93aa-c3f832fa961f" returned: 0 in 0.314s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:46 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-b3976166-a5fa-49b6-b5f6-66e2ceb8ebe4 tempest-VolumesGetTest-1105605191 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:57:46 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-b3976166-a5fa-49b6-b5f6-66e2ceb8ebe4 tempest-VolumesGetTest-1105605191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:57:46 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b3976166-a5fa-49b6-b5f6-66e2ceb8ebe4 tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a9acbfe-288b-4f90-9749-21c6dcf7eea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b8dc950-4be8-4cc8-93aa-c3f832fa961f', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:46 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b3976166-a5fa-49b6-b5f6-66e2ceb8ebe4 tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efb2e4aa-8b75-4764-b96a-1f1eb9318bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:46 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-b3976166-a5fa-49b6-b5f6-66e2ceb8ebe4 tempest-VolumesGetTest-1105605191 None] Volume volume-0b8dc950-4be8-4cc8-93aa-c3f832fa961f (0b8dc950-4be8-4cc8-93aa-c3f832fa961f): created successfully Jul 30 16:57:46 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b3976166-a5fa-49b6-b5f6-66e2ceb8ebe4 tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efb2e4aa-8b75-4764-b96a-1f1eb9318bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:46 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b3976166-a5fa-49b6-b5f6-66e2ceb8ebe4 tempest-VolumesGetTest-1105605191 None] Flow 'volume_create_manager' (b6057f5a-26fe-487c-ae2f-de96d133e959) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:57:46 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-b3976166-a5fa-49b6-b5f6-66e2ceb8ebe4 tempest-VolumesGetTest-1105605191 None] Created volume successfully. Jul 30 16:57:46 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-7897651c-8166-4f1e-bdf7-a146a2857c47 tempest-VolumesListAdminTestJSON-581800604 None] Acquiring lock "cinder-d437fe76-02f0-4576-b7db-cac1d096c3d2-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:57:46 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-7897651c-8166-4f1e-bdf7-a146a2857c47 tempest-VolumesListAdminTestJSON-581800604 None] Lock "cinder-d437fe76-02f0-4576-b7db-cac1d096c3d2-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:57:46 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-7897651c-8166-4f1e-bdf7-a146a2857c47 tempest-VolumesListAdminTestJSON-581800604 None] Acquiring lock "cinder-quobyte-d437fe76-02f0-4576-b7db-cac1d096c3d2" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:57:46 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-7897651c-8166-4f1e-bdf7-a146a2857c47 tempest-VolumesListAdminTestJSON-581800604 None] Lock "cinder-quobyte-d437fe76-02f0-4576-b7db-cac1d096c3d2" acquired by "delete_volume" :: waited 0.017s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:57:46 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40432bd-05a5-4e2d-aea5-6d359f6f9860]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:57:46 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7897651c-8166-4f1e-bdf7-a146a2857c47 tempest-VolumesListAdminTestJSON-581800604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d437fe76-02f0-4576-b7db-cac1d096c3d2 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:46 devstack sudo[98609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d437fe76-02f0-4576-b7db-cac1d096c3d2 Jul 30 16:57:46 devstack sudo[98609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:47 devstack sudo[98609]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7897651c-8166-4f1e-bdf7-a146a2857c47 tempest-VolumesListAdminTestJSON-581800604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d437fe76-02f0-4576-b7db-cac1d096c3d2" returned: 0 in 0.546s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7897651c-8166-4f1e-bdf7-a146a2857c47 tempest-VolumesListAdminTestJSON-581800604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d437fe76-02f0-4576-b7db-cac1d096c3d2 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:47 devstack sudo[98617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d437fe76-02f0-4576-b7db-cac1d096c3d2 Jul 30 16:57:47 devstack sudo[98617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:47 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-b17f688e-49b0-4a49-840c-35c1c1fc93f5 tempest-AttachVolumeNegativeTest-1037417113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:57:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b17f688e-49b0-4a49-840c-35c1c1fc93f5 tempest-AttachVolumeNegativeTest-1037417113 None] Flow 'volume_create_manager' (80f92960-c27e-4509-a420-59e48abb35ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:57:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b17f688e-49b0-4a49-840c-35c1c1fc93f5 tempest-AttachVolumeNegativeTest-1037417113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9aa957fc-811c-46ec-aa90-6719871c5cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b17f688e-49b0-4a49-840c-35c1c1fc93f5 tempest-AttachVolumeNegativeTest-1037417113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9aa957fc-811c-46ec-aa90-6719871c5cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:57:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1373632625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15525624-5a95-43ed-b3e2-6ffbbb3c22ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9e601affb8f4aecbadcf75c60187e20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:57:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:57:47Z,use_quota=True,user_id='6bbe8f4a440a4bf18642093e7843287b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b17f688e-49b0-4a49-840c-35c1c1fc93f5 tempest-AttachVolumeNegativeTest-1037417113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (732e3815-6a5e-4ddb-b1f1-99173c5dc233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b17f688e-49b0-4a49-840c-35c1c1fc93f5 tempest-AttachVolumeNegativeTest-1037417113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (732e3815-6a5e-4ddb-b1f1-99173c5dc233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b17f688e-49b0-4a49-840c-35c1c1fc93f5 tempest-AttachVolumeNegativeTest-1037417113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aea2cfe5-b15f-4a1f-ac23-59bf90052fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b17f688e-49b0-4a49-840c-35c1c1fc93f5 tempest-AttachVolumeNegativeTest-1037417113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aea2cfe5-b15f-4a1f-ac23-59bf90052fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15525624-5a95-43ed-b3e2-6ffbbb3c22ed', 'volume_name': 'volume-15525624-5a95-43ed-b3e2-6ffbbb3c22ed', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b17f688e-49b0-4a49-840c-35c1c1fc93f5 tempest-AttachVolumeNegativeTest-1037417113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfaeaf96-7292-45e8-8cb9-fecbb2d28e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b17f688e-49b0-4a49-840c-35c1c1fc93f5 tempest-AttachVolumeNegativeTest-1037417113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfaeaf96-7292-45e8-8cb9-fecbb2d28e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b17f688e-49b0-4a49-840c-35c1c1fc93f5 tempest-AttachVolumeNegativeTest-1037417113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51a9560e-44ab-4603-b8c8-22a74c641f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:47 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-b17f688e-49b0-4a49-840c-35c1c1fc93f5 tempest-AttachVolumeNegativeTest-1037417113 None] Volume 15525624-5a95-43ed-b3e2-6ffbbb3c22ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15525624-5a95-43ed-b3e2-6ffbbb3c22ed', 'volume_size': 1} Jul 30 16:57:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-b17f688e-49b0-4a49-840c-35c1c1fc93f5 tempest-AttachVolumeNegativeTest-1037417113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:57:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-b17f688e-49b0-4a49-840c-35c1c1fc93f5 tempest-AttachVolumeNegativeTest-1037417113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:57:47 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-b17f688e-49b0-4a49-840c-35c1c1fc93f5 tempest-AttachVolumeNegativeTest-1037417113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:57:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1373632625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15525624-5a95-43ed-b3e2-6ffbbb3c22ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9e601affb8f4aecbadcf75c60187e20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:57:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:57:47Z,use_quota=True,user_id='6bbe8f4a440a4bf18642093e7843287b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:57:47 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-b17f688e-49b0-4a49-840c-35c1c1fc93f5 tempest-AttachVolumeNegativeTest-1037417113 None] Creating volume 15525624-5a95-43ed-b3e2-6ffbbb3c22ed {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:57:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-b17f688e-49b0-4a49-840c-35c1c1fc93f5 tempest-AttachVolumeNegativeTest-1037417113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:57:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-b17f688e-49b0-4a49-840c-35c1c1fc93f5 tempest-AttachVolumeNegativeTest-1037417113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:57:47 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-b17f688e-49b0-4a49-840c-35c1c1fc93f5 tempest-AttachVolumeNegativeTest-1037417113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:57:47 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-b17f688e-49b0-4a49-840c-35c1c1fc93f5 tempest-AttachVolumeNegativeTest-1037417113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:57:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-b17f688e-49b0-4a49-840c-35c1c1fc93f5 tempest-AttachVolumeNegativeTest-1037417113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:57:47 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-b17f688e-49b0-4a49-840c-35c1c1fc93f5 tempest-AttachVolumeNegativeTest-1037417113 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:57:47 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-b17f688e-49b0-4a49-840c-35c1c1fc93f5 tempest-AttachVolumeNegativeTest-1037417113 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 16:57:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-b17f688e-49b0-4a49-840c-35c1c1fc93f5 tempest-AttachVolumeNegativeTest-1037417113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-15525624-5a95-43ed-b3e2-6ffbbb3c22ed 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:47 devstack sudo[98619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-15525624-5a95-43ed-b3e2-6ffbbb3c22ed 1073741824 Jul 30 16:57:47 devstack sudo[98619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:47 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8bf6fb1-40f8-402a-b49b-ba01569abfb1 tempest-VolumesGetTest-1105605191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:57:47 devstack sudo[98617]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f8bf6fb1-40f8-402a-b49b-ba01569abfb1 tempest-VolumesGetTest-1105605191 None] Flow 'volume_create_manager' (5fdee5ad-e700-4451-bf56-0a2dbfcd612e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:57:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f8bf6fb1-40f8-402a-b49b-ba01569abfb1 tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77e2c9bc-d8c7-43e7-abee-8d2946a5b095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7897651c-8166-4f1e-bdf7-a146a2857c47 tempest-VolumesListAdminTestJSON-581800604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d437fe76-02f0-4576-b7db-cac1d096c3d2" returned: 0 in 0.511s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f8bf6fb1-40f8-402a-b49b-ba01569abfb1 tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77e2c9bc-d8c7-43e7-abee-8d2946a5b095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:57:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1654055333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fb46d06-76cc-4b67-b64c-8631ab0d05ab,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0bea33560340472bac2e4927a1080f4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:57:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=0b8dc950-4be8-4cc8-93aa-c3f832fa961f,status='creating',terminated_at=None,updated_at=2026-07-30T14:57:48Z,use_quota=True,user_id='7079e6f8867c456bbafdd16180e334f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f8bf6fb1-40f8-402a-b49b-ba01569abfb1 tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e89f22c0-059b-4e7c-8720-98ed8de3b9b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f8bf6fb1-40f8-402a-b49b-ba01569abfb1 tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e89f22c0-059b-4e7c-8720-98ed8de3b9b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f8bf6fb1-40f8-402a-b49b-ba01569abfb1 tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9a8fe93-26d9-4fbe-ae60-0c73e64dea03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:47 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-7897651c-8166-4f1e-bdf7-a146a2857c47 tempest-VolumesListAdminTestJSON-581800604 None] Lock "cinder-quobyte-d437fe76-02f0-4576-b7db-cac1d096c3d2" released by "delete_volume" :: held 1.160s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:57:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f8bf6fb1-40f8-402a-b49b-ba01569abfb1 tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9a8fe93-26d9-4fbe-ae60-0c73e64dea03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '8fb46d06-76cc-4b67-b64c-8631ab0d05ab', 'volume_name': 'volume-8fb46d06-76cc-4b67-b64c-8631ab0d05ab', 'volume_size': 1, 'source_volid': '0b8dc950-4be8-4cc8-93aa-c3f832fa961f', 'source_volstatus': 'available'}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f8bf6fb1-40f8-402a-b49b-ba01569abfb1 tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05e157fa-ecbf-430f-8d03-220469afa0ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f8bf6fb1-40f8-402a-b49b-ba01569abfb1 tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05e157fa-ecbf-430f-8d03-220469afa0ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f8bf6fb1-40f8-402a-b49b-ba01569abfb1 tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (540e6e69-9e05-440a-9e9d-57dce0a7b075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:47 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-f8bf6fb1-40f8-402a-b49b-ba01569abfb1 tempest-VolumesGetTest-1105605191 None] Volume 8fb46d06-76cc-4b67-b64c-8631ab0d05ab: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-8fb46d06-76cc-4b67-b64c-8631ab0d05ab', 'volume_size': 1, 'source_volid': '0b8dc950-4be8-4cc8-93aa-c3f832fa961f', 'source_volstatus': 'available'} Jul 30 16:57:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-f8bf6fb1-40f8-402a-b49b-ba01569abfb1 tempest-VolumesGetTest-1105605191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:57:48 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-7897651c-8166-4f1e-bdf7-a146a2857c47 tempest-VolumesListAdminTestJSON-581800604 None] Created reservations ['ff06b529-a8b8-4d38-b7c9-b93e2be49f40', 'e3c3fd55-8fd0-4761-840f-e01c43a14065', '7baa5d11-721a-4fa7-a7ed-9575aedc5208', '4044cd65-c546-49c1-841c-1981bd9625c8'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:57:48 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-7897651c-8166-4f1e-bdf7-a146a2857c47 tempest-VolumesListAdminTestJSON-581800604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:57:48 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-7897651c-8166-4f1e-bdf7-a146a2857c47 tempest-VolumesListAdminTestJSON-581800604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:57:48 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-7897651c-8166-4f1e-bdf7-a146a2857c47 tempest-VolumesListAdminTestJSON-581800604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:57:48 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-7897651c-8166-4f1e-bdf7-a146a2857c47 tempest-VolumesListAdminTestJSON-581800604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:57:48 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-7897651c-8166-4f1e-bdf7-a146a2857c47 tempest-VolumesListAdminTestJSON-581800604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:57:48 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7897651c-8166-4f1e-bdf7-a146a2857c47 tempest-VolumesListAdminTestJSON-581800604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:48 devstack sudo[98626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:57:48 devstack sudo[98626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:48 devstack sudo[98619]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:48 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-b17f688e-49b0-4a49-840c-35c1c1fc93f5 tempest-AttachVolumeNegativeTest-1037417113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-15525624-5a95-43ed-b3e2-6ffbbb3c22ed 1073741824" returned: 0 in 0.622s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:48 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-b17f688e-49b0-4a49-840c-35c1c1fc93f5 tempest-AttachVolumeNegativeTest-1037417113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-15525624-5a95-43ed-b3e2-6ffbbb3c22ed {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:48 devstack sudo[98628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-15525624-5a95-43ed-b3e2-6ffbbb3c22ed Jul 30 16:57:48 devstack sudo[98628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:48 devstack sudo[98626]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:48 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7897651c-8166-4f1e-bdf7-a146a2857c47 tempest-VolumesListAdminTestJSON-581800604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.298s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:48 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-7897651c-8166-4f1e-bdf7-a146a2857c47 tempest-VolumesListAdminTestJSON-581800604 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:57:48 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-7897651c-8166-4f1e-bdf7-a146a2857c47 tempest-VolumesListAdminTestJSON-581800604 None] Deleted volume successfully. Jul 30 16:57:48 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-7897651c-8166-4f1e-bdf7-a146a2857c47 tempest-VolumesListAdminTestJSON-581800604 None] Lock "cinder-d437fe76-02f0-4576-b7db-cac1d096c3d2-delete_volume" released by "delete_volume" :: held 1.747s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:57:48 devstack sudo[98628]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:48 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-b17f688e-49b0-4a49-840c-35c1c1fc93f5 tempest-AttachVolumeNegativeTest-1037417113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-15525624-5a95-43ed-b3e2-6ffbbb3c22ed" returned: 0 in 0.338s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:48 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-b17f688e-49b0-4a49-840c-35c1c1fc93f5 tempest-AttachVolumeNegativeTest-1037417113 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:57:48 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-b17f688e-49b0-4a49-840c-35c1c1fc93f5 tempest-AttachVolumeNegativeTest-1037417113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:57:48 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-f8bf6fb1-40f8-402a-b49b-ba01569abfb1 tempest-VolumesGetTest-1105605191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.604s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:57:48 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-f8bf6fb1-40f8-402a-b49b-ba01569abfb1 tempest-VolumesGetTest-1105605191 None] Cloning volume 0b8dc950-4be8-4cc8-93aa-c3f832fa961f to volume 8fb46d06-76cc-4b67-b64c-8631ab0d05ab Jul 30 16:57:48 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b17f688e-49b0-4a49-840c-35c1c1fc93f5 tempest-AttachVolumeNegativeTest-1037417113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51a9560e-44ab-4603-b8c8-22a74c641f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15525624-5a95-43ed-b3e2-6ffbbb3c22ed', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:48 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b17f688e-49b0-4a49-840c-35c1c1fc93f5 tempest-AttachVolumeNegativeTest-1037417113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afcbe7e9-0afb-4dad-a7d3-b90a4f091365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:48 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-f8bf6fb1-40f8-402a-b49b-ba01569abfb1 tempest-VolumesGetTest-1105605191 None] Creating offline snapshot 6d02c654-99a8-409e-9bf4-b7b070e1cffd of volume 0b8dc950-4be8-4cc8-93aa-c3f832fa961f {{(pid=88568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:57:48 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-b17f688e-49b0-4a49-840c-35c1c1fc93f5 tempest-AttachVolumeNegativeTest-1037417113 None] Volume volume-15525624-5a95-43ed-b3e2-6ffbbb3c22ed (15525624-5a95-43ed-b3e2-6ffbbb3c22ed): created successfully Jul 30 16:57:48 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b17f688e-49b0-4a49-840c-35c1c1fc93f5 tempest-AttachVolumeNegativeTest-1037417113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afcbe7e9-0afb-4dad-a7d3-b90a4f091365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:48 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b17f688e-49b0-4a49-840c-35c1c1fc93f5 tempest-AttachVolumeNegativeTest-1037417113 None] Flow 'volume_create_manager' (80f92960-c27e-4509-a420-59e48abb35ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:57:48 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[6948ab81-3c81-48fa-a194-cfc8cdb57054]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:57:48 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f8bf6fb1-40f8-402a-b49b-ba01569abfb1 tempest-VolumesGetTest-1105605191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0b8dc950-4be8-4cc8-93aa-c3f832fa961f {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:48 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-b17f688e-49b0-4a49-840c-35c1c1fc93f5 tempest-AttachVolumeNegativeTest-1037417113 None] Created volume successfully. Jul 30 16:57:48 devstack sudo[98632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0b8dc950-4be8-4cc8-93aa-c3f832fa961f Jul 30 16:57:48 devstack sudo[98632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:49 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-04544e5f-04a6-48aa-b039-748a4dc31fd3 tempest-VolumesListAdminTestJSON-581800604 None] Acquiring lock "cinder-65b1f227-3baa-4121-8b70-c691d6e9b5cd-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:57:49 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-04544e5f-04a6-48aa-b039-748a4dc31fd3 tempest-VolumesListAdminTestJSON-581800604 None] Lock "cinder-65b1f227-3baa-4121-8b70-c691d6e9b5cd-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:57:49 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-04544e5f-04a6-48aa-b039-748a4dc31fd3 tempest-VolumesListAdminTestJSON-581800604 None] Acquiring lock "cinder-quobyte-65b1f227-3baa-4121-8b70-c691d6e9b5cd" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:57:49 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-04544e5f-04a6-48aa-b039-748a4dc31fd3 tempest-VolumesListAdminTestJSON-581800604 None] Lock "cinder-quobyte-65b1f227-3baa-4121-8b70-c691d6e9b5cd" acquired by "delete_volume" :: waited 0.022s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:57:49 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[f67b0674-ed5f-40f7-be38-9e5cb0e37f94]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:57:49 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-04544e5f-04a6-48aa-b039-748a4dc31fd3 tempest-VolumesListAdminTestJSON-581800604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-65b1f227-3baa-4121-8b70-c691d6e9b5cd {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:49 devstack sudo[98632]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:49 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f8bf6fb1-40f8-402a-b49b-ba01569abfb1 tempest-VolumesGetTest-1105605191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0b8dc950-4be8-4cc8-93aa-c3f832fa961f" returned: 0 in 0.460s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:49 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f8bf6fb1-40f8-402a-b49b-ba01569abfb1 tempest-VolumesGetTest-1105605191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0b8dc950-4be8-4cc8-93aa-c3f832fa961f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0b8dc950-4be8-4cc8-93aa-c3f832fa961f.6d02c654-99a8-409e-9bf4-b7b070e1cffd 1G {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:49 devstack sudo[98638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0b8dc950-4be8-4cc8-93aa-c3f832fa961f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0b8dc950-4be8-4cc8-93aa-c3f832fa961f.6d02c654-99a8-409e-9bf4-b7b070e1cffd 1G Jul 30 16:57:49 devstack sudo[98638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:49 devstack sudo[98637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-65b1f227-3baa-4121-8b70-c691d6e9b5cd Jul 30 16:57:49 devstack sudo[98637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:49 devstack sudo[98637]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:49 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-04544e5f-04a6-48aa-b039-748a4dc31fd3 tempest-VolumesListAdminTestJSON-581800604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-65b1f227-3baa-4121-8b70-c691d6e9b5cd" returned: 0 in 0.571s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:49 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-04544e5f-04a6-48aa-b039-748a4dc31fd3 tempest-VolumesListAdminTestJSON-581800604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-65b1f227-3baa-4121-8b70-c691d6e9b5cd {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:49 devstack sudo[98652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-65b1f227-3baa-4121-8b70-c691d6e9b5cd Jul 30 16:57:49 devstack sudo[98652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:49 devstack sudo[98638]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:49 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f8bf6fb1-40f8-402a-b49b-ba01569abfb1 tempest-VolumesGetTest-1105605191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0b8dc950-4be8-4cc8-93aa-c3f832fa961f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0b8dc950-4be8-4cc8-93aa-c3f832fa961f.6d02c654-99a8-409e-9bf4-b7b070e1cffd 1G" returned: 0 in 0.631s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:49 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f8bf6fb1-40f8-402a-b49b-ba01569abfb1 tempest-VolumesGetTest-1105605191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b8dc950-4be8-4cc8-93aa-c3f832fa961f -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0b8dc950-4be8-4cc8-93aa-c3f832fa961f.6d02c654-99a8-409e-9bf4-b7b070e1cffd {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:49 devstack sudo[98654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b8dc950-4be8-4cc8-93aa-c3f832fa961f -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0b8dc950-4be8-4cc8-93aa-c3f832fa961f.6d02c654-99a8-409e-9bf4-b7b070e1cffd Jul 30 16:57:49 devstack sudo[98654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:50 devstack sudo[98652]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-04544e5f-04a6-48aa-b039-748a4dc31fd3 tempest-VolumesListAdminTestJSON-581800604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-65b1f227-3baa-4121-8b70-c691d6e9b5cd" returned: 0 in 0.348s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:50 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-04544e5f-04a6-48aa-b039-748a4dc31fd3 tempest-VolumesListAdminTestJSON-581800604 None] Lock "cinder-quobyte-65b1f227-3baa-4121-8b70-c691d6e9b5cd" released by "delete_volume" :: held 0.970s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:57:50 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-04544e5f-04a6-48aa-b039-748a4dc31fd3 tempest-VolumesListAdminTestJSON-581800604 None] Created reservations ['b9ff4f0c-86e4-42fa-9558-d10b3d492495', '02fabc82-4825-42ab-97e2-e619174ce1f9', '48db3588-fc77-4c3c-b262-65eac7ea020f', '3065e291-ec2c-4ac7-a5be-b9ce21258354'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:57:50 devstack sudo[98654]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f8bf6fb1-40f8-402a-b49b-ba01569abfb1 tempest-VolumesGetTest-1105605191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b8dc950-4be8-4cc8-93aa-c3f832fa961f -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0b8dc950-4be8-4cc8-93aa-c3f832fa961f.6d02c654-99a8-409e-9bf4-b7b070e1cffd" returned: 0 in 0.448s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:50 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-f8bf6fb1-40f8-402a-b49b-ba01569abfb1 tempest-VolumesGetTest-1105605191 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0b8dc950-4be8-4cc8-93aa-c3f832fa961f.6d02c654-99a8-409e-9bf4-b7b070e1cffd is being set with open permissions: ugo+rw Jul 30 16:57:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f8bf6fb1-40f8-402a-b49b-ba01569abfb1 tempest-VolumesGetTest-1105605191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0b8dc950-4be8-4cc8-93aa-c3f832fa961f.6d02c654-99a8-409e-9bf4-b7b070e1cffd {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:50 devstack sudo[98660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0b8dc950-4be8-4cc8-93aa-c3f832fa961f.6d02c654-99a8-409e-9bf4-b7b070e1cffd Jul 30 16:57:50 devstack sudo[98660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-04544e5f-04a6-48aa-b039-748a4dc31fd3 tempest-VolumesListAdminTestJSON-581800604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:57:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-04544e5f-04a6-48aa-b039-748a4dc31fd3 tempest-VolumesListAdminTestJSON-581800604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:57:50 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-04544e5f-04a6-48aa-b039-748a4dc31fd3 tempest-VolumesListAdminTestJSON-581800604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:57:50 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-04544e5f-04a6-48aa-b039-748a4dc31fd3 tempest-VolumesListAdminTestJSON-581800604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:57:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-04544e5f-04a6-48aa-b039-748a4dc31fd3 tempest-VolumesListAdminTestJSON-581800604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:57:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-04544e5f-04a6-48aa-b039-748a4dc31fd3 tempest-VolumesListAdminTestJSON-581800604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:50 devstack sudo[98662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:57:50 devstack sudo[98662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:50 devstack sudo[98660]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f8bf6fb1-40f8-402a-b49b-ba01569abfb1 tempest-VolumesGetTest-1105605191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0b8dc950-4be8-4cc8-93aa-c3f832fa961f.6d02c654-99a8-409e-9bf4-b7b070e1cffd" returned: 0 in 0.378s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f8bf6fb1-40f8-402a-b49b-ba01569abfb1 tempest-VolumesGetTest-1105605191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0b8dc950-4be8-4cc8-93aa-c3f832fa961f.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:50 devstack sudo[98674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0b8dc950-4be8-4cc8-93aa-c3f832fa961f.info Jul 30 16:57:50 devstack sudo[98674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:50 devstack sudo[98662]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-04544e5f-04a6-48aa-b039-748a4dc31fd3 tempest-VolumesListAdminTestJSON-581800604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.351s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:50 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-04544e5f-04a6-48aa-b039-748a4dc31fd3 tempest-VolumesListAdminTestJSON-581800604 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:57:50 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-04544e5f-04a6-48aa-b039-748a4dc31fd3 tempest-VolumesListAdminTestJSON-581800604 None] Deleted volume successfully. Jul 30 16:57:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-dbeab380-26d0-4dc8-bd39-939b6d9c5b9f req-166f5e10-fcbd-4b41-95ea-b12e505391cd tempest-AttachVolumeNegativeTest-1037417113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:57:50 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-04544e5f-04a6-48aa-b039-748a4dc31fd3 tempest-VolumesListAdminTestJSON-581800604 None] Lock "cinder-65b1f227-3baa-4121-8b70-c691d6e9b5cd-delete_volume" released by "delete_volume" :: held 1.732s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:57:50 devstack sudo[98674]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f8bf6fb1-40f8-402a-b49b-ba01569abfb1 tempest-VolumesGetTest-1105605191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0b8dc950-4be8-4cc8-93aa-c3f832fa961f.info" returned: 0 in 0.265s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:50 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-f8bf6fb1-40f8-402a-b49b-ba01569abfb1 tempest-VolumesGetTest-1105605191 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0b8dc950-4be8-4cc8-93aa-c3f832fa961f.info is being set with open permissions: ugo+rw Jul 30 16:57:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f8bf6fb1-40f8-402a-b49b-ba01569abfb1 tempest-VolumesGetTest-1105605191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0b8dc950-4be8-4cc8-93aa-c3f832fa961f.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:51 devstack sudo[98677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0b8dc950-4be8-4cc8-93aa-c3f832fa961f.info Jul 30 16:57:51 devstack sudo[98677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:51 devstack sudo[98677]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f8bf6fb1-40f8-402a-b49b-ba01569abfb1 tempest-VolumesGetTest-1105605191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0b8dc950-4be8-4cc8-93aa-c3f832fa961f.info" returned: 0 in 0.247s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:51 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-f8bf6fb1-40f8-402a-b49b-ba01569abfb1 tempest-VolumesGetTest-1105605191 None] Acquiring lock "cinder-quobyte-8fb46d06-76cc-4b67-b64c-8631ab0d05ab" by "_copy_volume_from_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:57:51 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-f8bf6fb1-40f8-402a-b49b-ba01569abfb1 tempest-VolumesGetTest-1105605191 None] Lock "cinder-quobyte-8fb46d06-76cc-4b67-b64c-8631ab0d05ab" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:57:51 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-f8bf6fb1-40f8-402a-b49b-ba01569abfb1 tempest-VolumesGetTest-1105605191 None] snapshot: 6d02c654-99a8-409e-9bf4-b7b070e1cffd, volume: 8fb46d06-76cc-4b67-b64c-8631ab0d05ab, {{(pid=88568) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 30 16:57:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-f8bf6fb1-40f8-402a-b49b-ba01569abfb1 tempest-VolumesGetTest-1105605191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:57:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-f8bf6fb1-40f8-402a-b49b-ba01569abfb1 tempest-VolumesGetTest-1105605191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:57:51 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-f8bf6fb1-40f8-402a-b49b-ba01569abfb1 tempest-VolumesGetTest-1105605191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:57:51 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-f8bf6fb1-40f8-402a-b49b-ba01569abfb1 tempest-VolumesGetTest-1105605191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:57:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-f8bf6fb1-40f8-402a-b49b-ba01569abfb1 tempest-VolumesGetTest-1105605191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:57:51 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9422f09-9f0c-45a0-8bf0-58163654baf4]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:57:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f8bf6fb1-40f8-402a-b49b-ba01569abfb1 tempest-VolumesGetTest-1105605191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0b8dc950-4be8-4cc8-93aa-c3f832fa961f.6d02c654-99a8-409e-9bf4-b7b070e1cffd {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:51 devstack sudo[98680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0b8dc950-4be8-4cc8-93aa-c3f832fa961f.6d02c654-99a8-409e-9bf4-b7b070e1cffd Jul 30 16:57:51 devstack sudo[98680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:51 devstack sudo[98680]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f8bf6fb1-40f8-402a-b49b-ba01569abfb1 tempest-VolumesGetTest-1105605191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0b8dc950-4be8-4cc8-93aa-c3f832fa961f.6d02c654-99a8-409e-9bf4-b7b070e1cffd" returned: 0 in 0.551s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:51 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-f8bf6fb1-40f8-402a-b49b-ba01569abfb1 tempest-VolumesGetTest-1105605191 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b8dc950-4be8-4cc8-93aa-c3f832fa961f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:57:51 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ead1fd-cc12-4021-b955-b9c425a3abc1]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:57:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f8bf6fb1-40f8-402a-b49b-ba01569abfb1 tempest-VolumesGetTest-1105605191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0b8dc950-4be8-4cc8-93aa-c3f832fa961f {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:52 devstack sudo[98685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0b8dc950-4be8-4cc8-93aa-c3f832fa961f Jul 30 16:57:52 devstack sudo[98685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:52 devstack sudo[98685]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f8bf6fb1-40f8-402a-b49b-ba01569abfb1 tempest-VolumesGetTest-1105605191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0b8dc950-4be8-4cc8-93aa-c3f832fa961f" returned: 0 in 0.426s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:52 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-f8bf6fb1-40f8-402a-b49b-ba01569abfb1 tempest-VolumesGetTest-1105605191 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0b8dc950-4be8-4cc8-93aa-c3f832fa961f {{(pid=88568) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 30 16:57:52 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-f8bf6fb1-40f8-402a-b49b-ba01569abfb1 tempest-VolumesGetTest-1105605191 None] Creating direct copy from snapshot {{(pid=88568) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 30 16:57:52 devstack cinder-volume[88568]: DEBUG cinder.utils [None req-f8bf6fb1-40f8-402a-b49b-ba01569abfb1 tempest-VolumesGetTest-1105605191 None] Path /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8fb46d06-76cc-4b67-b64c-8631ab0d05ab not found in is_blk_device check {{(pid=88568) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 30 16:57:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f8bf6fb1-40f8-402a-b49b-ba01569abfb1 tempest-VolumesGetTest-1105605191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0b8dc950-4be8-4cc8-93aa-c3f832fa961f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8fb46d06-76cc-4b67-b64c-8631ab0d05ab {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:52 devstack sudo[98690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0b8dc950-4be8-4cc8-93aa-c3f832fa961f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8fb46d06-76cc-4b67-b64c-8631ab0d05ab Jul 30 16:57:52 devstack sudo[98690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:52 devstack cinder-volume[88568]: DEBUG oslo_service.periodic_task [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:57:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:57:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:57:52 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:57:52 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:57:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:57:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:52 devstack sudo[98692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:57:52 devstack sudo[98692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:52 devstack sudo[98692]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.377s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:52 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:57:52 devstack cinder-volume[88568]: DEBUG oslo_service.periodic_task [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Running periodic task VolumeManager._thread_info {{(pid=88568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:57:52 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] thread count: 28 {{(pid=88568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:57:52 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] thread info: [<_MainThread(MainThread, started 127406866608256)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:57:58 devstack sudo[98690]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f8bf6fb1-40f8-402a-b49b-ba01569abfb1 tempest-VolumesGetTest-1105605191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0b8dc950-4be8-4cc8-93aa-c3f832fa961f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8fb46d06-76cc-4b67-b64c-8631ab0d05ab" returned: 0 in 6.402s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:58 devstack cinder-volume[88568]: DEBUG cinder.image.image_utils [None req-f8bf6fb1-40f8-402a-b49b-ba01569abfb1 tempest-VolumesGetTest-1105605191 None] Image conversion details: src /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0b8dc950-4be8-4cc8-93aa-c3f832fa961f, size 1024.00 MB, duration 6.40 sec, destination /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8fb46d06-76cc-4b67-b64c-8631ab0d05ab {{(pid=88568) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 16:57:58 devstack cinder-volume[88568]: INFO cinder.image.image_utils [None req-f8bf6fb1-40f8-402a-b49b-ba01569abfb1 tempest-VolumesGetTest-1105605191 None] Converted 1024.00 MB image at 159.92 MB/s Jul 30 16:57:58 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-f8bf6fb1-40f8-402a-b49b-ba01569abfb1 tempest-VolumesGetTest-1105605191 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8fb46d06-76cc-4b67-b64c-8631ab0d05ab is being set with open permissions: ugo+rw Jul 30 16:57:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f8bf6fb1-40f8-402a-b49b-ba01569abfb1 tempest-VolumesGetTest-1105605191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8fb46d06-76cc-4b67-b64c-8631ab0d05ab {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:58 devstack sudo[98715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8fb46d06-76cc-4b67-b64c-8631ab0d05ab Jul 30 16:57:58 devstack sudo[98715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:59 devstack sudo[98715]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f8bf6fb1-40f8-402a-b49b-ba01569abfb1 tempest-VolumesGetTest-1105605191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8fb46d06-76cc-4b67-b64c-8631ab0d05ab" returned: 0 in 0.378s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:59 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-f8bf6fb1-40f8-402a-b49b-ba01569abfb1 tempest-VolumesGetTest-1105605191 None] Lock "cinder-quobyte-8fb46d06-76cc-4b67-b64c-8631ab0d05ab" released by "_copy_volume_from_snapshot" :: held 7.859s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:57:59 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-f8bf6fb1-40f8-402a-b49b-ba01569abfb1 tempest-VolumesGetTest-1105605191 None] Acquiring lock "cinder-quobyte-6d02c654-99a8-409e-9bf4-b7b070e1cffd" by "_delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:57:59 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-f8bf6fb1-40f8-402a-b49b-ba01569abfb1 tempest-VolumesGetTest-1105605191 None] Lock "cinder-quobyte-6d02c654-99a8-409e-9bf4-b7b070e1cffd" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:57:59 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-f8bf6fb1-40f8-402a-b49b-ba01569abfb1 tempest-VolumesGetTest-1105605191 None] Deleting offline snapshot 6d02c654-99a8-409e-9bf4-b7b070e1cffd of volume 0b8dc950-4be8-4cc8-93aa-c3f832fa961f {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:57:59 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-f8bf6fb1-40f8-402a-b49b-ba01569abfb1 tempest-VolumesGetTest-1105605191 None] snapshot_file for this snap is: volume-0b8dc950-4be8-4cc8-93aa-c3f832fa961f.6d02c654-99a8-409e-9bf4-b7b070e1cffd {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:57:59 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc82d62-cc53-4b97-a89c-231c6aa5198e]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:57:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f8bf6fb1-40f8-402a-b49b-ba01569abfb1 tempest-VolumesGetTest-1105605191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0b8dc950-4be8-4cc8-93aa-c3f832fa961f.6d02c654-99a8-409e-9bf4-b7b070e1cffd {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:59 devstack sudo[98718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0b8dc950-4be8-4cc8-93aa-c3f832fa961f.6d02c654-99a8-409e-9bf4-b7b070e1cffd Jul 30 16:57:59 devstack sudo[98718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:59 devstack sudo[98718]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f8bf6fb1-40f8-402a-b49b-ba01569abfb1 tempest-VolumesGetTest-1105605191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0b8dc950-4be8-4cc8-93aa-c3f832fa961f.6d02c654-99a8-409e-9bf4-b7b070e1cffd" returned: 0 in 0.438s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:59 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-f8bf6fb1-40f8-402a-b49b-ba01569abfb1 tempest-VolumesGetTest-1105605191 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b8dc950-4be8-4cc8-93aa-c3f832fa961f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:57:59 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e853b8-ba24-475b-9833-e512b7141678]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:57:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f8bf6fb1-40f8-402a-b49b-ba01569abfb1 tempest-VolumesGetTest-1105605191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0b8dc950-4be8-4cc8-93aa-c3f832fa961f {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:59 devstack sudo[98723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0b8dc950-4be8-4cc8-93aa-c3f832fa961f Jul 30 16:57:59 devstack sudo[98723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:00 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2189d40-0a08-4c24-ad6a-491d6d474359 tempest-VolumesDeleteCascade-824361553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:58:00 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f2189d40-0a08-4c24-ad6a-491d6d474359 tempest-VolumesDeleteCascade-824361553 None] Flow 'volume_create_manager' (0ead04be-3039-4d72-b35c-f34a3e9cbac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:58:00 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f2189d40-0a08-4c24-ad6a-491d6d474359 tempest-VolumesDeleteCascade-824361553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28c546ac-45a9-45ed-b610-1741becb88d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:00 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f2189d40-0a08-4c24-ad6a-491d6d474359 tempest-VolumesDeleteCascade-824361553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28c546ac-45a9-45ed-b610-1741becb88d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:58:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-376824239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02b5ace3-528d-4d8b-8344-80ac87b41bd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d24cfc404784d1fa2288ea0de5982de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:58:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:58:00Z,use_quota=True,user_id='472c553d709946489f0703e6c0c6e054',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:00 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f2189d40-0a08-4c24-ad6a-491d6d474359 tempest-VolumesDeleteCascade-824361553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32ef4215-8767-4b22-a7ca-8b40dae8e85b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:00 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f2189d40-0a08-4c24-ad6a-491d6d474359 tempest-VolumesDeleteCascade-824361553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32ef4215-8767-4b22-a7ca-8b40dae8e85b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:00 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f2189d40-0a08-4c24-ad6a-491d6d474359 tempest-VolumesDeleteCascade-824361553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12125e77-1257-49c9-8a78-c4049cff5d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:00 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f2189d40-0a08-4c24-ad6a-491d6d474359 tempest-VolumesDeleteCascade-824361553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12125e77-1257-49c9-8a78-c4049cff5d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02b5ace3-528d-4d8b-8344-80ac87b41bd6', 'volume_name': 'volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:00 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f2189d40-0a08-4c24-ad6a-491d6d474359 tempest-VolumesDeleteCascade-824361553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31f9fec1-63a5-48a5-9791-75b8e0092a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:00 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f2189d40-0a08-4c24-ad6a-491d6d474359 tempest-VolumesDeleteCascade-824361553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31f9fec1-63a5-48a5-9791-75b8e0092a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:00 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f2189d40-0a08-4c24-ad6a-491d6d474359 tempest-VolumesDeleteCascade-824361553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec75f312-1676-4bbc-9f43-17c22378ee12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:00 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-f2189d40-0a08-4c24-ad6a-491d6d474359 tempest-VolumesDeleteCascade-824361553 None] Volume 02b5ace3-528d-4d8b-8344-80ac87b41bd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6', 'volume_size': 1} Jul 30 16:58:00 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-f2189d40-0a08-4c24-ad6a-491d6d474359 tempest-VolumesDeleteCascade-824361553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:58:00 devstack sudo[98723]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:00 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f8bf6fb1-40f8-402a-b49b-ba01569abfb1 tempest-VolumesGetTest-1105605191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0b8dc950-4be8-4cc8-93aa-c3f832fa961f" returned: 0 in 0.696s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:00 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f8bf6fb1-40f8-402a-b49b-ba01569abfb1 tempest-VolumesGetTest-1105605191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0b8dc950-4be8-4cc8-93aa-c3f832fa961f.6d02c654-99a8-409e-9bf4-b7b070e1cffd {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:00 devstack sudo[98728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0b8dc950-4be8-4cc8-93aa-c3f832fa961f.6d02c654-99a8-409e-9bf4-b7b070e1cffd Jul 30 16:58:00 devstack sudo[98728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:00 devstack sudo[98728]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:00 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f8bf6fb1-40f8-402a-b49b-ba01569abfb1 tempest-VolumesGetTest-1105605191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0b8dc950-4be8-4cc8-93aa-c3f832fa961f.6d02c654-99a8-409e-9bf4-b7b070e1cffd" returned: 0 in 0.358s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:00 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f8bf6fb1-40f8-402a-b49b-ba01569abfb1 tempest-VolumesGetTest-1105605191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0b8dc950-4be8-4cc8-93aa-c3f832fa961f.6d02c654-99a8-409e-9bf4-b7b070e1cffd {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:00 devstack sudo[98733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0b8dc950-4be8-4cc8-93aa-c3f832fa961f.6d02c654-99a8-409e-9bf4-b7b070e1cffd Jul 30 16:58:00 devstack sudo[98733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:01 devstack sudo[98733]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f8bf6fb1-40f8-402a-b49b-ba01569abfb1 tempest-VolumesGetTest-1105605191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0b8dc950-4be8-4cc8-93aa-c3f832fa961f.6d02c654-99a8-409e-9bf4-b7b070e1cffd" returned: 0 in 0.266s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:01 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-f8bf6fb1-40f8-402a-b49b-ba01569abfb1 tempest-VolumesGetTest-1105605191 None] Lock "cinder-quobyte-6d02c654-99a8-409e-9bf4-b7b070e1cffd" released by "_delete_snapshot" :: held 1.926s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:58:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-f8bf6fb1-40f8-402a-b49b-ba01569abfb1 tempest-VolumesGetTest-1105605191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.557s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:58:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-dbeab380-26d0-4dc8-bd39-939b6d9c5b9f req-166f5e10-fcbd-4b41-95ea-b12e505391cd tempest-AttachVolumeNegativeTest-1037417113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 10.340s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:58:01 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f8bf6fb1-40f8-402a-b49b-ba01569abfb1 tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (540e6e69-9e05-440a-9e9d-57dce0a7b075) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fb46d06-76cc-4b67-b64c-8631ab0d05ab', 'volume_size': 1, 'source_volid': '0b8dc950-4be8-4cc8-93aa-c3f832fa961f', 'source_volstatus': 'available'}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:01 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f8bf6fb1-40f8-402a-b49b-ba01569abfb1 tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fcaa6eb-77bb-4286-b946-178409962ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-dbeab380-26d0-4dc8-bd39-939b6d9c5b9f req-166f5e10-fcbd-4b41-95ea-b12e505391cd tempest-AttachVolumeNegativeTest-1037417113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.037s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:58:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-f2189d40-0a08-4c24-ad6a-491d6d474359 tempest-VolumesDeleteCascade-824361553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.918s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:58:01 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-f2189d40-0a08-4c24-ad6a-491d6d474359 tempest-VolumesDeleteCascade-824361553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:58:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-376824239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02b5ace3-528d-4d8b-8344-80ac87b41bd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d24cfc404784d1fa2288ea0de5982de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:58:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:58:00Z,use_quota=True,user_id='472c553d709946489f0703e6c0c6e054',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:58:01 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-f2189d40-0a08-4c24-ad6a-491d6d474359 tempest-VolumesDeleteCascade-824361553 None] Creating volume 02b5ace3-528d-4d8b-8344-80ac87b41bd6 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:58:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-f2189d40-0a08-4c24-ad6a-491d6d474359 tempest-VolumesDeleteCascade-824361553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:58:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-f2189d40-0a08-4c24-ad6a-491d6d474359 tempest-VolumesDeleteCascade-824361553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:58:01 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-f2189d40-0a08-4c24-ad6a-491d6d474359 tempest-VolumesDeleteCascade-824361553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:58:01 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-f2189d40-0a08-4c24-ad6a-491d6d474359 tempest-VolumesDeleteCascade-824361553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:58:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-f2189d40-0a08-4c24-ad6a-491d6d474359 tempest-VolumesDeleteCascade-824361553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:58:01 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-f2189d40-0a08-4c24-ad6a-491d6d474359 tempest-VolumesDeleteCascade-824361553 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:58:01 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-f2189d40-0a08-4c24-ad6a-491d6d474359 tempest-VolumesDeleteCascade-824361553 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 16:58:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f2189d40-0a08-4c24-ad6a-491d6d474359 tempest-VolumesDeleteCascade-824361553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:01 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-f8bf6fb1-40f8-402a-b49b-ba01569abfb1 tempest-VolumesGetTest-1105605191 None] Volume volume-8fb46d06-76cc-4b67-b64c-8631ab0d05ab (8fb46d06-76cc-4b67-b64c-8631ab0d05ab): created successfully Jul 30 16:58:01 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f8bf6fb1-40f8-402a-b49b-ba01569abfb1 tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fcaa6eb-77bb-4286-b946-178409962ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:01 devstack sudo[98736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6 1073741824 Jul 30 16:58:01 devstack sudo[98736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:01 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f8bf6fb1-40f8-402a-b49b-ba01569abfb1 tempest-VolumesGetTest-1105605191 None] Flow 'volume_create_manager' (5fdee5ad-e700-4451-bf56-0a2dbfcd612e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:58:01 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-f8bf6fb1-40f8-402a-b49b-ba01569abfb1 tempest-VolumesGetTest-1105605191 None] Created volume successfully. Jul 30 16:58:01 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [req-dbeab380-26d0-4dc8-bd39-939b6d9c5b9f req-166f5e10-fcbd-4b41-95ea-b12e505391cd tempest-AttachVolumeNegativeTest-1037417113 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924', 'name': 'volume-15525624-5a95-43ed-b3e2-6ffbbb3c22ed', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '59115859-1728-422d-8907-db4081886c11', 'enforce_multipath': True} {{(pid=88568) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 16:58:01 devstack cinder-volume[88568]: INFO cinder.volume.manager [req-dbeab380-26d0-4dc8-bd39-939b6d9c5b9f req-166f5e10-fcbd-4b41-95ea-b12e505391cd tempest-AttachVolumeNegativeTest-1037417113 None] attachment_update completed successfully. Jul 30 16:58:01 devstack sudo[98736]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f2189d40-0a08-4c24-ad6a-491d6d474359 tempest-VolumesDeleteCascade-824361553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6 1073741824" returned: 0 in 0.537s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f2189d40-0a08-4c24-ad6a-491d6d474359 tempest-VolumesDeleteCascade-824361553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:01 devstack sudo[99124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6 Jul 30 16:58:01 devstack sudo[99124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:02 devstack sudo[99124]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f2189d40-0a08-4c24-ad6a-491d6d474359 tempest-VolumesDeleteCascade-824361553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6" returned: 0 in 0.295s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:02 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-f2189d40-0a08-4c24-ad6a-491d6d474359 tempest-VolumesDeleteCascade-824361553 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:58:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-f2189d40-0a08-4c24-ad6a-491d6d474359 tempest-VolumesDeleteCascade-824361553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:58:02 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f2189d40-0a08-4c24-ad6a-491d6d474359 tempest-VolumesDeleteCascade-824361553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec75f312-1676-4bbc-9f43-17c22378ee12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:02 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f2189d40-0a08-4c24-ad6a-491d6d474359 tempest-VolumesDeleteCascade-824361553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67868c2f-f49c-4127-8879-ee9dad3708b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:02 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-f2189d40-0a08-4c24-ad6a-491d6d474359 tempest-VolumesDeleteCascade-824361553 None] Volume volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6 (02b5ace3-528d-4d8b-8344-80ac87b41bd6): created successfully Jul 30 16:58:02 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f2189d40-0a08-4c24-ad6a-491d6d474359 tempest-VolumesDeleteCascade-824361553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67868c2f-f49c-4127-8879-ee9dad3708b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:02 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f2189d40-0a08-4c24-ad6a-491d6d474359 tempest-VolumesDeleteCascade-824361553 None] Flow 'volume_create_manager' (0ead04be-3039-4d72-b35c-f34a3e9cbac9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:58:02 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-f2189d40-0a08-4c24-ad6a-491d6d474359 tempest-VolumesDeleteCascade-824361553 None] Created volume successfully. Jul 30 16:58:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-22b3ab75-2d77-4936-98cd-0f6ecaa8791f tempest-VolumesDeleteCascade-824361553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:58:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-22b3ab75-2d77-4936-98cd-0f6ecaa8791f tempest-VolumesDeleteCascade-824361553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:58:02 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-22b3ab75-2d77-4936-98cd-0f6ecaa8791f tempest-VolumesDeleteCascade-824361553 None] Creating offline snapshot 3769d710-1ebf-45b5-a0ed-726acf6eebd0 of volume 02b5ace3-528d-4d8b-8344-80ac87b41bd6 {{(pid=88568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:58:02 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28d1a53-1b1e-49e4-abdd-044317a23533]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:58:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-22b3ab75-2d77-4936-98cd-0f6ecaa8791f tempest-VolumesDeleteCascade-824361553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:02 devstack sudo[99130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6 Jul 30 16:58:02 devstack sudo[99130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:03 devstack sudo[99130]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-22b3ab75-2d77-4936-98cd-0f6ecaa8791f tempest-VolumesDeleteCascade-824361553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6" returned: 0 in 0.723s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-22b3ab75-2d77-4936-98cd-0f6ecaa8791f tempest-VolumesDeleteCascade-824361553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6.3769d710-1ebf-45b5-a0ed-726acf6eebd0 1G {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:03 devstack sudo[99135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6.3769d710-1ebf-45b5-a0ed-726acf6eebd0 1G Jul 30 16:58:03 devstack sudo[99135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:03 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-27e7b4a5-cd76-41e6-9511-2d2a483fb80a tempest-VolumesGetTest-1105605191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:58:03 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-27e7b4a5-cd76-41e6-9511-2d2a483fb80a tempest-VolumesGetTest-1105605191 None] Flow 'volume_create_manager' (961b25a8-f053-4a09-8383-534b24dee41f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:58:03 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-27e7b4a5-cd76-41e6-9511-2d2a483fb80a tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30e0fe8f-0c52-437b-9de1-d6efe127d78a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:03 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-27e7b4a5-cd76-41e6-9511-2d2a483fb80a tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30e0fe8f-0c52-437b-9de1-d6efe127d78a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:58:03Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1176552468',display_name='tempest-VolumesGetTest-Volume-872761127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ad61567-71bd-44c5-a132-9e613b3653bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bea33560340472bac2e4927a1080f4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:58:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:58:04Z,use_quota=True,user_id='7079e6f8867c456bbafdd16180e334f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:03 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-27e7b4a5-cd76-41e6-9511-2d2a483fb80a tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df78294b-7f67-4342-95cc-1c0aced96edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:03 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-27e7b4a5-cd76-41e6-9511-2d2a483fb80a tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df78294b-7f67-4342-95cc-1c0aced96edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:03 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-27e7b4a5-cd76-41e6-9511-2d2a483fb80a tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e9c7930-0ff5-4752-9825-7c546b1515c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:03 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-27e7b4a5-cd76-41e6-9511-2d2a483fb80a tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e9c7930-0ff5-4752-9825-7c546b1515c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ad61567-71bd-44c5-a132-9e613b3653bb', 'volume_name': 'volume-8ad61567-71bd-44c5-a132-9e613b3653bb', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:03 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-27e7b4a5-cd76-41e6-9511-2d2a483fb80a tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ec7c932-eada-4579-bef9-b2b21e2f5130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:03 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-27e7b4a5-cd76-41e6-9511-2d2a483fb80a tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ec7c932-eada-4579-bef9-b2b21e2f5130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:03 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-27e7b4a5-cd76-41e6-9511-2d2a483fb80a tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (464e5544-f863-4a16-bbb5-5781cc0829ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:03 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-27e7b4a5-cd76-41e6-9511-2d2a483fb80a tempest-VolumesGetTest-1105605191 None] Volume 8ad61567-71bd-44c5-a132-9e613b3653bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ad61567-71bd-44c5-a132-9e613b3653bb', 'volume_size': 1} Jul 30 16:58:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-27e7b4a5-cd76-41e6-9511-2d2a483fb80a tempest-VolumesGetTest-1105605191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:58:04 devstack sudo[99135]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-22b3ab75-2d77-4936-98cd-0f6ecaa8791f tempest-VolumesDeleteCascade-824361553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6.3769d710-1ebf-45b5-a0ed-726acf6eebd0 1G" returned: 0 in 0.637s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-22b3ab75-2d77-4936-98cd-0f6ecaa8791f tempest-VolumesDeleteCascade-824361553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6.3769d710-1ebf-45b5-a0ed-726acf6eebd0 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:04 devstack sudo[99141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6.3769d710-1ebf-45b5-a0ed-726acf6eebd0 Jul 30 16:58:04 devstack sudo[99141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:04 devstack sudo[99141]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-22b3ab75-2d77-4936-98cd-0f6ecaa8791f tempest-VolumesDeleteCascade-824361553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6.3769d710-1ebf-45b5-a0ed-726acf6eebd0" returned: 0 in 0.421s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:04 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-22b3ab75-2d77-4936-98cd-0f6ecaa8791f tempest-VolumesDeleteCascade-824361553 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6.3769d710-1ebf-45b5-a0ed-726acf6eebd0 is being set with open permissions: ugo+rw Jul 30 16:58:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-22b3ab75-2d77-4936-98cd-0f6ecaa8791f tempest-VolumesDeleteCascade-824361553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6.3769d710-1ebf-45b5-a0ed-726acf6eebd0 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:04 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-815c1c5e-617f-4678-866d-e51726ba73e3 tempest-VolumesSnapshotTestJSON-1454524182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:58:04 devstack sudo[99151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6.3769d710-1ebf-45b5-a0ed-726acf6eebd0 Jul 30 16:58:04 devstack sudo[99151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:04 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-815c1c5e-617f-4678-866d-e51726ba73e3 tempest-VolumesSnapshotTestJSON-1454524182 None] Flow 'volume_create_manager' (82a1a87d-d403-42c3-b7fa-e1838a26cc76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:58:04 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-815c1c5e-617f-4678-866d-e51726ba73e3 tempest-VolumesSnapshotTestJSON-1454524182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ca0cf80-5a34-4033-b8fc-f7172a8c0414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:04 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-815c1c5e-617f-4678-866d-e51726ba73e3 tempest-VolumesSnapshotTestJSON-1454524182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ca0cf80-5a34-4033-b8fc-f7172a8c0414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:58:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2115892856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f214f25c-5e5f-48d9-8df8-8232ce1db9a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26d8b9dd9f954ebf908cd619fefa3523',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:58:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:58:05Z,use_quota=True,user_id='05c871db56e4469bbcc891874329eee6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:04 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-815c1c5e-617f-4678-866d-e51726ba73e3 tempest-VolumesSnapshotTestJSON-1454524182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d22a4da-09f8-4c2c-8c97-d35cefe63072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:04 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-815c1c5e-617f-4678-866d-e51726ba73e3 tempest-VolumesSnapshotTestJSON-1454524182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d22a4da-09f8-4c2c-8c97-d35cefe63072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:04 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-815c1c5e-617f-4678-866d-e51726ba73e3 tempest-VolumesSnapshotTestJSON-1454524182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d55216b4-34fe-423a-8b2f-aeb7548f22dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:04 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-815c1c5e-617f-4678-866d-e51726ba73e3 tempest-VolumesSnapshotTestJSON-1454524182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d55216b4-34fe-423a-8b2f-aeb7548f22dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f214f25c-5e5f-48d9-8df8-8232ce1db9a4', 'volume_name': 'volume-f214f25c-5e5f-48d9-8df8-8232ce1db9a4', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:04 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-815c1c5e-617f-4678-866d-e51726ba73e3 tempest-VolumesSnapshotTestJSON-1454524182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3289cdc-7d65-41d2-8a84-dfd7314f7c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:04 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-815c1c5e-617f-4678-866d-e51726ba73e3 tempest-VolumesSnapshotTestJSON-1454524182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3289cdc-7d65-41d2-8a84-dfd7314f7c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:04 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-815c1c5e-617f-4678-866d-e51726ba73e3 tempest-VolumesSnapshotTestJSON-1454524182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (042c18b4-eaee-4748-bff6-b4fb19f6c878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:04 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-815c1c5e-617f-4678-866d-e51726ba73e3 tempest-VolumesSnapshotTestJSON-1454524182 None] Volume f214f25c-5e5f-48d9-8df8-8232ce1db9a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f214f25c-5e5f-48d9-8df8-8232ce1db9a4', 'volume_size': 1} Jul 30 16:58:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-815c1c5e-617f-4678-866d-e51726ba73e3 tempest-VolumesSnapshotTestJSON-1454524182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:58:04 devstack cinder-volume[88568]: INFO cinder.volume.manager [req-ca0edf57-3943-426c-8ece-da5ab5552f95 req-72b158de-9c2e-4a88-821e-536436b93454 tempest-AttachVolumeNegativeTest-1037417113 None] Terminate volume connection completed successfully. Jul 30 16:58:04 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [req-ca0edf57-3943-426c-8ece-da5ab5552f95 req-72b158de-9c2e-4a88-821e-536436b93454 tempest-AttachVolumeNegativeTest-1037417113 None] Deleting attachment 59115859-1728-422d-8907-db4081886c11. {{(pid=88568) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 16:58:04 devstack sudo[99151]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-22b3ab75-2d77-4936-98cd-0f6ecaa8791f tempest-VolumesDeleteCascade-824361553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6.3769d710-1ebf-45b5-a0ed-726acf6eebd0" returned: 0 in 0.298s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-22b3ab75-2d77-4936-98cd-0f6ecaa8791f tempest-VolumesDeleteCascade-824361553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:04 devstack sudo[99181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6.info Jul 30 16:58:04 devstack sudo[99181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:05 devstack sudo[99181]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:05 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-22b3ab75-2d77-4936-98cd-0f6ecaa8791f tempest-VolumesDeleteCascade-824361553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6.info" returned: 0 in 0.271s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:05 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-22b3ab75-2d77-4936-98cd-0f6ecaa8791f tempest-VolumesDeleteCascade-824361553 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6.info is being set with open permissions: ugo+rw Jul 30 16:58:05 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-22b3ab75-2d77-4936-98cd-0f6ecaa8791f tempest-VolumesDeleteCascade-824361553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:05 devstack sudo[99184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6.info Jul 30 16:58:05 devstack sudo[99184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:05 devstack sudo[99184]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:05 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-22b3ab75-2d77-4936-98cd-0f6ecaa8791f tempest-VolumesDeleteCascade-824361553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6.info" returned: 0 in 0.258s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:05 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-22b3ab75-2d77-4936-98cd-0f6ecaa8791f tempest-VolumesDeleteCascade-824361553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.724s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:58:05 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-27e7b4a5-cd76-41e6-9511-2d2a483fb80a tempest-VolumesGetTest-1105605191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.620s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:58:05 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-27e7b4a5-cd76-41e6-9511-2d2a483fb80a tempest-VolumesGetTest-1105605191 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:58:03Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1176552468',display_name='tempest-VolumesGetTest-Volume-872761127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ad61567-71bd-44c5-a132-9e613b3653bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bea33560340472bac2e4927a1080f4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:58:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:58:04Z,use_quota=True,user_id='7079e6f8867c456bbafdd16180e334f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:58:05 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-27e7b4a5-cd76-41e6-9511-2d2a483fb80a tempest-VolumesGetTest-1105605191 None] Creating volume 8ad61567-71bd-44c5-a132-9e613b3653bb {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:58:05 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-27e7b4a5-cd76-41e6-9511-2d2a483fb80a tempest-VolumesGetTest-1105605191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:58:05 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-27e7b4a5-cd76-41e6-9511-2d2a483fb80a tempest-VolumesGetTest-1105605191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:58:05 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-27e7b4a5-cd76-41e6-9511-2d2a483fb80a tempest-VolumesGetTest-1105605191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:58:05 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-27e7b4a5-cd76-41e6-9511-2d2a483fb80a tempest-VolumesGetTest-1105605191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:58:05 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-27e7b4a5-cd76-41e6-9511-2d2a483fb80a tempest-VolumesGetTest-1105605191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:58:05 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-27e7b4a5-cd76-41e6-9511-2d2a483fb80a tempest-VolumesGetTest-1105605191 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:58:05 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-27e7b4a5-cd76-41e6-9511-2d2a483fb80a tempest-VolumesGetTest-1105605191 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 16:58:05 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-27e7b4a5-cd76-41e6-9511-2d2a483fb80a tempest-VolumesGetTest-1105605191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8ad61567-71bd-44c5-a132-9e613b3653bb 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:05 devstack sudo[99187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8ad61567-71bd-44c5-a132-9e613b3653bb 1073741824 Jul 30 16:58:05 devstack sudo[99187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:05 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-22b3ab75-2d77-4936-98cd-0f6ecaa8791f tempest-VolumesDeleteCascade-824361553 None] Create snapshot completed successfully Jul 30 16:58:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a7e691f3-5c15-4c61-904d-d4f457b0c478 tempest-VolumesDeleteCascade-824361553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:58:06 devstack sudo[99187]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-27e7b4a5-cd76-41e6-9511-2d2a483fb80a tempest-VolumesGetTest-1105605191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8ad61567-71bd-44c5-a132-9e613b3653bb 1073741824" returned: 0 in 0.633s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-27e7b4a5-cd76-41e6-9511-2d2a483fb80a tempest-VolumesGetTest-1105605191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8ad61567-71bd-44c5-a132-9e613b3653bb {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:06 devstack sudo[99209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8ad61567-71bd-44c5-a132-9e613b3653bb Jul 30 16:58:06 devstack sudo[99209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:06 devstack sudo[99209]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-27e7b4a5-cd76-41e6-9511-2d2a483fb80a tempest-VolumesGetTest-1105605191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8ad61567-71bd-44c5-a132-9e613b3653bb" returned: 0 in 0.305s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:06 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-27e7b4a5-cd76-41e6-9511-2d2a483fb80a tempest-VolumesGetTest-1105605191 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:58:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-27e7b4a5-cd76-41e6-9511-2d2a483fb80a tempest-VolumesGetTest-1105605191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:58:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-815c1c5e-617f-4678-866d-e51726ba73e3 tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.795s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:58:06 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-815c1c5e-617f-4678-866d-e51726ba73e3 tempest-VolumesSnapshotTestJSON-1454524182 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:58:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2115892856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f214f25c-5e5f-48d9-8df8-8232ce1db9a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26d8b9dd9f954ebf908cd619fefa3523',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:58:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:58:05Z,use_quota=True,user_id='05c871db56e4469bbcc891874329eee6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:58:06 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-815c1c5e-617f-4678-866d-e51726ba73e3 tempest-VolumesSnapshotTestJSON-1454524182 None] Creating volume f214f25c-5e5f-48d9-8df8-8232ce1db9a4 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:58:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-815c1c5e-617f-4678-866d-e51726ba73e3 tempest-VolumesSnapshotTestJSON-1454524182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:58:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-815c1c5e-617f-4678-866d-e51726ba73e3 tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:58:06 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-815c1c5e-617f-4678-866d-e51726ba73e3 tempest-VolumesSnapshotTestJSON-1454524182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:58:06 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-815c1c5e-617f-4678-866d-e51726ba73e3 tempest-VolumesSnapshotTestJSON-1454524182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:58:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-815c1c5e-617f-4678-866d-e51726ba73e3 tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:58:06 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-815c1c5e-617f-4678-866d-e51726ba73e3 tempest-VolumesSnapshotTestJSON-1454524182 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:58:06 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-815c1c5e-617f-4678-866d-e51726ba73e3 tempest-VolumesSnapshotTestJSON-1454524182 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 16:58:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-815c1c5e-617f-4678-866d-e51726ba73e3 tempest-VolumesSnapshotTestJSON-1454524182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f214f25c-5e5f-48d9-8df8-8232ce1db9a4 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:06 devstack sudo[99219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f214f25c-5e5f-48d9-8df8-8232ce1db9a4 1073741824 Jul 30 16:58:06 devstack sudo[99219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:06 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-27e7b4a5-cd76-41e6-9511-2d2a483fb80a tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (464e5544-f863-4a16-bbb5-5781cc0829ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ad61567-71bd-44c5-a132-9e613b3653bb', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:06 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-27e7b4a5-cd76-41e6-9511-2d2a483fb80a tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (204c9cb4-150c-4e02-9ffd-b6a5e809ad75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:06 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-27e7b4a5-cd76-41e6-9511-2d2a483fb80a tempest-VolumesGetTest-1105605191 None] Volume volume-8ad61567-71bd-44c5-a132-9e613b3653bb (8ad61567-71bd-44c5-a132-9e613b3653bb): created successfully Jul 30 16:58:06 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-27e7b4a5-cd76-41e6-9511-2d2a483fb80a tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (204c9cb4-150c-4e02-9ffd-b6a5e809ad75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:06 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-27e7b4a5-cd76-41e6-9511-2d2a483fb80a tempest-VolumesGetTest-1105605191 None] Flow 'volume_create_manager' (961b25a8-f053-4a09-8383-534b24dee41f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:58:06 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-27e7b4a5-cd76-41e6-9511-2d2a483fb80a tempest-VolumesGetTest-1105605191 None] Created volume successfully. Jul 30 16:58:06 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-961533c4-398d-42fd-8f4f-fb3ae74bfde3 tempest-VolumesGetTest-1105605191 None] Acquiring lock "cinder-8ad61567-71bd-44c5-a132-9e613b3653bb-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:58:07 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-961533c4-398d-42fd-8f4f-fb3ae74bfde3 tempest-VolumesGetTest-1105605191 None] Lock "cinder-8ad61567-71bd-44c5-a132-9e613b3653bb-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:58:07 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-961533c4-398d-42fd-8f4f-fb3ae74bfde3 tempest-VolumesGetTest-1105605191 None] Acquiring lock "cinder-quobyte-8ad61567-71bd-44c5-a132-9e613b3653bb" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:58:07 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-961533c4-398d-42fd-8f4f-fb3ae74bfde3 tempest-VolumesGetTest-1105605191 None] Lock "cinder-quobyte-8ad61567-71bd-44c5-a132-9e613b3653bb" acquired by "delete_volume" :: waited 0.019s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:58:07 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[161e92a7-bfe3-471d-9f17-710221e68288]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:58:07 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-961533c4-398d-42fd-8f4f-fb3ae74bfde3 tempest-VolumesGetTest-1105605191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8ad61567-71bd-44c5-a132-9e613b3653bb {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:07 devstack sudo[99219]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:07 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-815c1c5e-617f-4678-866d-e51726ba73e3 tempest-VolumesSnapshotTestJSON-1454524182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f214f25c-5e5f-48d9-8df8-8232ce1db9a4 1073741824" returned: 0 in 0.639s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:07 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-815c1c5e-617f-4678-866d-e51726ba73e3 tempest-VolumesSnapshotTestJSON-1454524182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f214f25c-5e5f-48d9-8df8-8232ce1db9a4 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:07 devstack sudo[99227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f214f25c-5e5f-48d9-8df8-8232ce1db9a4 Jul 30 16:58:07 devstack sudo[99227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:07 devstack sudo[99226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8ad61567-71bd-44c5-a132-9e613b3653bb Jul 30 16:58:07 devstack sudo[99226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:07 devstack sudo[99227]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:07 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-815c1c5e-617f-4678-866d-e51726ba73e3 tempest-VolumesSnapshotTestJSON-1454524182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f214f25c-5e5f-48d9-8df8-8232ce1db9a4" returned: 0 in 0.296s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:07 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-815c1c5e-617f-4678-866d-e51726ba73e3 tempest-VolumesSnapshotTestJSON-1454524182 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:58:07 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-815c1c5e-617f-4678-866d-e51726ba73e3 tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:58:07 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a7e691f3-5c15-4c61-904d-d4f457b0c478 tempest-VolumesDeleteCascade-824361553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.380s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:58:07 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-815c1c5e-617f-4678-866d-e51726ba73e3 tempest-VolumesSnapshotTestJSON-1454524182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (042c18b4-eaee-4748-bff6-b4fb19f6c878) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f214f25c-5e5f-48d9-8df8-8232ce1db9a4', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:07 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-815c1c5e-617f-4678-866d-e51726ba73e3 tempest-VolumesSnapshotTestJSON-1454524182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c701cb4d-547d-4a08-8f43-8ad4bd1d5a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:07 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-a7e691f3-5c15-4c61-904d-d4f457b0c478 tempest-VolumesDeleteCascade-824361553 None] Creating offline snapshot c7c3b151-cf8a-487c-96fc-d5439a3ca0f8 of volume 02b5ace3-528d-4d8b-8344-80ac87b41bd6 {{(pid=88568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:58:07 devstack sudo[99226]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:07 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-961533c4-398d-42fd-8f4f-fb3ae74bfde3 tempest-VolumesGetTest-1105605191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8ad61567-71bd-44c5-a132-9e613b3653bb" returned: 0 in 0.463s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:07 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-961533c4-398d-42fd-8f4f-fb3ae74bfde3 tempest-VolumesGetTest-1105605191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8ad61567-71bd-44c5-a132-9e613b3653bb {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:07 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e1323b8-dd6c-4e7b-b00b-2ad77d09aa3d]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:58:07 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a7e691f3-5c15-4c61-904d-d4f457b0c478 tempest-VolumesDeleteCascade-824361553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6.3769d710-1ebf-45b5-a0ed-726acf6eebd0 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:07 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-815c1c5e-617f-4678-866d-e51726ba73e3 tempest-VolumesSnapshotTestJSON-1454524182 None] Volume volume-f214f25c-5e5f-48d9-8df8-8232ce1db9a4 (f214f25c-5e5f-48d9-8df8-8232ce1db9a4): created successfully Jul 30 16:58:07 devstack sudo[99235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8ad61567-71bd-44c5-a132-9e613b3653bb Jul 30 16:58:07 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-815c1c5e-617f-4678-866d-e51726ba73e3 tempest-VolumesSnapshotTestJSON-1454524182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c701cb4d-547d-4a08-8f43-8ad4bd1d5a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:07 devstack sudo[99235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:07 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-815c1c5e-617f-4678-866d-e51726ba73e3 tempest-VolumesSnapshotTestJSON-1454524182 None] Flow 'volume_create_manager' (82a1a87d-d403-42c3-b7fa-e1838a26cc76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:58:07 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-815c1c5e-617f-4678-866d-e51726ba73e3 tempest-VolumesSnapshotTestJSON-1454524182 None] Created volume successfully. Jul 30 16:58:07 devstack sudo[99236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6.3769d710-1ebf-45b5-a0ed-726acf6eebd0 Jul 30 16:58:07 devstack sudo[99236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:07 devstack sudo[99235]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:07 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-961533c4-398d-42fd-8f4f-fb3ae74bfde3 tempest-VolumesGetTest-1105605191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8ad61567-71bd-44c5-a132-9e613b3653bb" returned: 0 in 0.386s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:07 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-961533c4-398d-42fd-8f4f-fb3ae74bfde3 tempest-VolumesGetTest-1105605191 None] Lock "cinder-quobyte-8ad61567-71bd-44c5-a132-9e613b3653bb" released by "delete_volume" :: held 0.905s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:58:08 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-961533c4-398d-42fd-8f4f-fb3ae74bfde3 tempest-VolumesGetTest-1105605191 None] Created reservations ['545b5051-5857-4aac-b265-7905ee9f9a86', 'e777ff10-996a-49cf-a6b4-4a61afb1df80', '0626cd39-aa5f-4d75-b4b8-d2533116139f', '75477a58-5df5-4722-a681-713ae7b6047a'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:58:08 devstack sudo[99236]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:08 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a7e691f3-5c15-4c61-904d-d4f457b0c478 tempest-VolumesDeleteCascade-824361553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6.3769d710-1ebf-45b5-a0ed-726acf6eebd0" returned: 0 in 0.536s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:08 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-a7e691f3-5c15-4c61-904d-d4f457b0c478 tempest-VolumesDeleteCascade-824361553 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:58:08 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a7e691f3-5c15-4c61-904d-d4f457b0c478 tempest-VolumesDeleteCascade-824361553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6.3769d710-1ebf-45b5-a0ed-726acf6eebd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6.c7c3b151-cf8a-487c-96fc-d5439a3ca0f8 1G {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:08 devstack sudo[99245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6.3769d710-1ebf-45b5-a0ed-726acf6eebd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6.c7c3b151-cf8a-487c-96fc-d5439a3ca0f8 1G Jul 30 16:58:08 devstack sudo[99245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:08 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-cc1ecdf0-a6a6-4902-ab33-b6100f08cc58 tempest-VolumesSnapshotTestJSON-1454524182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:58:08 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-961533c4-398d-42fd-8f4f-fb3ae74bfde3 tempest-VolumesGetTest-1105605191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:58:08 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-961533c4-398d-42fd-8f4f-fb3ae74bfde3 tempest-VolumesGetTest-1105605191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:58:08 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-961533c4-398d-42fd-8f4f-fb3ae74bfde3 tempest-VolumesGetTest-1105605191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:58:08 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-961533c4-398d-42fd-8f4f-fb3ae74bfde3 tempest-VolumesGetTest-1105605191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:58:08 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-961533c4-398d-42fd-8f4f-fb3ae74bfde3 tempest-VolumesGetTest-1105605191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:58:08 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-961533c4-398d-42fd-8f4f-fb3ae74bfde3 tempest-VolumesGetTest-1105605191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:08 devstack sudo[99247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:58:08 devstack sudo[99247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:08 devstack sudo[99247]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:08 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-961533c4-398d-42fd-8f4f-fb3ae74bfde3 tempest-VolumesGetTest-1105605191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.367s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:08 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-961533c4-398d-42fd-8f4f-fb3ae74bfde3 tempest-VolumesGetTest-1105605191 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:58:08 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-961533c4-398d-42fd-8f4f-fb3ae74bfde3 tempest-VolumesGetTest-1105605191 None] Deleted volume successfully. Jul 30 16:58:08 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-961533c4-398d-42fd-8f4f-fb3ae74bfde3 tempest-VolumesGetTest-1105605191 None] Lock "cinder-8ad61567-71bd-44c5-a132-9e613b3653bb-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:58:08 devstack sudo[99245]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:08 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a7e691f3-5c15-4c61-904d-d4f457b0c478 tempest-VolumesDeleteCascade-824361553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6.3769d710-1ebf-45b5-a0ed-726acf6eebd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6.c7c3b151-cf8a-487c-96fc-d5439a3ca0f8 1G" returned: 0 in 0.601s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:08 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a7e691f3-5c15-4c61-904d-d4f457b0c478 tempest-VolumesDeleteCascade-824361553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6.3769d710-1ebf-45b5-a0ed-726acf6eebd0 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6.c7c3b151-cf8a-487c-96fc-d5439a3ca0f8 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:08 devstack sudo[99253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6.3769d710-1ebf-45b5-a0ed-726acf6eebd0 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6.c7c3b151-cf8a-487c-96fc-d5439a3ca0f8 Jul 30 16:58:08 devstack sudo[99253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:09 devstack sudo[99253]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:09 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a7e691f3-5c15-4c61-904d-d4f457b0c478 tempest-VolumesDeleteCascade-824361553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6.3769d710-1ebf-45b5-a0ed-726acf6eebd0 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6.c7c3b151-cf8a-487c-96fc-d5439a3ca0f8" returned: 0 in 0.284s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:09 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-a7e691f3-5c15-4c61-904d-d4f457b0c478 tempest-VolumesDeleteCascade-824361553 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6.c7c3b151-cf8a-487c-96fc-d5439a3ca0f8 is being set with open permissions: ugo+rw Jul 30 16:58:09 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a7e691f3-5c15-4c61-904d-d4f457b0c478 tempest-VolumesDeleteCascade-824361553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6.c7c3b151-cf8a-487c-96fc-d5439a3ca0f8 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:09 devstack sudo[99258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6.c7c3b151-cf8a-487c-96fc-d5439a3ca0f8 Jul 30 16:58:09 devstack sudo[99258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:09 devstack sudo[99258]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:09 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a7e691f3-5c15-4c61-904d-d4f457b0c478 tempest-VolumesDeleteCascade-824361553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6.c7c3b151-cf8a-487c-96fc-d5439a3ca0f8" returned: 0 in 0.249s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:09 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a7e691f3-5c15-4c61-904d-d4f457b0c478 tempest-VolumesDeleteCascade-824361553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.799s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:58:09 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-cc1ecdf0-a6a6-4902-ab33-b6100f08cc58 tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.110s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:58:09 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-a011b16f-9a71-4d10-bcc3-df34e7962cd0 tempest-VolumesGetTest-1105605191 None] Acquiring lock "cinder-8fb46d06-76cc-4b67-b64c-8631ab0d05ab-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:58:09 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-cc1ecdf0-a6a6-4902-ab33-b6100f08cc58 tempest-VolumesSnapshotTestJSON-1454524182 None] Creating offline snapshot 8f94c25f-ce28-41bc-94d1-9f581adc6e31 of volume f214f25c-5e5f-48d9-8df8-8232ce1db9a4 {{(pid=88568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:58:09 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-a7e691f3-5c15-4c61-904d-d4f457b0c478 tempest-VolumesDeleteCascade-824361553 None] Create snapshot completed successfully Jul 30 16:58:09 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d57ac2-71c8-4657-9e70-4aa6686a07f8]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:58:09 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-a011b16f-9a71-4d10-bcc3-df34e7962cd0 tempest-VolumesGetTest-1105605191 None] Lock "cinder-8fb46d06-76cc-4b67-b64c-8631ab0d05ab-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:58:09 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-cc1ecdf0-a6a6-4902-ab33-b6100f08cc58 tempest-VolumesSnapshotTestJSON-1454524182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f214f25c-5e5f-48d9-8df8-8232ce1db9a4 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:09 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-a011b16f-9a71-4d10-bcc3-df34e7962cd0 tempest-VolumesGetTest-1105605191 None] Acquiring lock "cinder-quobyte-8fb46d06-76cc-4b67-b64c-8631ab0d05ab" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:58:09 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-a011b16f-9a71-4d10-bcc3-df34e7962cd0 tempest-VolumesGetTest-1105605191 None] Lock "cinder-quobyte-8fb46d06-76cc-4b67-b64c-8631ab0d05ab" acquired by "delete_volume" :: waited 0.024s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:58:09 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f0b725-27cc-4dfd-84d9-133a0d33825a]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:58:09 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a011b16f-9a71-4d10-bcc3-df34e7962cd0 tempest-VolumesGetTest-1105605191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8fb46d06-76cc-4b67-b64c-8631ab0d05ab {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:09 devstack sudo[99261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f214f25c-5e5f-48d9-8df8-8232ce1db9a4 Jul 30 16:58:09 devstack sudo[99261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:09 devstack sudo[99262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8fb46d06-76cc-4b67-b64c-8631ab0d05ab Jul 30 16:58:09 devstack sudo[99262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:09 devstack sudo[99261]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:09 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-cc1ecdf0-a6a6-4902-ab33-b6100f08cc58 tempest-VolumesSnapshotTestJSON-1454524182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f214f25c-5e5f-48d9-8df8-8232ce1db9a4" returned: 0 in 0.430s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:09 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-cc1ecdf0-a6a6-4902-ab33-b6100f08cc58 tempest-VolumesSnapshotTestJSON-1454524182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f214f25c-5e5f-48d9-8df8-8232ce1db9a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f214f25c-5e5f-48d9-8df8-8232ce1db9a4.8f94c25f-ce28-41bc-94d1-9f581adc6e31 1G {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:09 devstack sudo[99270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f214f25c-5e5f-48d9-8df8-8232ce1db9a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f214f25c-5e5f-48d9-8df8-8232ce1db9a4.8f94c25f-ce28-41bc-94d1-9f581adc6e31 1G Jul 30 16:58:09 devstack sudo[99270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:09 devstack sudo[99262]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:09 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a011b16f-9a71-4d10-bcc3-df34e7962cd0 tempest-VolumesGetTest-1105605191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8fb46d06-76cc-4b67-b64c-8631ab0d05ab" returned: 0 in 0.420s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:09 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a011b16f-9a71-4d10-bcc3-df34e7962cd0 tempest-VolumesGetTest-1105605191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8fb46d06-76cc-4b67-b64c-8631ab0d05ab {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:09 devstack sudo[99273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8fb46d06-76cc-4b67-b64c-8631ab0d05ab Jul 30 16:58:09 devstack sudo[99273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:10 devstack sudo[99273]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:10 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a011b16f-9a71-4d10-bcc3-df34e7962cd0 tempest-VolumesGetTest-1105605191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8fb46d06-76cc-4b67-b64c-8631ab0d05ab" returned: 0 in 0.267s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:10 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-a011b16f-9a71-4d10-bcc3-df34e7962cd0 tempest-VolumesGetTest-1105605191 None] Lock "cinder-quobyte-8fb46d06-76cc-4b67-b64c-8631ab0d05ab" released by "delete_volume" :: held 0.730s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:58:10 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-a011b16f-9a71-4d10-bcc3-df34e7962cd0 tempest-VolumesGetTest-1105605191 None] Created reservations ['010f0375-97f4-4904-9d05-1b8830114db8', 'f63d631c-7640-42d7-84b7-33561602f0eb', '299809f0-a18b-4650-a593-17503cd0aaae', '623784ac-291e-4901-9312-731924e6a52e'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:58:10 devstack sudo[99270]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:10 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-cc1ecdf0-a6a6-4902-ab33-b6100f08cc58 tempest-VolumesSnapshotTestJSON-1454524182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f214f25c-5e5f-48d9-8df8-8232ce1db9a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f214f25c-5e5f-48d9-8df8-8232ce1db9a4.8f94c25f-ce28-41bc-94d1-9f581adc6e31 1G" returned: 0 in 0.522s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:10 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-cc1ecdf0-a6a6-4902-ab33-b6100f08cc58 tempest-VolumesSnapshotTestJSON-1454524182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f214f25c-5e5f-48d9-8df8-8232ce1db9a4 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f214f25c-5e5f-48d9-8df8-8232ce1db9a4.8f94c25f-ce28-41bc-94d1-9f581adc6e31 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:10 devstack sudo[99281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f214f25c-5e5f-48d9-8df8-8232ce1db9a4 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f214f25c-5e5f-48d9-8df8-8232ce1db9a4.8f94c25f-ce28-41bc-94d1-9f581adc6e31 Jul 30 16:58:10 devstack sudo[99281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:10 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a011b16f-9a71-4d10-bcc3-df34e7962cd0 tempest-VolumesGetTest-1105605191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:58:10 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a011b16f-9a71-4d10-bcc3-df34e7962cd0 tempest-VolumesGetTest-1105605191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:58:10 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-a011b16f-9a71-4d10-bcc3-df34e7962cd0 tempest-VolumesGetTest-1105605191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:58:10 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-a011b16f-9a71-4d10-bcc3-df34e7962cd0 tempest-VolumesGetTest-1105605191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:58:10 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a011b16f-9a71-4d10-bcc3-df34e7962cd0 tempest-VolumesGetTest-1105605191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:58:10 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a011b16f-9a71-4d10-bcc3-df34e7962cd0 tempest-VolumesGetTest-1105605191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:10 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-e8d730d2-ee8d-4f18-be77-e7c7892a63d5 tempest-VolumesDeleteCascade-824361553 None] Acquiring lock "cinder-02b5ace3-528d-4d8b-8344-80ac87b41bd6-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:58:10 devstack sudo[99283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:58:10 devstack sudo[99283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:10 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-e8d730d2-ee8d-4f18-be77-e7c7892a63d5 tempest-VolumesDeleteCascade-824361553 None] Lock "cinder-02b5ace3-528d-4d8b-8344-80ac87b41bd6-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:58:10 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e8d730d2-ee8d-4f18-be77-e7c7892a63d5 tempest-VolumesDeleteCascade-824361553 None] Performing cascade delete. {{(pid=88568) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 30 16:58:10 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-e8d730d2-ee8d-4f18-be77-e7c7892a63d5 tempest-VolumesDeleteCascade-824361553 None] Acquiring lock "cinder-3769d710-1ebf-45b5-a0ed-726acf6eebd0-delete_snapshot" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:58:10 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-e8d730d2-ee8d-4f18-be77-e7c7892a63d5 tempest-VolumesDeleteCascade-824361553 None] Lock "cinder-3769d710-1ebf-45b5-a0ed-726acf6eebd0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:58:10 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-e8d730d2-ee8d-4f18-be77-e7c7892a63d5 tempest-VolumesDeleteCascade-824361553 None] Acquiring lock "cinder-quobyte-02b5ace3-528d-4d8b-8344-80ac87b41bd6" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:58:10 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-e8d730d2-ee8d-4f18-be77-e7c7892a63d5 tempest-VolumesDeleteCascade-824361553 None] Lock "cinder-quobyte-02b5ace3-528d-4d8b-8344-80ac87b41bd6" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:58:10 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-e8d730d2-ee8d-4f18-be77-e7c7892a63d5 tempest-VolumesDeleteCascade-824361553 None] Acquiring lock "cinder-quobyte-3769d710-1ebf-45b5-a0ed-726acf6eebd0" by "_delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:58:10 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-e8d730d2-ee8d-4f18-be77-e7c7892a63d5 tempest-VolumesDeleteCascade-824361553 None] Lock "cinder-quobyte-3769d710-1ebf-45b5-a0ed-726acf6eebd0" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:58:10 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-e8d730d2-ee8d-4f18-be77-e7c7892a63d5 tempest-VolumesDeleteCascade-824361553 None] Deleting offline snapshot 3769d710-1ebf-45b5-a0ed-726acf6eebd0 of volume 02b5ace3-528d-4d8b-8344-80ac87b41bd6 {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:58:10 devstack sudo[99283]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:10 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-e8d730d2-ee8d-4f18-be77-e7c7892a63d5 tempest-VolumesDeleteCascade-824361553 None] snapshot_file for this snap is: volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6.3769d710-1ebf-45b5-a0ed-726acf6eebd0 {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:58:10 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a011b16f-9a71-4d10-bcc3-df34e7962cd0 tempest-VolumesGetTest-1105605191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.359s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:10 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-a011b16f-9a71-4d10-bcc3-df34e7962cd0 tempest-VolumesGetTest-1105605191 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:58:10 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e4b2bc1-8b4d-441d-9cde-638008743d21]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:58:10 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-31d19e5d-5159-48d8-8b42-9378ccee08e3 tempest-VolumesGetTest-1105605191 None] Acquiring lock "cinder-0b8dc950-4be8-4cc8-93aa-c3f832fa961f-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:58:10 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e8d730d2-ee8d-4f18-be77-e7c7892a63d5 tempest-VolumesDeleteCascade-824361553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6.3769d710-1ebf-45b5-a0ed-726acf6eebd0 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:10 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-a011b16f-9a71-4d10-bcc3-df34e7962cd0 tempest-VolumesGetTest-1105605191 None] Deleted volume successfully. Jul 30 16:58:10 devstack sudo[99281]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:10 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-cc1ecdf0-a6a6-4902-ab33-b6100f08cc58 tempest-VolumesSnapshotTestJSON-1454524182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f214f25c-5e5f-48d9-8df8-8232ce1db9a4 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f214f25c-5e5f-48d9-8df8-8232ce1db9a4.8f94c25f-ce28-41bc-94d1-9f581adc6e31" returned: 0 in 0.508s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:10 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-cc1ecdf0-a6a6-4902-ab33-b6100f08cc58 tempest-VolumesSnapshotTestJSON-1454524182 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f214f25c-5e5f-48d9-8df8-8232ce1db9a4.8f94c25f-ce28-41bc-94d1-9f581adc6e31 is being set with open permissions: ugo+rw Jul 30 16:58:10 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-cc1ecdf0-a6a6-4902-ab33-b6100f08cc58 tempest-VolumesSnapshotTestJSON-1454524182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f214f25c-5e5f-48d9-8df8-8232ce1db9a4.8f94c25f-ce28-41bc-94d1-9f581adc6e31 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:10 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-31d19e5d-5159-48d8-8b42-9378ccee08e3 tempest-VolumesGetTest-1105605191 None] Lock "cinder-0b8dc950-4be8-4cc8-93aa-c3f832fa961f-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:58:10 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-a011b16f-9a71-4d10-bcc3-df34e7962cd0 tempest-VolumesGetTest-1105605191 None] Lock "cinder-8fb46d06-76cc-4b67-b64c-8631ab0d05ab-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:58:10 devstack sudo[99290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f214f25c-5e5f-48d9-8df8-8232ce1db9a4.8f94c25f-ce28-41bc-94d1-9f581adc6e31 Jul 30 16:58:10 devstack sudo[99290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:10 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-31d19e5d-5159-48d8-8b42-9378ccee08e3 tempest-VolumesGetTest-1105605191 None] Acquiring lock "cinder-quobyte-0b8dc950-4be8-4cc8-93aa-c3f832fa961f" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:58:10 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-31d19e5d-5159-48d8-8b42-9378ccee08e3 tempest-VolumesGetTest-1105605191 None] Lock "cinder-quobyte-0b8dc950-4be8-4cc8-93aa-c3f832fa961f" acquired by "delete_volume" :: waited 0.024s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:58:10 devstack sudo[99289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6.3769d710-1ebf-45b5-a0ed-726acf6eebd0 Jul 30 16:58:10 devstack sudo[99289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:10 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aeb21e1-57bd-4a86-8cfc-3a39efbbf426]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:58:10 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-31d19e5d-5159-48d8-8b42-9378ccee08e3 tempest-VolumesGetTest-1105605191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0b8dc950-4be8-4cc8-93aa-c3f832fa961f {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:11 devstack sudo[99293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0b8dc950-4be8-4cc8-93aa-c3f832fa961f Jul 30 16:58:11 devstack sudo[99293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:11 devstack sudo[99290]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-cc1ecdf0-a6a6-4902-ab33-b6100f08cc58 tempest-VolumesSnapshotTestJSON-1454524182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f214f25c-5e5f-48d9-8df8-8232ce1db9a4.8f94c25f-ce28-41bc-94d1-9f581adc6e31" returned: 0 in 0.325s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-cc1ecdf0-a6a6-4902-ab33-b6100f08cc58 tempest-VolumesSnapshotTestJSON-1454524182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f214f25c-5e5f-48d9-8df8-8232ce1db9a4.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:11 devstack sudo[99299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f214f25c-5e5f-48d9-8df8-8232ce1db9a4.info Jul 30 16:58:11 devstack sudo[99299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:11 devstack sudo[99289]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e8d730d2-ee8d-4f18-be77-e7c7892a63d5 tempest-VolumesDeleteCascade-824361553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6.3769d710-1ebf-45b5-a0ed-726acf6eebd0" returned: 0 in 0.493s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:11 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-e8d730d2-ee8d-4f18-be77-e7c7892a63d5 tempest-VolumesDeleteCascade-824361553 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:58:11 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[065f6854-cb2d-4cb0-bacb-9a2ed80627f8]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:58:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e8d730d2-ee8d-4f18-be77-e7c7892a63d5 tempest-VolumesDeleteCascade-824361553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:11 devstack sudo[99305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6 Jul 30 16:58:11 devstack sudo[99305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:11 devstack sudo[99293]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-31d19e5d-5159-48d8-8b42-9378ccee08e3 tempest-VolumesGetTest-1105605191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0b8dc950-4be8-4cc8-93aa-c3f832fa961f" returned: 0 in 0.485s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-31d19e5d-5159-48d8-8b42-9378ccee08e3 tempest-VolumesGetTest-1105605191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0b8dc950-4be8-4cc8-93aa-c3f832fa961f {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:11 devstack sudo[99311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0b8dc950-4be8-4cc8-93aa-c3f832fa961f Jul 30 16:58:11 devstack sudo[99311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:11 devstack sudo[99299]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-cc1ecdf0-a6a6-4902-ab33-b6100f08cc58 tempest-VolumesSnapshotTestJSON-1454524182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f214f25c-5e5f-48d9-8df8-8232ce1db9a4.info" returned: 0 in 0.343s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:11 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-cc1ecdf0-a6a6-4902-ab33-b6100f08cc58 tempest-VolumesSnapshotTestJSON-1454524182 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f214f25c-5e5f-48d9-8df8-8232ce1db9a4.info is being set with open permissions: ugo+rw Jul 30 16:58:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-cc1ecdf0-a6a6-4902-ab33-b6100f08cc58 tempest-VolumesSnapshotTestJSON-1454524182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f214f25c-5e5f-48d9-8df8-8232ce1db9a4.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:11 devstack sudo[99314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f214f25c-5e5f-48d9-8df8-8232ce1db9a4.info Jul 30 16:58:11 devstack sudo[99314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:11 devstack sudo[99305]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e8d730d2-ee8d-4f18-be77-e7c7892a63d5 tempest-VolumesDeleteCascade-824361553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6" returned: 0 in 0.455s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:11 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8e36fc-6b4c-47da-8018-cc83b6d8a15e]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:58:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e8d730d2-ee8d-4f18-be77-e7c7892a63d5 tempest-VolumesDeleteCascade-824361553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6.c7c3b151-cf8a-487c-96fc-d5439a3ca0f8 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:11 devstack sudo[99311]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-31d19e5d-5159-48d8-8b42-9378ccee08e3 tempest-VolumesGetTest-1105605191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0b8dc950-4be8-4cc8-93aa-c3f832fa961f" returned: 0 in 0.340s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:11 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-31d19e5d-5159-48d8-8b42-9378ccee08e3 tempest-VolumesGetTest-1105605191 None] Lock "cinder-quobyte-0b8dc950-4be8-4cc8-93aa-c3f832fa961f" released by "delete_volume" :: held 0.926s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:58:11 devstack sudo[99314]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-cc1ecdf0-a6a6-4902-ab33-b6100f08cc58 tempest-VolumesSnapshotTestJSON-1454524182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f214f25c-5e5f-48d9-8df8-8232ce1db9a4.info" returned: 0 in 0.351s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:11 devstack sudo[99321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6.c7c3b151-cf8a-487c-96fc-d5439a3ca0f8 Jul 30 16:58:11 devstack sudo[99321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-cc1ecdf0-a6a6-4902-ab33-b6100f08cc58 tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.630s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:58:11 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-31d19e5d-5159-48d8-8b42-9378ccee08e3 tempest-VolumesGetTest-1105605191 None] Created reservations ['83e14e86-b4c5-4f5c-88d8-6e00c94debd1', 'baa7089a-20a3-417c-8a5f-174e35a59376', 'b70dc127-ed97-475c-8577-bb2688dcf49c', 'cf497727-3d4e-48a8-868e-d62b6e3f6027'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:58:12 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-cc1ecdf0-a6a6-4902-ab33-b6100f08cc58 tempest-VolumesSnapshotTestJSON-1454524182 None] Create snapshot completed successfully Jul 30 16:58:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-31d19e5d-5159-48d8-8b42-9378ccee08e3 tempest-VolumesGetTest-1105605191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:58:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-31d19e5d-5159-48d8-8b42-9378ccee08e3 tempest-VolumesGetTest-1105605191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:58:12 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-31d19e5d-5159-48d8-8b42-9378ccee08e3 tempest-VolumesGetTest-1105605191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:58:12 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-31d19e5d-5159-48d8-8b42-9378ccee08e3 tempest-VolumesGetTest-1105605191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:58:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-31d19e5d-5159-48d8-8b42-9378ccee08e3 tempest-VolumesGetTest-1105605191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:58:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-31d19e5d-5159-48d8-8b42-9378ccee08e3 tempest-VolumesGetTest-1105605191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:12 devstack sudo[99325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:58:12 devstack sudo[99325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:12 devstack sudo[99321]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e8d730d2-ee8d-4f18-be77-e7c7892a63d5 tempest-VolumesDeleteCascade-824361553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6.c7c3b151-cf8a-487c-96fc-d5439a3ca0f8" returned: 0 in 0.398s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:12 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-e8d730d2-ee8d-4f18-be77-e7c7892a63d5 tempest-VolumesDeleteCascade-824361553 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:58:12 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d7c860-3f4b-4fc6-a2a4-b631f0e232ea]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:58:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e8d730d2-ee8d-4f18-be77-e7c7892a63d5 tempest-VolumesDeleteCascade-824361553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6.3769d710-1ebf-45b5-a0ed-726acf6eebd0 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:12 devstack sudo[99331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6.3769d710-1ebf-45b5-a0ed-726acf6eebd0 Jul 30 16:58:12 devstack sudo[99331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:12 devstack sudo[99325]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-31d19e5d-5159-48d8-8b42-9378ccee08e3 tempest-VolumesGetTest-1105605191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.293s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:12 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-31d19e5d-5159-48d8-8b42-9378ccee08e3 tempest-VolumesGetTest-1105605191 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:58:12 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-31d19e5d-5159-48d8-8b42-9378ccee08e3 tempest-VolumesGetTest-1105605191 None] Deleted volume successfully. Jul 30 16:58:12 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-31d19e5d-5159-48d8-8b42-9378ccee08e3 tempest-VolumesGetTest-1105605191 None] Lock "cinder-0b8dc950-4be8-4cc8-93aa-c3f832fa961f-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:58:12 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-c933f9ac-bad3-4761-b7fc-64f55dec64f5 tempest-VolumesSnapshotTestJSON-1454524182 None] Acquiring lock "cinder-8f94c25f-ce28-41bc-94d1-9f581adc6e31-delete_snapshot" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:58:12 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-c933f9ac-bad3-4761-b7fc-64f55dec64f5 tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "cinder-8f94c25f-ce28-41bc-94d1-9f581adc6e31-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:58:12 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-c933f9ac-bad3-4761-b7fc-64f55dec64f5 tempest-VolumesSnapshotTestJSON-1454524182 None] Acquiring lock "cinder-quobyte-f214f25c-5e5f-48d9-8df8-8232ce1db9a4" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:58:12 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-c933f9ac-bad3-4761-b7fc-64f55dec64f5 tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "cinder-quobyte-f214f25c-5e5f-48d9-8df8-8232ce1db9a4" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:58:12 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-c933f9ac-bad3-4761-b7fc-64f55dec64f5 tempest-VolumesSnapshotTestJSON-1454524182 None] Acquiring lock "cinder-quobyte-8f94c25f-ce28-41bc-94d1-9f581adc6e31" by "_delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:58:12 devstack sudo[99331]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e8d730d2-ee8d-4f18-be77-e7c7892a63d5 tempest-VolumesDeleteCascade-824361553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6.3769d710-1ebf-45b5-a0ed-726acf6eebd0" returned: 0 in 0.446s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:12 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-e8d730d2-ee8d-4f18-be77-e7c7892a63d5 tempest-VolumesDeleteCascade-824361553 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:58:12 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-c933f9ac-bad3-4761-b7fc-64f55dec64f5 tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "cinder-quobyte-8f94c25f-ce28-41bc-94d1-9f581adc6e31" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:58:12 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-c933f9ac-bad3-4761-b7fc-64f55dec64f5 tempest-VolumesSnapshotTestJSON-1454524182 None] Deleting offline snapshot 8f94c25f-ce28-41bc-94d1-9f581adc6e31 of volume f214f25c-5e5f-48d9-8df8-8232ce1db9a4 {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:58:12 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-c933f9ac-bad3-4761-b7fc-64f55dec64f5 tempest-VolumesSnapshotTestJSON-1454524182 None] snapshot_file for this snap is: volume-f214f25c-5e5f-48d9-8df8-8232ce1db9a4.8f94c25f-ce28-41bc-94d1-9f581adc6e31 {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:58:12 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[615a4212-e2c5-4261-a396-4cef8f95e423]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:58:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e8d730d2-ee8d-4f18-be77-e7c7892a63d5 tempest-VolumesDeleteCascade-824361553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:12 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9bbbd99-92d4-42e7-b7f3-2c0246b62a44]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:58:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-c933f9ac-bad3-4761-b7fc-64f55dec64f5 tempest-VolumesSnapshotTestJSON-1454524182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f214f25c-5e5f-48d9-8df8-8232ce1db9a4.8f94c25f-ce28-41bc-94d1-9f581adc6e31 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:12 devstack sudo[99339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6 Jul 30 16:58:12 devstack sudo[99339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:12 devstack sudo[99340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f214f25c-5e5f-48d9-8df8-8232ce1db9a4.8f94c25f-ce28-41bc-94d1-9f581adc6e31 Jul 30 16:58:12 devstack sudo[99340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:13 devstack sudo[99339]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e8d730d2-ee8d-4f18-be77-e7c7892a63d5 tempest-VolumesDeleteCascade-824361553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6" returned: 0 in 0.437s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e8d730d2-ee8d-4f18-be77-e7c7892a63d5 tempest-VolumesDeleteCascade-824361553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6.3769d710-1ebf-45b5-a0ed-726acf6eebd0 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:13 devstack sudo[99340]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-c933f9ac-bad3-4761-b7fc-64f55dec64f5 tempest-VolumesSnapshotTestJSON-1454524182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f214f25c-5e5f-48d9-8df8-8232ce1db9a4.8f94c25f-ce28-41bc-94d1-9f581adc6e31" returned: 0 in 0.440s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:13 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-c933f9ac-bad3-4761-b7fc-64f55dec64f5 tempest-VolumesSnapshotTestJSON-1454524182 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f214f25c-5e5f-48d9-8df8-8232ce1db9a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:58:13 devstack sudo[99354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6.3769d710-1ebf-45b5-a0ed-726acf6eebd0 Jul 30 16:58:13 devstack sudo[99354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:13 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d9d906-3d46-4773-811c-b2fffdf2e817]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:58:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-c933f9ac-bad3-4761-b7fc-64f55dec64f5 tempest-VolumesSnapshotTestJSON-1454524182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f214f25c-5e5f-48d9-8df8-8232ce1db9a4 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:13 devstack sudo[99356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f214f25c-5e5f-48d9-8df8-8232ce1db9a4 Jul 30 16:58:13 devstack sudo[99356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:13 devstack sudo[99354]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e8d730d2-ee8d-4f18-be77-e7c7892a63d5 tempest-VolumesDeleteCascade-824361553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6.3769d710-1ebf-45b5-a0ed-726acf6eebd0" returned: 0 in 0.441s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e8d730d2-ee8d-4f18-be77-e7c7892a63d5 tempest-VolumesDeleteCascade-824361553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6.3769d710-1ebf-45b5-a0ed-726acf6eebd0 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:13 devstack sudo[99365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6.3769d710-1ebf-45b5-a0ed-726acf6eebd0 Jul 30 16:58:13 devstack sudo[99365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:13 devstack sudo[99356]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-c933f9ac-bad3-4761-b7fc-64f55dec64f5 tempest-VolumesSnapshotTestJSON-1454524182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f214f25c-5e5f-48d9-8df8-8232ce1db9a4" returned: 0 in 0.463s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-c933f9ac-bad3-4761-b7fc-64f55dec64f5 tempest-VolumesSnapshotTestJSON-1454524182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f214f25c-5e5f-48d9-8df8-8232ce1db9a4.8f94c25f-ce28-41bc-94d1-9f581adc6e31 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:13 devstack sudo[99367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f214f25c-5e5f-48d9-8df8-8232ce1db9a4.8f94c25f-ce28-41bc-94d1-9f581adc6e31 Jul 30 16:58:13 devstack sudo[99367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:13 devstack sudo[99365]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e8d730d2-ee8d-4f18-be77-e7c7892a63d5 tempest-VolumesDeleteCascade-824361553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6.3769d710-1ebf-45b5-a0ed-726acf6eebd0" returned: 0 in 0.360s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e8d730d2-ee8d-4f18-be77-e7c7892a63d5 tempest-VolumesDeleteCascade-824361553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6.c7c3b151-cf8a-487c-96fc-d5439a3ca0f8 -F qcow2 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:13 devstack sudo[99370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6.c7c3b151-cf8a-487c-96fc-d5439a3ca0f8 -F qcow2 Jul 30 16:58:13 devstack sudo[99370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:13 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf41c9bc-3347-49ef-a221-2fb50c62ab41 tempest-VolumesGetTest-1105605191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:58:14 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-cf41c9bc-3347-49ef-a221-2fb50c62ab41 tempest-VolumesGetTest-1105605191 None] Flow 'volume_create_manager' (b1e240ea-7103-490a-8edb-eefd0a524244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:58:14 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-cf41c9bc-3347-49ef-a221-2fb50c62ab41 tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfd6ff00-6003-4b7e-a727-bbd1d8e50388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:14 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-cf41c9bc-3347-49ef-a221-2fb50c62ab41 tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfd6ff00-6003-4b7e-a727-bbd1d8e50388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:58:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-410080208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8817d7bc-693d-4a64-94b3-eac381a4a544,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0bea33560340472bac2e4927a1080f4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:58:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:58:14Z,use_quota=True,user_id='7079e6f8867c456bbafdd16180e334f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:14 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-cf41c9bc-3347-49ef-a221-2fb50c62ab41 tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ad89703-1452-4e98-80e4-2fe85fa56bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:14 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-cf41c9bc-3347-49ef-a221-2fb50c62ab41 tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ad89703-1452-4e98-80e4-2fe85fa56bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:14 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-cf41c9bc-3347-49ef-a221-2fb50c62ab41 tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b674961b-3ac3-4992-baef-39b397a62105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:14 devstack cinder-volume[88568]: DEBUG cinder.image.glance [None req-cf41c9bc-3347-49ef-a221-2fb50c62ab41 tempest-VolumesGetTest-1105605191 None] Creating Keystone auth plugin from conf {{(pid=88568) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 30 16:58:14 devstack sudo[99367]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-c933f9ac-bad3-4761-b7fc-64f55dec64f5 tempest-VolumesSnapshotTestJSON-1454524182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f214f25c-5e5f-48d9-8df8-8232ce1db9a4.8f94c25f-ce28-41bc-94d1-9f581adc6e31" returned: 0 in 0.511s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-c933f9ac-bad3-4761-b7fc-64f55dec64f5 tempest-VolumesSnapshotTestJSON-1454524182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f214f25c-5e5f-48d9-8df8-8232ce1db9a4.8f94c25f-ce28-41bc-94d1-9f581adc6e31 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:14 devstack sudo[99376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f214f25c-5e5f-48d9-8df8-8232ce1db9a4.8f94c25f-ce28-41bc-94d1-9f581adc6e31 Jul 30 16:58:14 devstack sudo[99376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:14 devstack sudo[99370]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e8d730d2-ee8d-4f18-be77-e7c7892a63d5 tempest-VolumesDeleteCascade-824361553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6.c7c3b151-cf8a-487c-96fc-d5439a3ca0f8 -F qcow2" returned: 0 in 0.412s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:14 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-e8d730d2-ee8d-4f18-be77-e7c7892a63d5 tempest-VolumesDeleteCascade-824361553 None] Lock "cinder-quobyte-3769d710-1ebf-45b5-a0ed-726acf6eebd0" released by "_delete_snapshot" :: held 3.677s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:58:14 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-e8d730d2-ee8d-4f18-be77-e7c7892a63d5 tempest-VolumesDeleteCascade-824361553 None] Lock "cinder-quobyte-02b5ace3-528d-4d8b-8344-80ac87b41bd6" released by "delete_snapshot" :: held 3.720s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:58:14 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-e8d730d2-ee8d-4f18-be77-e7c7892a63d5 tempest-VolumesDeleteCascade-824361553 None] Created reservations ['a41b5bb9-3884-46d4-ab54-703af744b6f6', '37772a1c-40ee-47f5-9521-20e2d7cf0040', 'e9c5287b-e5e1-44ab-8a1b-8e121da23b1e', '0e1ce7aa-9b77-4c10-b493-84104ff093a0'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:58:14 devstack sudo[99376]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-c933f9ac-bad3-4761-b7fc-64f55dec64f5 tempest-VolumesSnapshotTestJSON-1454524182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f214f25c-5e5f-48d9-8df8-8232ce1db9a4.8f94c25f-ce28-41bc-94d1-9f581adc6e31" returned: 0 in 0.371s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:14 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-cf41c9bc-3347-49ef-a221-2fb50c62ab41 tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b674961b-3ac3-4992-baef-39b397a62105) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8817d7bc-693d-4a64-94b3-eac381a4a544', 'volume_name': 'volume-8817d7bc-693d-4a64-94b3-eac381a4a544', 'volume_size': 1, 'image_id': '6126230f-0fba-48b9-943c-1885f4fc4be0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6126230f-0fba-48b9-943c-1885f4fc4be0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2802aa975ace4011a130c68c7a9c96bb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6126230f-0fba-48b9-943c-1885f4fc4be0', 'created_at': datetime.datetime(2026, 7, 30, 14, 43, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 43, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6126230f-0fba-48b9-943c-1885f4fc4be0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:14 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-cf41c9bc-3347-49ef-a221-2fb50c62ab41 tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd7a1303-1a07-4086-986d-f587695660d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:14 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-cf41c9bc-3347-49ef-a221-2fb50c62ab41 tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd7a1303-1a07-4086-986d-f587695660d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:14 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-cf41c9bc-3347-49ef-a221-2fb50c62ab41 tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ef06790-75cc-44f2-9cb7-927208b80de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:14 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-cf41c9bc-3347-49ef-a221-2fb50c62ab41 tempest-VolumesGetTest-1105605191 None] Volume 8817d7bc-693d-4a64-94b3-eac381a4a544: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8817d7bc-693d-4a64-94b3-eac381a4a544', 'volume_size': 1, 'image_id': '6126230f-0fba-48b9-943c-1885f4fc4be0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6126230f-0fba-48b9-943c-1885f4fc4be0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2802aa975ace4011a130c68c7a9c96bb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6126230f-0fba-48b9-943c-1885f4fc4be0', 'created_at': datetime.datetime(2026, 7, 30, 14, 43, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 43, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6126230f-0fba-48b9-943c-1885f4fc4be0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 30 16:58:14 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf41c9bc-3347-49ef-a221-2fb50c62ab41 tempest-VolumesGetTest-1105605191 None] Trying to clone 8817d7bc-693d-4a64-94b3-eac381a4a544 from image 6126230f-0fba-48b9-943c-1885f4fc4be0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6126230f-0fba-48b9-943c-1885f4fc4be0', 'metadata': {}}]). {{(pid=88568) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 30 16:58:14 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-c933f9ac-bad3-4761-b7fc-64f55dec64f5 tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "cinder-quobyte-8f94c25f-ce28-41bc-94d1-9f581adc6e31" released by "_delete_snapshot" :: held 1.963s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:58:14 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-c933f9ac-bad3-4761-b7fc-64f55dec64f5 tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "cinder-quobyte-f214f25c-5e5f-48d9-8df8-8232ce1db9a4" released by "delete_snapshot" :: held 2.004s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:58:14 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-e8d730d2-ee8d-4f18-be77-e7c7892a63d5 tempest-VolumesDeleteCascade-824361553 None] Delete snapshot completed successfully. Jul 30 16:58:14 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-e8d730d2-ee8d-4f18-be77-e7c7892a63d5 tempest-VolumesDeleteCascade-824361553 None] Lock "cinder-3769d710-1ebf-45b5-a0ed-726acf6eebd0-delete_snapshot" released by "delete_snapshot" :: held 4.076s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:58:14 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-e8d730d2-ee8d-4f18-be77-e7c7892a63d5 tempest-VolumesDeleteCascade-824361553 None] Acquiring lock "cinder-c7c3b151-cf8a-487c-96fc-d5439a3ca0f8-delete_snapshot" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:58:14 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-e8d730d2-ee8d-4f18-be77-e7c7892a63d5 tempest-VolumesDeleteCascade-824361553 None] Lock "cinder-c7c3b151-cf8a-487c-96fc-d5439a3ca0f8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:58:14 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-e8d730d2-ee8d-4f18-be77-e7c7892a63d5 tempest-VolumesDeleteCascade-824361553 None] Acquiring lock "cinder-quobyte-02b5ace3-528d-4d8b-8344-80ac87b41bd6" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:58:14 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-e8d730d2-ee8d-4f18-be77-e7c7892a63d5 tempest-VolumesDeleteCascade-824361553 None] Lock "cinder-quobyte-02b5ace3-528d-4d8b-8344-80ac87b41bd6" acquired by "delete_snapshot" :: waited 0.045s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:58:14 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-e8d730d2-ee8d-4f18-be77-e7c7892a63d5 tempest-VolumesDeleteCascade-824361553 None] Acquiring lock "cinder-quobyte-c7c3b151-cf8a-487c-96fc-d5439a3ca0f8" by "_delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:58:14 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-c933f9ac-bad3-4761-b7fc-64f55dec64f5 tempest-VolumesSnapshotTestJSON-1454524182 None] Created reservations ['0bea93d5-129b-4a5d-aa61-9c30357a3f97', '44f0a43b-000d-4daa-98a1-8cb19f8d76bc', '1c364b51-e2e8-4026-8015-c23a56bca19e', '3e972b23-2552-4aff-b0b8-94484c47224c'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:58:14 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-e8d730d2-ee8d-4f18-be77-e7c7892a63d5 tempest-VolumesDeleteCascade-824361553 None] Lock "cinder-quobyte-c7c3b151-cf8a-487c-96fc-d5439a3ca0f8" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:58:14 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-e8d730d2-ee8d-4f18-be77-e7c7892a63d5 tempest-VolumesDeleteCascade-824361553 None] Deleting offline snapshot c7c3b151-cf8a-487c-96fc-d5439a3ca0f8 of volume 02b5ace3-528d-4d8b-8344-80ac87b41bd6 {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:58:14 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-e8d730d2-ee8d-4f18-be77-e7c7892a63d5 tempest-VolumesDeleteCascade-824361553 None] snapshot_file for this snap is: volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6.c7c3b151-cf8a-487c-96fc-d5439a3ca0f8 {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:58:14 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6bf959e-1f43-4d84-8481-6056181b5df5]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:58:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e8d730d2-ee8d-4f18-be77-e7c7892a63d5 tempest-VolumesDeleteCascade-824361553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6.c7c3b151-cf8a-487c-96fc-d5439a3ca0f8 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:15 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-c933f9ac-bad3-4761-b7fc-64f55dec64f5 tempest-VolumesSnapshotTestJSON-1454524182 None] Delete snapshot completed successfully. Jul 30 16:58:15 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-c933f9ac-bad3-4761-b7fc-64f55dec64f5 tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "cinder-8f94c25f-ce28-41bc-94d1-9f581adc6e31-delete_snapshot" released by "delete_snapshot" :: held 2.505s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:58:15 devstack sudo[99385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6.c7c3b151-cf8a-487c-96fc-d5439a3ca0f8 Jul 30 16:58:15 devstack sudo[99385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:15 devstack cinder-volume[88568]: DEBUG cinder.image.image_utils [None req-cf41c9bc-3347-49ef-a221-2fb50c62ab41 tempest-VolumesGetTest-1105605191 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6126230f-0fba-48b9-943c-1885f4fc4be0_os4yr_p6devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88568) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 30 16:58:15 devstack cinder-volume[88568]: INFO cinder.image.image_utils [None req-cf41c9bc-3347-49ef-a221-2fb50c62ab41 tempest-VolumesGetTest-1105605191 None] Image download 20.69 MB at 20.69 MB/s Jul 30 16:58:15 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[01fe60ac-c19f-4686-a443-33b50a2937c2]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:58:15 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-cf41c9bc-3347-49ef-a221-2fb50c62ab41 tempest-VolumesGetTest-1105605191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6126230f-0fba-48b9-943c-1885f4fc4be0_os4yr_p6devstack@QuobyteHD {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:15 devstack sudo[99388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6126230f-0fba-48b9-943c-1885f4fc4be0_os4yr_p6devstack@QuobyteHD Jul 30 16:58:15 devstack sudo[99388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:15 devstack sudo[99385]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:15 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e8d730d2-ee8d-4f18-be77-e7c7892a63d5 tempest-VolumesDeleteCascade-824361553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6.c7c3b151-cf8a-487c-96fc-d5439a3ca0f8" returned: 0 in 0.446s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:15 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-e8d730d2-ee8d-4f18-be77-e7c7892a63d5 tempest-VolumesDeleteCascade-824361553 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:58:15 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a44dfe9-97b2-48b2-b530-af566e0c93b1]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:58:15 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e8d730d2-ee8d-4f18-be77-e7c7892a63d5 tempest-VolumesDeleteCascade-824361553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:15 devstack sudo[99393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6 Jul 30 16:58:15 devstack sudo[99393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:15 devstack sudo[99388]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:15 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-cf41c9bc-3347-49ef-a221-2fb50c62ab41 tempest-VolumesGetTest-1105605191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6126230f-0fba-48b9-943c-1885f4fc4be0_os4yr_p6devstack@QuobyteHD" returned: 0 in 0.456s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:15 devstack cinder-volume[88568]: DEBUG cinder.image.image_utils [None req-cf41c9bc-3347-49ef-a221-2fb50c62ab41 tempest-VolumesGetTest-1105605191 None] Temporary image 6126230f-0fba-48b9-943c-1885f4fc4be0 is fetched for user 7079e6f8867c456bbafdd16180e334f0. {{(pid=88568) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 30 16:58:15 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1c371a-914e-4827-9ff2-d2d0f2565147]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:58:15 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-cf41c9bc-3347-49ef-a221-2fb50c62ab41 tempest-VolumesGetTest-1105605191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6126230f-0fba-48b9-943c-1885f4fc4be0_os4yr_p6devstack@QuobyteHD {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:15 devstack sudo[99398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6126230f-0fba-48b9-943c-1885f4fc4be0_os4yr_p6devstack@QuobyteHD Jul 30 16:58:15 devstack sudo[99398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:15 devstack sudo[99393]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:15 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e8d730d2-ee8d-4f18-be77-e7c7892a63d5 tempest-VolumesDeleteCascade-824361553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6" returned: 0 in 0.537s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:15 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e8d730d2-ee8d-4f18-be77-e7c7892a63d5 tempest-VolumesDeleteCascade-824361553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6.c7c3b151-cf8a-487c-96fc-d5439a3ca0f8 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:16 devstack sudo[99403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6.c7c3b151-cf8a-487c-96fc-d5439a3ca0f8 Jul 30 16:58:16 devstack sudo[99403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:16 devstack sudo[99398]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:16 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-cf41c9bc-3347-49ef-a221-2fb50c62ab41 tempest-VolumesGetTest-1105605191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6126230f-0fba-48b9-943c-1885f4fc4be0_os4yr_p6devstack@QuobyteHD" returned: 0 in 0.431s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:16 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-cf41c9bc-3347-49ef-a221-2fb50c62ab41 tempest-VolumesGetTest-1105605191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:58:16 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-cf41c9bc-3347-49ef-a221-2fb50c62ab41 tempest-VolumesGetTest-1105605191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:58:16 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-cf41c9bc-3347-49ef-a221-2fb50c62ab41 tempest-VolumesGetTest-1105605191 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:58:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-410080208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8817d7bc-693d-4a64-94b3-eac381a4a544,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0bea33560340472bac2e4927a1080f4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:58:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:58:14Z,use_quota=True,user_id='7079e6f8867c456bbafdd16180e334f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:58:16 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-cf41c9bc-3347-49ef-a221-2fb50c62ab41 tempest-VolumesGetTest-1105605191 None] Creating volume 8817d7bc-693d-4a64-94b3-eac381a4a544 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:58:16 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-cf41c9bc-3347-49ef-a221-2fb50c62ab41 tempest-VolumesGetTest-1105605191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:58:16 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-cf41c9bc-3347-49ef-a221-2fb50c62ab41 tempest-VolumesGetTest-1105605191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:58:16 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-cf41c9bc-3347-49ef-a221-2fb50c62ab41 tempest-VolumesGetTest-1105605191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:58:16 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-cf41c9bc-3347-49ef-a221-2fb50c62ab41 tempest-VolumesGetTest-1105605191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:58:16 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-cf41c9bc-3347-49ef-a221-2fb50c62ab41 tempest-VolumesGetTest-1105605191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:58:16 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-cf41c9bc-3347-49ef-a221-2fb50c62ab41 tempest-VolumesGetTest-1105605191 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:58:16 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-cf41c9bc-3347-49ef-a221-2fb50c62ab41 tempest-VolumesGetTest-1105605191 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 16:58:16 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-cf41c9bc-3347-49ef-a221-2fb50c62ab41 tempest-VolumesGetTest-1105605191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8817d7bc-693d-4a64-94b3-eac381a4a544 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:16 devstack sudo[99408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8817d7bc-693d-4a64-94b3-eac381a4a544 1073741824 Jul 30 16:58:16 devstack sudo[99408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:16 devstack sudo[99403]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:16 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e8d730d2-ee8d-4f18-be77-e7c7892a63d5 tempest-VolumesDeleteCascade-824361553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6.c7c3b151-cf8a-487c-96fc-d5439a3ca0f8" returned: 0 in 0.570s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:16 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e8d730d2-ee8d-4f18-be77-e7c7892a63d5 tempest-VolumesDeleteCascade-824361553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6.c7c3b151-cf8a-487c-96fc-d5439a3ca0f8 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:16 devstack sudo[99420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6.c7c3b151-cf8a-487c-96fc-d5439a3ca0f8 Jul 30 16:58:16 devstack sudo[99420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:16 devstack sudo[99420]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:16 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e8d730d2-ee8d-4f18-be77-e7c7892a63d5 tempest-VolumesDeleteCascade-824361553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6.c7c3b151-cf8a-487c-96fc-d5439a3ca0f8" returned: 0 in 0.422s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:17 devstack sudo[99408]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-cf41c9bc-3347-49ef-a221-2fb50c62ab41 tempest-VolumesGetTest-1105605191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8817d7bc-693d-4a64-94b3-eac381a4a544 1073741824" returned: 0 in 0.835s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:17 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-e8d730d2-ee8d-4f18-be77-e7c7892a63d5 tempest-VolumesDeleteCascade-824361553 None] Lock "cinder-quobyte-c7c3b151-cf8a-487c-96fc-d5439a3ca0f8" released by "_delete_snapshot" :: held 2.200s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:58:17 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-e8d730d2-ee8d-4f18-be77-e7c7892a63d5 tempest-VolumesDeleteCascade-824361553 None] Lock "cinder-quobyte-02b5ace3-528d-4d8b-8344-80ac87b41bd6" released by "delete_snapshot" :: held 2.284s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:58:17 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-f769beeb-21e6-4aae-a3c9-12c3f957be00 tempest-VolumesSnapshotTestJSON-1454524182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:58:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f769beeb-21e6-4aae-a3c9-12c3f957be00 tempest-VolumesSnapshotTestJSON-1454524182 None] Flow 'volume_create_manager' (1806a44a-633e-41f9-b1f9-77793731cdaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:58:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f769beeb-21e6-4aae-a3c9-12c3f957be00 tempest-VolumesSnapshotTestJSON-1454524182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35eca35d-fc67-4626-bc8f-0f0d18d116e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-cf41c9bc-3347-49ef-a221-2fb50c62ab41 tempest-VolumesGetTest-1105605191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8817d7bc-693d-4a64-94b3-eac381a4a544 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f769beeb-21e6-4aae-a3c9-12c3f957be00 tempest-VolumesSnapshotTestJSON-1454524182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35eca35d-fc67-4626-bc8f-0f0d18d116e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:58:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-86221217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=764a7e2c-ef7a-407e-bf01-7a297257f31a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26d8b9dd9f954ebf908cd619fefa3523',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:58:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:58:17Z,use_quota=True,user_id='05c871db56e4469bbcc891874329eee6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f769beeb-21e6-4aae-a3c9-12c3f957be00 tempest-VolumesSnapshotTestJSON-1454524182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3f93b1a-2eea-45a1-9bbe-de653c1cf61b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:17 devstack sudo[99438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8817d7bc-693d-4a64-94b3-eac381a4a544 Jul 30 16:58:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f769beeb-21e6-4aae-a3c9-12c3f957be00 tempest-VolumesSnapshotTestJSON-1454524182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3f93b1a-2eea-45a1-9bbe-de653c1cf61b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:17 devstack sudo[99438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f769beeb-21e6-4aae-a3c9-12c3f957be00 tempest-VolumesSnapshotTestJSON-1454524182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b5f23c2-b2d2-4689-8261-0d98074b86aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f769beeb-21e6-4aae-a3c9-12c3f957be00 tempest-VolumesSnapshotTestJSON-1454524182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b5f23c2-b2d2-4689-8261-0d98074b86aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '764a7e2c-ef7a-407e-bf01-7a297257f31a', 'volume_name': 'volume-764a7e2c-ef7a-407e-bf01-7a297257f31a', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f769beeb-21e6-4aae-a3c9-12c3f957be00 tempest-VolumesSnapshotTestJSON-1454524182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eef83fc5-ef01-4944-8e8f-1a084b0070f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f769beeb-21e6-4aae-a3c9-12c3f957be00 tempest-VolumesSnapshotTestJSON-1454524182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eef83fc5-ef01-4944-8e8f-1a084b0070f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f769beeb-21e6-4aae-a3c9-12c3f957be00 tempest-VolumesSnapshotTestJSON-1454524182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f74d5771-850c-415e-80bf-026b07fbf207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:17 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-f769beeb-21e6-4aae-a3c9-12c3f957be00 tempest-VolumesSnapshotTestJSON-1454524182 None] Volume 764a7e2c-ef7a-407e-bf01-7a297257f31a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-764a7e2c-ef7a-407e-bf01-7a297257f31a', 'volume_size': 1} Jul 30 16:58:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-f769beeb-21e6-4aae-a3c9-12c3f957be00 tempest-VolumesSnapshotTestJSON-1454524182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:58:17 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-e8d730d2-ee8d-4f18-be77-e7c7892a63d5 tempest-VolumesDeleteCascade-824361553 None] Created reservations ['8f6b75af-10fc-4067-9e39-31fd39abd848', '338e5f13-c455-4a4e-81f8-e9c2a0308e18', '0e53fd02-d7d7-472b-814a-a4edda85cea9', '8325276a-d190-439e-9f9c-6837cfa24999'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:58:17 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-e8d730d2-ee8d-4f18-be77-e7c7892a63d5 tempest-VolumesDeleteCascade-824361553 None] Delete snapshot completed successfully. Jul 30 16:58:17 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-e8d730d2-ee8d-4f18-be77-e7c7892a63d5 tempest-VolumesDeleteCascade-824361553 None] Lock "cinder-c7c3b151-cf8a-487c-96fc-d5439a3ca0f8-delete_snapshot" released by "delete_snapshot" :: held 2.701s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:58:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e8d730d2-ee8d-4f18-be77-e7c7892a63d5 tempest-VolumesDeleteCascade-824361553 None] Snapshots deleted, issuing volume delete {{(pid=88568) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 30 16:58:17 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-e8d730d2-ee8d-4f18-be77-e7c7892a63d5 tempest-VolumesDeleteCascade-824361553 None] Acquiring lock "cinder-quobyte-02b5ace3-528d-4d8b-8344-80ac87b41bd6" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:58:17 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-e8d730d2-ee8d-4f18-be77-e7c7892a63d5 tempest-VolumesDeleteCascade-824361553 None] Lock "cinder-quobyte-02b5ace3-528d-4d8b-8344-80ac87b41bd6" acquired by "delete_volume" :: waited 0.018s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:58:17 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c26924-7c26-43cb-9e45-b33647c55425]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:58:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e8d730d2-ee8d-4f18-be77-e7c7892a63d5 tempest-VolumesDeleteCascade-824361553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:17 devstack sudo[99438]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-cf41c9bc-3347-49ef-a221-2fb50c62ab41 tempest-VolumesGetTest-1105605191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8817d7bc-693d-4a64-94b3-eac381a4a544" returned: 0 in 0.313s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:17 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-cf41c9bc-3347-49ef-a221-2fb50c62ab41 tempest-VolumesGetTest-1105605191 None] <== create_volume: return (1380ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:58:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-cf41c9bc-3347-49ef-a221-2fb50c62ab41 tempest-VolumesGetTest-1105605191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.383s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:58:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-f769beeb-21e6-4aae-a3c9-12c3f957be00 tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.253s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:58:17 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-f769beeb-21e6-4aae-a3c9-12c3f957be00 tempest-VolumesSnapshotTestJSON-1454524182 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:58:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-86221217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=764a7e2c-ef7a-407e-bf01-7a297257f31a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26d8b9dd9f954ebf908cd619fefa3523',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:58:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:58:17Z,use_quota=True,user_id='05c871db56e4469bbcc891874329eee6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:58:17 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-f769beeb-21e6-4aae-a3c9-12c3f957be00 tempest-VolumesSnapshotTestJSON-1454524182 None] Creating volume 764a7e2c-ef7a-407e-bf01-7a297257f31a {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:58:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-f769beeb-21e6-4aae-a3c9-12c3f957be00 tempest-VolumesSnapshotTestJSON-1454524182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:58:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-f769beeb-21e6-4aae-a3c9-12c3f957be00 tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:58:17 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-f769beeb-21e6-4aae-a3c9-12c3f957be00 tempest-VolumesSnapshotTestJSON-1454524182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:58:17 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-f769beeb-21e6-4aae-a3c9-12c3f957be00 tempest-VolumesSnapshotTestJSON-1454524182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:58:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-f769beeb-21e6-4aae-a3c9-12c3f957be00 tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:58:17 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-f769beeb-21e6-4aae-a3c9-12c3f957be00 tempest-VolumesSnapshotTestJSON-1454524182 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:58:17 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-f769beeb-21e6-4aae-a3c9-12c3f957be00 tempest-VolumesSnapshotTestJSON-1454524182 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 16:58:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f769beeb-21e6-4aae-a3c9-12c3f957be00 tempest-VolumesSnapshotTestJSON-1454524182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-764a7e2c-ef7a-407e-bf01-7a297257f31a 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:17 devstack sudo[99443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6 Jul 30 16:58:17 devstack sudo[99443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:17 devstack sudo[99445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-764a7e2c-ef7a-407e-bf01-7a297257f31a 1073741824 Jul 30 16:58:17 devstack sudo[99445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:17 devstack cinder-volume[88568]: DEBUG cinder.volume.volume_utils [None req-cf41c9bc-3347-49ef-a221-2fb50c62ab41 tempest-VolumesGetTest-1105605191 None] Attempting download of 6126230f-0fba-48b9-943c-1885f4fc4be0 ((None, [{'url': 'file:///opt/stack/data/glance/images/6126230f-0fba-48b9-943c-1885f4fc4be0', 'metadata': {}}])) to volume 8817d7bc-693d-4a64-94b3-eac381a4a544. {{(pid=88568) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 30 16:58:17 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb047b00-f923-4cfe-a297-662dfa5efc68]: (4, 'raw') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:58:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-cf41c9bc-3347-49ef-a221-2fb50c62ab41 tempest-VolumesGetTest-1105605191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6126230f-0fba-48b9-943c-1885f4fc4be0_ane4fjm0 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:17 devstack sudo[99448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6126230f-0fba-48b9-943c-1885f4fc4be0_ane4fjm0 Jul 30 16:58:17 devstack sudo[99448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:17 devstack sudo[99443]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e8d730d2-ee8d-4f18-be77-e7c7892a63d5 tempest-VolumesDeleteCascade-824361553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6" returned: 0 in 0.450s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e8d730d2-ee8d-4f18-be77-e7c7892a63d5 tempest-VolumesDeleteCascade-824361553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:17 devstack sudo[99456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6 Jul 30 16:58:17 devstack sudo[99456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:18 devstack sudo[99448]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-cf41c9bc-3347-49ef-a221-2fb50c62ab41 tempest-VolumesGetTest-1105605191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6126230f-0fba-48b9-943c-1885f4fc4be0_ane4fjm0" returned: 0 in 0.441s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-cf41c9bc-3347-49ef-a221-2fb50c62ab41 tempest-VolumesGetTest-1105605191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6126230f-0fba-48b9-943c-1885f4fc4be0_ane4fjm0 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:18 devstack sudo[99445]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f769beeb-21e6-4aae-a3c9-12c3f957be00 tempest-VolumesSnapshotTestJSON-1454524182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-764a7e2c-ef7a-407e-bf01-7a297257f31a 1073741824" returned: 0 in 0.673s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:18 devstack sudo[99456]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f769beeb-21e6-4aae-a3c9-12c3f957be00 tempest-VolumesSnapshotTestJSON-1454524182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-764a7e2c-ef7a-407e-bf01-7a297257f31a {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e8d730d2-ee8d-4f18-be77-e7c7892a63d5 tempest-VolumesDeleteCascade-824361553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02b5ace3-528d-4d8b-8344-80ac87b41bd6" returned: 0 in 0.394s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:18 devstack sudo[99461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6126230f-0fba-48b9-943c-1885f4fc4be0_ane4fjm0 Jul 30 16:58:18 devstack sudo[99461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:18 devstack sudo[99463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-764a7e2c-ef7a-407e-bf01-7a297257f31a Jul 30 16:58:18 devstack sudo[99463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:18 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-e8d730d2-ee8d-4f18-be77-e7c7892a63d5 tempest-VolumesDeleteCascade-824361553 None] Lock "cinder-quobyte-02b5ace3-528d-4d8b-8344-80ac87b41bd6" released by "delete_volume" :: held 0.937s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:58:18 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-e8d730d2-ee8d-4f18-be77-e7c7892a63d5 tempest-VolumesDeleteCascade-824361553 None] Created reservations ['a01e4135-b262-4669-ac55-43ee570d3790', '443b8100-28ba-47f5-8f5a-b8035018da08', '5fa06d97-55d7-42d8-93c5-3537447b3c3b', '36a2449c-51ad-4b26-9e83-172528c5cc7b'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:58:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-e8d730d2-ee8d-4f18-be77-e7c7892a63d5 tempest-VolumesDeleteCascade-824361553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:58:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-e8d730d2-ee8d-4f18-be77-e7c7892a63d5 tempest-VolumesDeleteCascade-824361553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:58:18 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-e8d730d2-ee8d-4f18-be77-e7c7892a63d5 tempest-VolumesDeleteCascade-824361553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:58:18 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-e8d730d2-ee8d-4f18-be77-e7c7892a63d5 tempest-VolumesDeleteCascade-824361553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:58:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-e8d730d2-ee8d-4f18-be77-e7c7892a63d5 tempest-VolumesDeleteCascade-824361553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:58:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e8d730d2-ee8d-4f18-be77-e7c7892a63d5 tempest-VolumesDeleteCascade-824361553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:18 devstack sudo[99466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:58:18 devstack sudo[99466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:18 devstack sudo[99463]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f769beeb-21e6-4aae-a3c9-12c3f957be00 tempest-VolumesSnapshotTestJSON-1454524182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-764a7e2c-ef7a-407e-bf01-7a297257f31a" returned: 0 in 0.358s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:18 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-f769beeb-21e6-4aae-a3c9-12c3f957be00 tempest-VolumesSnapshotTestJSON-1454524182 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:58:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-f769beeb-21e6-4aae-a3c9-12c3f957be00 tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:58:18 devstack sudo[99461]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:18 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f769beeb-21e6-4aae-a3c9-12c3f957be00 tempest-VolumesSnapshotTestJSON-1454524182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f74d5771-850c-415e-80bf-026b07fbf207) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-764a7e2c-ef7a-407e-bf01-7a297257f31a', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:18 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f769beeb-21e6-4aae-a3c9-12c3f957be00 tempest-VolumesSnapshotTestJSON-1454524182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (121fdb73-83af-401c-83cf-cba0ec05f9cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-cf41c9bc-3347-49ef-a221-2fb50c62ab41 tempest-VolumesGetTest-1105605191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6126230f-0fba-48b9-943c-1885f4fc4be0_ane4fjm0" returned: 1 in 0.590s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-cf41c9bc-3347-49ef-a221-2fb50c62ab41 tempest-VolumesGetTest-1105605191 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6126230f-0fba-48b9-943c-1885f4fc4be0_ane4fjm0' failed. Not Retrying. {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 16:58:18 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b12099-aa28-4122-9c40-b523a0c14384]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:58:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-cf41c9bc-3347-49ef-a221-2fb50c62ab41 tempest-VolumesGetTest-1105605191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6126230f-0fba-48b9-943c-1885f4fc4be0_os4yr_p6devstack@QuobyteHD {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:18 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-f769beeb-21e6-4aae-a3c9-12c3f957be00 tempest-VolumesSnapshotTestJSON-1454524182 None] Volume volume-764a7e2c-ef7a-407e-bf01-7a297257f31a (764a7e2c-ef7a-407e-bf01-7a297257f31a): created successfully Jul 30 16:58:18 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f769beeb-21e6-4aae-a3c9-12c3f957be00 tempest-VolumesSnapshotTestJSON-1454524182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (121fdb73-83af-401c-83cf-cba0ec05f9cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:18 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f769beeb-21e6-4aae-a3c9-12c3f957be00 tempest-VolumesSnapshotTestJSON-1454524182 None] Flow 'volume_create_manager' (1806a44a-633e-41f9-b1f9-77793731cdaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:58:18 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-f769beeb-21e6-4aae-a3c9-12c3f957be00 tempest-VolumesSnapshotTestJSON-1454524182 None] Created volume successfully. Jul 30 16:58:18 devstack sudo[99466]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e8d730d2-ee8d-4f18-be77-e7c7892a63d5 tempest-VolumesDeleteCascade-824361553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.294s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:18 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-e8d730d2-ee8d-4f18-be77-e7c7892a63d5 tempest-VolumesDeleteCascade-824361553 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:58:18 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-e8d730d2-ee8d-4f18-be77-e7c7892a63d5 tempest-VolumesDeleteCascade-824361553 None] Deleted volume successfully. Jul 30 16:58:18 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-e8d730d2-ee8d-4f18-be77-e7c7892a63d5 tempest-VolumesDeleteCascade-824361553 None] Lock "cinder-02b5ace3-528d-4d8b-8344-80ac87b41bd6-delete_volume" released by "delete_volume" :: held 8.420s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:58:18 devstack sudo[99472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6126230f-0fba-48b9-943c-1885f4fc4be0_os4yr_p6devstack@QuobyteHD Jul 30 16:58:18 devstack sudo[99472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:19 devstack sudo[99472]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:19 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-cf41c9bc-3347-49ef-a221-2fb50c62ab41 tempest-VolumesGetTest-1105605191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6126230f-0fba-48b9-943c-1885f4fc4be0_os4yr_p6devstack@QuobyteHD" returned: 0 in 0.433s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:19 devstack cinder-volume[88568]: DEBUG cinder.image.image_utils [None req-cf41c9bc-3347-49ef-a221-2fb50c62ab41 tempest-VolumesGetTest-1105605191 None] 6126230f-0fba-48b9-943c-1885f4fc4be0 was qcow2, converting to qcow2 {{(pid=88568) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 30 16:58:19 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-cf41c9bc-3347-49ef-a221-2fb50c62ab41 tempest-VolumesGetTest-1105605191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6126230f-0fba-48b9-943c-1885f4fc4be0_os4yr_p6devstack@QuobyteHD /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8817d7bc-693d-4a64-94b3-eac381a4a544 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:19 devstack sudo[99479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6126230f-0fba-48b9-943c-1885f4fc4be0_os4yr_p6devstack@QuobyteHD /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8817d7bc-693d-4a64-94b3-eac381a4a544 Jul 30 16:58:19 devstack sudo[99479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:19 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-dc5119e3-6e02-4968-8d98-bca486ae1300 tempest-VolumesSnapshotTestJSON-1454524182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:58:19 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-dc5119e3-6e02-4968-8d98-bca486ae1300 tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:58:19 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-dc5119e3-6e02-4968-8d98-bca486ae1300 tempest-VolumesSnapshotTestJSON-1454524182 None] Creating offline snapshot c19ce9ca-976a-4653-8cfe-ff5409ecc347 of volume 764a7e2c-ef7a-407e-bf01-7a297257f31a {{(pid=88568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:58:19 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[2edeee7c-4056-47bd-a297-f2f9463db056]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:58:19 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-dc5119e3-6e02-4968-8d98-bca486ae1300 tempest-VolumesSnapshotTestJSON-1454524182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-764a7e2c-ef7a-407e-bf01-7a297257f31a {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:19 devstack sudo[99489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-764a7e2c-ef7a-407e-bf01-7a297257f31a Jul 30 16:58:19 devstack sudo[99489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:20 devstack sudo[99489]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-dc5119e3-6e02-4968-8d98-bca486ae1300 tempest-VolumesSnapshotTestJSON-1454524182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-764a7e2c-ef7a-407e-bf01-7a297257f31a" returned: 0 in 0.825s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-dc5119e3-6e02-4968-8d98-bca486ae1300 tempest-VolumesSnapshotTestJSON-1454524182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-764a7e2c-ef7a-407e-bf01-7a297257f31a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-764a7e2c-ef7a-407e-bf01-7a297257f31a.c19ce9ca-976a-4653-8cfe-ff5409ecc347 1G {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:20 devstack sudo[99530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-764a7e2c-ef7a-407e-bf01-7a297257f31a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-764a7e2c-ef7a-407e-bf01-7a297257f31a.c19ce9ca-976a-4653-8cfe-ff5409ecc347 1G Jul 30 16:58:20 devstack sudo[99530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:20 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-02879ec1-299d-4742-93ed-cb58d3b6b798 tempest-VolumesDeleteCascade-824361553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:58:21 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-02879ec1-299d-4742-93ed-cb58d3b6b798 tempest-VolumesDeleteCascade-824361553 None] Flow 'volume_create_manager' (d1352c17-77f0-43e2-8976-2a90d3f99845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:58:21 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-02879ec1-299d-4742-93ed-cb58d3b6b798 tempest-VolumesDeleteCascade-824361553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80906596-1a27-4bd8-9f82-70384e9cc43a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:21 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-02879ec1-299d-4742-93ed-cb58d3b6b798 tempest-VolumesDeleteCascade-824361553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80906596-1a27-4bd8-9f82-70384e9cc43a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:58:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1597248062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d24cfc404784d1fa2288ea0de5982de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:58:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:58:21Z,use_quota=True,user_id='472c553d709946489f0703e6c0c6e054',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:21 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-02879ec1-299d-4742-93ed-cb58d3b6b798 tempest-VolumesDeleteCascade-824361553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (253745ef-ff04-4d5d-8d91-170340265ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:21 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-02879ec1-299d-4742-93ed-cb58d3b6b798 tempest-VolumesDeleteCascade-824361553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (253745ef-ff04-4d5d-8d91-170340265ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:21 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-02879ec1-299d-4742-93ed-cb58d3b6b798 tempest-VolumesDeleteCascade-824361553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eee01dec-6c54-45e5-b3db-70af6306496c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:21 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-02879ec1-299d-4742-93ed-cb58d3b6b798 tempest-VolumesDeleteCascade-824361553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eee01dec-6c54-45e5-b3db-70af6306496c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61', 'volume_name': 'volume-e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:21 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-02879ec1-299d-4742-93ed-cb58d3b6b798 tempest-VolumesDeleteCascade-824361553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (457452ba-45b9-4699-8631-8211f5601639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:21 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-02879ec1-299d-4742-93ed-cb58d3b6b798 tempest-VolumesDeleteCascade-824361553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (457452ba-45b9-4699-8631-8211f5601639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:21 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-02879ec1-299d-4742-93ed-cb58d3b6b798 tempest-VolumesDeleteCascade-824361553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f53f579-5d29-479b-ad58-94e1d449f4df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:21 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-02879ec1-299d-4742-93ed-cb58d3b6b798 tempest-VolumesDeleteCascade-824361553 None] Volume e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61', 'volume_size': 1} Jul 30 16:58:21 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-02879ec1-299d-4742-93ed-cb58d3b6b798 tempest-VolumesDeleteCascade-824361553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:58:21 devstack sudo[99530]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:21 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-dc5119e3-6e02-4968-8d98-bca486ae1300 tempest-VolumesSnapshotTestJSON-1454524182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-764a7e2c-ef7a-407e-bf01-7a297257f31a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-764a7e2c-ef7a-407e-bf01-7a297257f31a.c19ce9ca-976a-4653-8cfe-ff5409ecc347 1G" returned: 0 in 1.025s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:21 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-dc5119e3-6e02-4968-8d98-bca486ae1300 tempest-VolumesSnapshotTestJSON-1454524182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-764a7e2c-ef7a-407e-bf01-7a297257f31a -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-764a7e2c-ef7a-407e-bf01-7a297257f31a.c19ce9ca-976a-4653-8cfe-ff5409ecc347 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:21 devstack sudo[99565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-764a7e2c-ef7a-407e-bf01-7a297257f31a -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-764a7e2c-ef7a-407e-bf01-7a297257f31a.c19ce9ca-976a-4653-8cfe-ff5409ecc347 Jul 30 16:58:21 devstack sudo[99565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:21 devstack sudo[99565]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:21 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-dc5119e3-6e02-4968-8d98-bca486ae1300 tempest-VolumesSnapshotTestJSON-1454524182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-764a7e2c-ef7a-407e-bf01-7a297257f31a -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-764a7e2c-ef7a-407e-bf01-7a297257f31a.c19ce9ca-976a-4653-8cfe-ff5409ecc347" returned: 0 in 0.411s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:21 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-dc5119e3-6e02-4968-8d98-bca486ae1300 tempest-VolumesSnapshotTestJSON-1454524182 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-764a7e2c-ef7a-407e-bf01-7a297257f31a.c19ce9ca-976a-4653-8cfe-ff5409ecc347 is being set with open permissions: ugo+rw Jul 30 16:58:21 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-dc5119e3-6e02-4968-8d98-bca486ae1300 tempest-VolumesSnapshotTestJSON-1454524182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-764a7e2c-ef7a-407e-bf01-7a297257f31a.c19ce9ca-976a-4653-8cfe-ff5409ecc347 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:21 devstack sudo[99584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-764a7e2c-ef7a-407e-bf01-7a297257f31a.c19ce9ca-976a-4653-8cfe-ff5409ecc347 Jul 30 16:58:21 devstack sudo[99584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:21 devstack sudo[99584]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:21 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-dc5119e3-6e02-4968-8d98-bca486ae1300 tempest-VolumesSnapshotTestJSON-1454524182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-764a7e2c-ef7a-407e-bf01-7a297257f31a.c19ce9ca-976a-4653-8cfe-ff5409ecc347" returned: 0 in 0.268s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:21 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-dc5119e3-6e02-4968-8d98-bca486ae1300 tempest-VolumesSnapshotTestJSON-1454524182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-764a7e2c-ef7a-407e-bf01-7a297257f31a.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:21 devstack sudo[99587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-764a7e2c-ef7a-407e-bf01-7a297257f31a.info Jul 30 16:58:21 devstack sudo[99587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:22 devstack sudo[99479]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:22 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-cf41c9bc-3347-49ef-a221-2fb50c62ab41 tempest-VolumesGetTest-1105605191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6126230f-0fba-48b9-943c-1885f4fc4be0_os4yr_p6devstack@QuobyteHD /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8817d7bc-693d-4a64-94b3-eac381a4a544" returned: 0 in 2.963s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:22 devstack cinder-volume[88568]: DEBUG cinder.image.image_utils [None req-cf41c9bc-3347-49ef-a221-2fb50c62ab41 tempest-VolumesGetTest-1105605191 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6126230f-0fba-48b9-943c-1885f4fc4be0_os4yr_p6devstack@QuobyteHD, size 112.00 MB, duration 2.96 sec, destination /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8817d7bc-693d-4a64-94b3-eac381a4a544 {{(pid=88568) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 16:58:22 devstack cinder-volume[88568]: INFO cinder.image.image_utils [None req-cf41c9bc-3347-49ef-a221-2fb50c62ab41 tempest-VolumesGetTest-1105605191 None] Converted 112.00 MB image at 37.78 MB/s Jul 30 16:58:22 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-cf41c9bc-3347-49ef-a221-2fb50c62ab41 tempest-VolumesGetTest-1105605191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8817d7bc-693d-4a64-94b3-eac381a4a544 1G {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:22 devstack sudo[99589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8817d7bc-693d-4a64-94b3-eac381a4a544 1G Jul 30 16:58:22 devstack sudo[99589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:22 devstack sudo[99587]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:22 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-dc5119e3-6e02-4968-8d98-bca486ae1300 tempest-VolumesSnapshotTestJSON-1454524182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-764a7e2c-ef7a-407e-bf01-7a297257f31a.info" returned: 0 in 0.301s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:22 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-dc5119e3-6e02-4968-8d98-bca486ae1300 tempest-VolumesSnapshotTestJSON-1454524182 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-764a7e2c-ef7a-407e-bf01-7a297257f31a.info is being set with open permissions: ugo+rw Jul 30 16:58:22 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-dc5119e3-6e02-4968-8d98-bca486ae1300 tempest-VolumesSnapshotTestJSON-1454524182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-764a7e2c-ef7a-407e-bf01-7a297257f31a.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:22 devstack sudo[99592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-764a7e2c-ef7a-407e-bf01-7a297257f31a.info Jul 30 16:58:22 devstack sudo[99592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:22 devstack sudo[99592]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:22 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-dc5119e3-6e02-4968-8d98-bca486ae1300 tempest-VolumesSnapshotTestJSON-1454524182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-764a7e2c-ef7a-407e-bf01-7a297257f31a.info" returned: 0 in 0.317s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:22 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-dc5119e3-6e02-4968-8d98-bca486ae1300 tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.371s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:58:22 devstack sudo[99589]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:22 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-02879ec1-299d-4742-93ed-cb58d3b6b798 tempest-VolumesDeleteCascade-824361553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.477s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:58:22 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-02879ec1-299d-4742-93ed-cb58d3b6b798 tempest-VolumesDeleteCascade-824361553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:58:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1597248062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d24cfc404784d1fa2288ea0de5982de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:58:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:58:21Z,use_quota=True,user_id='472c553d709946489f0703e6c0c6e054',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:58:22 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-02879ec1-299d-4742-93ed-cb58d3b6b798 tempest-VolumesDeleteCascade-824361553 None] Creating volume e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:58:22 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-02879ec1-299d-4742-93ed-cb58d3b6b798 tempest-VolumesDeleteCascade-824361553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:58:22 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-02879ec1-299d-4742-93ed-cb58d3b6b798 tempest-VolumesDeleteCascade-824361553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:58:22 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-02879ec1-299d-4742-93ed-cb58d3b6b798 tempest-VolumesDeleteCascade-824361553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:58:22 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-02879ec1-299d-4742-93ed-cb58d3b6b798 tempest-VolumesDeleteCascade-824361553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:58:22 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-02879ec1-299d-4742-93ed-cb58d3b6b798 tempest-VolumesDeleteCascade-824361553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:58:22 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-02879ec1-299d-4742-93ed-cb58d3b6b798 tempest-VolumesDeleteCascade-824361553 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:58:22 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-02879ec1-299d-4742-93ed-cb58d3b6b798 tempest-VolumesDeleteCascade-824361553 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 16:58:22 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-02879ec1-299d-4742-93ed-cb58d3b6b798 tempest-VolumesDeleteCascade-824361553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:22 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-cf41c9bc-3347-49ef-a221-2fb50c62ab41 tempest-VolumesGetTest-1105605191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8817d7bc-693d-4a64-94b3-eac381a4a544 1G" returned: 0 in 0.559s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:22 devstack cinder-volume[88568]: DEBUG cinder.volume.volume_utils [None req-cf41c9bc-3347-49ef-a221-2fb50c62ab41 tempest-VolumesGetTest-1105605191 None] Downloaded image 6126230f-0fba-48b9-943c-1885f4fc4be0 ((None, [{'url': 'file:///opt/stack/data/glance/images/6126230f-0fba-48b9-943c-1885f4fc4be0', 'metadata': {}}])) to volume 8817d7bc-693d-4a64-94b3-eac381a4a544 successfully. {{(pid=88568) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 30 16:58:22 devstack sudo[99601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61 1073741824 Jul 30 16:58:22 devstack sudo[99601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:22 devstack cinder-volume[88568]: DEBUG cinder.image.image_utils [None req-cf41c9bc-3347-49ef-a221-2fb50c62ab41 tempest-VolumesGetTest-1105605191 None] Temporary image 6126230f-0fba-48b9-943c-1885f4fc4be0 for user 7079e6f8867c456bbafdd16180e334f0 is deleted. {{(pid=88568) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 30 16:58:22 devstack cinder-volume[88568]: DEBUG cinder.volume.volume_utils [None req-cf41c9bc-3347-49ef-a221-2fb50c62ab41 tempest-VolumesGetTest-1105605191 None] Marking volume 8817d7bc-693d-4a64-94b3-eac381a4a544 as bootable. {{(pid=88568) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 30 16:58:22 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-dc5119e3-6e02-4968-8d98-bca486ae1300 tempest-VolumesSnapshotTestJSON-1454524182 None] Create snapshot completed successfully Jul 30 16:58:22 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf41c9bc-3347-49ef-a221-2fb50c62ab41 tempest-VolumesGetTest-1105605191 None] Copying metadata from image 6126230f-0fba-48b9-943c-1885f4fc4be0 to 8817d7bc-693d-4a64-94b3-eac381a4a544. {{(pid=88568) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 30 16:58:22 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf41c9bc-3347-49ef-a221-2fb50c62ab41 tempest-VolumesGetTest-1105605191 None] Creating volume glance metadata for volume 8817d7bc-693d-4a64-94b3-eac381a4a544 backed by image 6126230f-0fba-48b9-943c-1885f4fc4be0 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6126230f-0fba-48b9-943c-1885f4fc4be0', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88568) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 30 16:58:23 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-cf41c9bc-3347-49ef-a221-2fb50c62ab41 tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ef06790-75cc-44f2-9cb7-927208b80de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8817d7bc-693d-4a64-94b3-eac381a4a544', 'volume_size': 1, 'image_id': '6126230f-0fba-48b9-943c-1885f4fc4be0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6126230f-0fba-48b9-943c-1885f4fc4be0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2802aa975ace4011a130c68c7a9c96bb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6126230f-0fba-48b9-943c-1885f4fc4be0', 'created_at': datetime.datetime(2026, 7, 30, 14, 43, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 43, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6126230f-0fba-48b9-943c-1885f4fc4be0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:23 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-cf41c9bc-3347-49ef-a221-2fb50c62ab41 tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8a05270-c902-4407-a89d-90ab3ea2d724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:23 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-cf41c9bc-3347-49ef-a221-2fb50c62ab41 tempest-VolumesGetTest-1105605191 None] Volume volume-8817d7bc-693d-4a64-94b3-eac381a4a544 (8817d7bc-693d-4a64-94b3-eac381a4a544): created successfully Jul 30 16:58:23 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-cf41c9bc-3347-49ef-a221-2fb50c62ab41 tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8a05270-c902-4407-a89d-90ab3ea2d724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:23 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-cf41c9bc-3347-49ef-a221-2fb50c62ab41 tempest-VolumesGetTest-1105605191 None] Flow 'volume_create_manager' (b1e240ea-7103-490a-8edb-eefd0a524244) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:58:23 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-cf41c9bc-3347-49ef-a221-2fb50c62ab41 tempest-VolumesGetTest-1105605191 None] Created volume successfully. Jul 30 16:58:23 devstack sudo[99601]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:23 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-02879ec1-299d-4742-93ed-cb58d3b6b798 tempest-VolumesDeleteCascade-824361553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61 1073741824" returned: 0 in 0.598s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:23 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-02879ec1-299d-4742-93ed-cb58d3b6b798 tempest-VolumesDeleteCascade-824361553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:23 devstack sudo[99607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61 Jul 30 16:58:23 devstack sudo[99607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:23 devstack sudo[99607]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:23 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-02879ec1-299d-4742-93ed-cb58d3b6b798 tempest-VolumesDeleteCascade-824361553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61" returned: 0 in 0.280s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:23 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-02879ec1-299d-4742-93ed-cb58d3b6b798 tempest-VolumesDeleteCascade-824361553 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:58:23 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-02879ec1-299d-4742-93ed-cb58d3b6b798 tempest-VolumesDeleteCascade-824361553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:58:23 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-02879ec1-299d-4742-93ed-cb58d3b6b798 tempest-VolumesDeleteCascade-824361553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f53f579-5d29-479b-ad58-94e1d449f4df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:23 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-02879ec1-299d-4742-93ed-cb58d3b6b798 tempest-VolumesDeleteCascade-824361553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9f512a5-3ca0-4838-a6da-fc70d5084c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:23 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-02879ec1-299d-4742-93ed-cb58d3b6b798 tempest-VolumesDeleteCascade-824361553 None] Volume volume-e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61 (e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61): created successfully Jul 30 16:58:23 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-02879ec1-299d-4742-93ed-cb58d3b6b798 tempest-VolumesDeleteCascade-824361553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9f512a5-3ca0-4838-a6da-fc70d5084c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:23 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-02879ec1-299d-4742-93ed-cb58d3b6b798 tempest-VolumesDeleteCascade-824361553 None] Flow 'volume_create_manager' (d1352c17-77f0-43e2-8976-2a90d3f99845) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:58:23 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-02879ec1-299d-4742-93ed-cb58d3b6b798 tempest-VolumesDeleteCascade-824361553 None] Created volume successfully. Jul 30 16:58:24 devstack cinder-volume[88568]: DEBUG dbcounter [-] [88568] Writing DB stats cinder:SELECT=147,cinder:INSERT=37,cinder:UPDATE=164,cinder:DELETE=20 {{(pid=88568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:58:24 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-b44e0e89-9d18-4e41-802c-9a89c0795e51 tempest-VolumesSnapshotTestJSON-1454524182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:58:24 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b44e0e89-9d18-4e41-802c-9a89c0795e51 tempest-VolumesSnapshotTestJSON-1454524182 None] Flow 'volume_create_manager' (3d0c40d0-13ae-4d10-8afd-0db2da986d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:58:24 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b44e0e89-9d18-4e41-802c-9a89c0795e51 tempest-VolumesSnapshotTestJSON-1454524182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b619a3bb-c14b-4959-87eb-2881d371eade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:24 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b44e0e89-9d18-4e41-802c-9a89c0795e51 tempest-VolumesSnapshotTestJSON-1454524182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b619a3bb-c14b-4959-87eb-2881d371eade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:58:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1762682041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7877a22c-c181-4570-96c0-2b5e2d8bbd12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26d8b9dd9f954ebf908cd619fefa3523',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:58:24Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=c19ce9ca-976a-4653-8cfe-ff5409ecc347,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:58:24Z,use_quota=True,user_id='05c871db56e4469bbcc891874329eee6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:24 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b44e0e89-9d18-4e41-802c-9a89c0795e51 tempest-VolumesSnapshotTestJSON-1454524182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (649384b0-7f88-4e1c-b5ca-af03a8add4a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:24 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b44e0e89-9d18-4e41-802c-9a89c0795e51 tempest-VolumesSnapshotTestJSON-1454524182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (649384b0-7f88-4e1c-b5ca-af03a8add4a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:24 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b44e0e89-9d18-4e41-802c-9a89c0795e51 tempest-VolumesSnapshotTestJSON-1454524182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d97a305-ed2b-45ca-a316-dbc71f23df34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:24 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b44e0e89-9d18-4e41-802c-9a89c0795e51 tempest-VolumesSnapshotTestJSON-1454524182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d97a305-ed2b-45ca-a316-dbc71f23df34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7877a22c-c181-4570-96c0-2b5e2d8bbd12', 'volume_name': 'volume-7877a22c-c181-4570-96c0-2b5e2d8bbd12', 'volume_size': 2, 'snapshot_id': 'c19ce9ca-976a-4653-8cfe-ff5409ecc347'}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:24 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b44e0e89-9d18-4e41-802c-9a89c0795e51 tempest-VolumesSnapshotTestJSON-1454524182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fe0b079-733e-4ff0-bc5d-a58013abdcc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:24 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b44e0e89-9d18-4e41-802c-9a89c0795e51 tempest-VolumesSnapshotTestJSON-1454524182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fe0b079-733e-4ff0-bc5d-a58013abdcc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:24 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b44e0e89-9d18-4e41-802c-9a89c0795e51 tempest-VolumesSnapshotTestJSON-1454524182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c27963f-5b1d-4148-a3a9-4e96f5485d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:24 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-b44e0e89-9d18-4e41-802c-9a89c0795e51 tempest-VolumesSnapshotTestJSON-1454524182 None] Volume 7877a22c-c181-4570-96c0-2b5e2d8bbd12: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7877a22c-c181-4570-96c0-2b5e2d8bbd12', 'volume_size': 2, 'snapshot_id': 'c19ce9ca-976a-4653-8cfe-ff5409ecc347'} Jul 30 16:58:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-b44e0e89-9d18-4e41-802c-9a89c0795e51 tempest-VolumesSnapshotTestJSON-1454524182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:58:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-b44e0e89-9d18-4e41-802c-9a89c0795e51 tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:58:24 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-b44e0e89-9d18-4e41-802c-9a89c0795e51 tempest-VolumesSnapshotTestJSON-1454524182 None] Acquiring lock "cinder-quobyte-c19ce9ca-976a-4653-8cfe-ff5409ecc347-7877a22c-c181-4570-96c0-2b5e2d8bbd12" by "_create_volume_from_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:58:24 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-b44e0e89-9d18-4e41-802c-9a89c0795e51 tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "cinder-quobyte-c19ce9ca-976a-4653-8cfe-ff5409ecc347-7877a22c-c181-4570-96c0-2b5e2d8bbd12" acquired by "_create_volume_from_snapshot" :: waited 0.118s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:58:24 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-b44e0e89-9d18-4e41-802c-9a89c0795e51 tempest-VolumesSnapshotTestJSON-1454524182 None] Creating volume 7877a22c-c181-4570-96c0-2b5e2d8bbd12 from snapshot c19ce9ca-976a-4653-8cfe-ff5409ecc347 {{(pid=88568) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 30 16:58:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-b44e0e89-9d18-4e41-802c-9a89c0795e51 tempest-VolumesSnapshotTestJSON-1454524182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:58:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-b44e0e89-9d18-4e41-802c-9a89c0795e51 tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:58:24 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-b44e0e89-9d18-4e41-802c-9a89c0795e51 tempest-VolumesSnapshotTestJSON-1454524182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:58:24 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-b44e0e89-9d18-4e41-802c-9a89c0795e51 tempest-VolumesSnapshotTestJSON-1454524182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:58:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-b44e0e89-9d18-4e41-802c-9a89c0795e51 tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:58:24 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-b44e0e89-9d18-4e41-802c-9a89c0795e51 tempest-VolumesSnapshotTestJSON-1454524182 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:58:24 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-b44e0e89-9d18-4e41-802c-9a89c0795e51 tempest-VolumesSnapshotTestJSON-1454524182 None] Acquiring lock "cinder-quobyte-7877a22c-c181-4570-96c0-2b5e2d8bbd12" by "_copy_volume_from_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:58:24 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-b44e0e89-9d18-4e41-802c-9a89c0795e51 tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "cinder-quobyte-7877a22c-c181-4570-96c0-2b5e2d8bbd12" acquired by "_copy_volume_from_snapshot" :: waited 0.051s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:58:24 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-b44e0e89-9d18-4e41-802c-9a89c0795e51 tempest-VolumesSnapshotTestJSON-1454524182 None] snapshot: c19ce9ca-976a-4653-8cfe-ff5409ecc347, volume: 7877a22c-c181-4570-96c0-2b5e2d8bbd12, {{(pid=88568) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 30 16:58:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-347f5b72-2c66-4686-91ad-71d0aae6dff8 tempest-VolumesDeleteCascade-824361553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:58:24 devstack cinder-volume[88568]: DEBUG dbcounter [-] [88568] Writing DB stats cinder:INSERT=56,cinder:UPDATE=172,cinder:SELECT=139,cinder:DELETE=11 {{(pid=88568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:58:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-b44e0e89-9d18-4e41-802c-9a89c0795e51 tempest-VolumesSnapshotTestJSON-1454524182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:58:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-b44e0e89-9d18-4e41-802c-9a89c0795e51 tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:58:24 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-b44e0e89-9d18-4e41-802c-9a89c0795e51 tempest-VolumesSnapshotTestJSON-1454524182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:58:24 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-b44e0e89-9d18-4e41-802c-9a89c0795e51 tempest-VolumesSnapshotTestJSON-1454524182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:58:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-b44e0e89-9d18-4e41-802c-9a89c0795e51 tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:58:24 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[40aa5d61-678e-4f2b-9c9a-82a533c2a1fd]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:58:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-b44e0e89-9d18-4e41-802c-9a89c0795e51 tempest-VolumesSnapshotTestJSON-1454524182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-764a7e2c-ef7a-407e-bf01-7a297257f31a.c19ce9ca-976a-4653-8cfe-ff5409ecc347 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:25 devstack sudo[99611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-764a7e2c-ef7a-407e-bf01-7a297257f31a.c19ce9ca-976a-4653-8cfe-ff5409ecc347 Jul 30 16:58:25 devstack sudo[99611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:25 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9c9fe7d-9c1e-494a-9180-8f51477df27a tempest-VolumesGetTest-1105605191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:58:25 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f9c9fe7d-9c1e-494a-9180-8f51477df27a tempest-VolumesGetTest-1105605191 None] Flow 'volume_create_manager' (e85e9c3b-4c67-4c89-be23-efefc4183607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:58:25 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f9c9fe7d-9c1e-494a-9180-8f51477df27a tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b798c54-1458-481c-87af-3bb8214e9d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:25 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f9c9fe7d-9c1e-494a-9180-8f51477df27a tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b798c54-1458-481c-87af-3bb8214e9d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:58:25Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2025130900',display_name='tempest-VolumesGetTest-Volume-1206599739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3ba3e96-10a0-4d6f-b24c-ad8fa68d7743,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bea33560340472bac2e4927a1080f4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:58:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:58:25Z,use_quota=True,user_id='7079e6f8867c456bbafdd16180e334f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:25 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f9c9fe7d-9c1e-494a-9180-8f51477df27a tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46d58a41-e7de-413c-85fa-fbec0b97a1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:25 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f9c9fe7d-9c1e-494a-9180-8f51477df27a tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46d58a41-e7de-413c-85fa-fbec0b97a1c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:25 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f9c9fe7d-9c1e-494a-9180-8f51477df27a tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c32be1cb-2010-41de-98ad-d579c0ce7b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:25 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f9c9fe7d-9c1e-494a-9180-8f51477df27a tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c32be1cb-2010-41de-98ad-d579c0ce7b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3ba3e96-10a0-4d6f-b24c-ad8fa68d7743', 'volume_name': 'volume-f3ba3e96-10a0-4d6f-b24c-ad8fa68d7743', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:25 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f9c9fe7d-9c1e-494a-9180-8f51477df27a tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f8c6979-4d71-4743-9cfd-9d8641c67aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:25 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f9c9fe7d-9c1e-494a-9180-8f51477df27a tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f8c6979-4d71-4743-9cfd-9d8641c67aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:25 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f9c9fe7d-9c1e-494a-9180-8f51477df27a tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1beecded-2653-46d3-a21f-06ef12e4c4b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:25 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-f9c9fe7d-9c1e-494a-9180-8f51477df27a tempest-VolumesGetTest-1105605191 None] Volume f3ba3e96-10a0-4d6f-b24c-ad8fa68d7743: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3ba3e96-10a0-4d6f-b24c-ad8fa68d7743', 'volume_size': 1} Jul 30 16:58:25 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-f9c9fe7d-9c1e-494a-9180-8f51477df27a tempest-VolumesGetTest-1105605191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:58:25 devstack sudo[99611]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:25 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-b44e0e89-9d18-4e41-802c-9a89c0795e51 tempest-VolumesSnapshotTestJSON-1454524182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-764a7e2c-ef7a-407e-bf01-7a297257f31a.c19ce9ca-976a-4653-8cfe-ff5409ecc347" returned: 0 in 0.642s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:25 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-b44e0e89-9d18-4e41-802c-9a89c0795e51 tempest-VolumesSnapshotTestJSON-1454524182 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-764a7e2c-ef7a-407e-bf01-7a297257f31a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:58:25 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf7d91e-3e1d-4b16-bf04-979d0f326a0c]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:58:25 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-b44e0e89-9d18-4e41-802c-9a89c0795e51 tempest-VolumesSnapshotTestJSON-1454524182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-764a7e2c-ef7a-407e-bf01-7a297257f31a {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:25 devstack sudo[99616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-764a7e2c-ef7a-407e-bf01-7a297257f31a Jul 30 16:58:25 devstack sudo[99616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:25 devstack sudo[99616]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:25 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-b44e0e89-9d18-4e41-802c-9a89c0795e51 tempest-VolumesSnapshotTestJSON-1454524182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-764a7e2c-ef7a-407e-bf01-7a297257f31a" returned: 0 in 0.462s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:25 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-b44e0e89-9d18-4e41-802c-9a89c0795e51 tempest-VolumesSnapshotTestJSON-1454524182 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-764a7e2c-ef7a-407e-bf01-7a297257f31a {{(pid=88568) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 30 16:58:25 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-b44e0e89-9d18-4e41-802c-9a89c0795e51 tempest-VolumesSnapshotTestJSON-1454524182 None] Creating direct copy from snapshot {{(pid=88568) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 30 16:58:25 devstack cinder-volume[88568]: DEBUG cinder.utils [None req-b44e0e89-9d18-4e41-802c-9a89c0795e51 tempest-VolumesSnapshotTestJSON-1454524182 None] Path /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7877a22c-c181-4570-96c0-2b5e2d8bbd12 not found in is_blk_device check {{(pid=88568) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 30 16:58:25 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-b44e0e89-9d18-4e41-802c-9a89c0795e51 tempest-VolumesSnapshotTestJSON-1454524182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-764a7e2c-ef7a-407e-bf01-7a297257f31a /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7877a22c-c181-4570-96c0-2b5e2d8bbd12 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:25 devstack sudo[99623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-764a7e2c-ef7a-407e-bf01-7a297257f31a /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7877a22c-c181-4570-96c0-2b5e2d8bbd12 Jul 30 16:58:25 devstack sudo[99623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:31 devstack sudo[99623]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:31 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-b44e0e89-9d18-4e41-802c-9a89c0795e51 tempest-VolumesSnapshotTestJSON-1454524182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-764a7e2c-ef7a-407e-bf01-7a297257f31a /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7877a22c-c181-4570-96c0-2b5e2d8bbd12" returned: 0 in 5.674s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:31 devstack cinder-volume[88568]: DEBUG cinder.image.image_utils [None req-b44e0e89-9d18-4e41-802c-9a89c0795e51 tempest-VolumesSnapshotTestJSON-1454524182 None] Image conversion details: src /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-764a7e2c-ef7a-407e-bf01-7a297257f31a, size 1024.00 MB, duration 5.68 sec, destination /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7877a22c-c181-4570-96c0-2b5e2d8bbd12 {{(pid=88568) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 16:58:31 devstack cinder-volume[88568]: INFO cinder.image.image_utils [None req-b44e0e89-9d18-4e41-802c-9a89c0795e51 tempest-VolumesSnapshotTestJSON-1454524182 None] Converted 1024.00 MB image at 180.43 MB/s Jul 30 16:58:31 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-b44e0e89-9d18-4e41-802c-9a89c0795e51 tempest-VolumesSnapshotTestJSON-1454524182 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7877a22c-c181-4570-96c0-2b5e2d8bbd12 is being set with open permissions: ugo+rw Jul 30 16:58:31 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-b44e0e89-9d18-4e41-802c-9a89c0795e51 tempest-VolumesSnapshotTestJSON-1454524182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7877a22c-c181-4570-96c0-2b5e2d8bbd12 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:31 devstack sudo[99637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7877a22c-c181-4570-96c0-2b5e2d8bbd12 Jul 30 16:58:31 devstack sudo[99637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:31 devstack sudo[99637]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:31 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-b44e0e89-9d18-4e41-802c-9a89c0795e51 tempest-VolumesSnapshotTestJSON-1454524182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7877a22c-c181-4570-96c0-2b5e2d8bbd12" returned: 0 in 0.237s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:31 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-b44e0e89-9d18-4e41-802c-9a89c0795e51 tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "cinder-quobyte-7877a22c-c181-4570-96c0-2b5e2d8bbd12" released by "_copy_volume_from_snapshot" :: held 7.162s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:58:31 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-b44e0e89-9d18-4e41-802c-9a89c0795e51 tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "cinder-quobyte-c19ce9ca-976a-4653-8cfe-ff5409ecc347-7877a22c-c181-4570-96c0-2b5e2d8bbd12" released by "_create_volume_from_snapshot" :: held 7.283s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:58:31 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-b44e0e89-9d18-4e41-802c-9a89c0795e51 tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.406s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:58:31 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-347f5b72-2c66-4686-91ad-71d0aae6dff8 tempest-VolumesDeleteCascade-824361553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.203s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:58:31 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-347f5b72-2c66-4686-91ad-71d0aae6dff8 tempest-VolumesDeleteCascade-824361553 None] Creating offline snapshot c7ecf819-30ca-48ed-942a-b79d00b27929 of volume e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61 {{(pid=88568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:58:31 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b44e0e89-9d18-4e41-802c-9a89c0795e51 tempest-VolumesSnapshotTestJSON-1454524182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c27963f-5b1d-4148-a3a9-4e96f5485d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7877a22c-c181-4570-96c0-2b5e2d8bbd12', 'volume_size': 2, 'snapshot_id': 'c19ce9ca-976a-4653-8cfe-ff5409ecc347'}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:31 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b44e0e89-9d18-4e41-802c-9a89c0795e51 tempest-VolumesSnapshotTestJSON-1454524182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cdb48f3-ec8c-4d6a-8909-447610367784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:31 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[87822bd6-f148-425c-a77c-27a0321ce064]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:58:31 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-347f5b72-2c66-4686-91ad-71d0aae6dff8 tempest-VolumesDeleteCascade-824361553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:31 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-b44e0e89-9d18-4e41-802c-9a89c0795e51 tempest-VolumesSnapshotTestJSON-1454524182 None] Volume volume-7877a22c-c181-4570-96c0-2b5e2d8bbd12 (7877a22c-c181-4570-96c0-2b5e2d8bbd12): created successfully Jul 30 16:58:31 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b44e0e89-9d18-4e41-802c-9a89c0795e51 tempest-VolumesSnapshotTestJSON-1454524182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cdb48f3-ec8c-4d6a-8909-447610367784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:31 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b44e0e89-9d18-4e41-802c-9a89c0795e51 tempest-VolumesSnapshotTestJSON-1454524182 None] Flow 'volume_create_manager' (3d0c40d0-13ae-4d10-8afd-0db2da986d39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:58:31 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-b44e0e89-9d18-4e41-802c-9a89c0795e51 tempest-VolumesSnapshotTestJSON-1454524182 None] Created volume successfully. Jul 30 16:58:32 devstack sudo[99640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61 Jul 30 16:58:32 devstack sudo[99640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:32 devstack sudo[99640]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:32 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-347f5b72-2c66-4686-91ad-71d0aae6dff8 tempest-VolumesDeleteCascade-824361553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61" returned: 0 in 0.389s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:32 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-347f5b72-2c66-4686-91ad-71d0aae6dff8 tempest-VolumesDeleteCascade-824361553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61.c7ecf819-30ca-48ed-942a-b79d00b27929 1G {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:32 devstack sudo[99645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61.c7ecf819-30ca-48ed-942a-b79d00b27929 1G Jul 30 16:58:32 devstack sudo[99645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:32 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-b2fde03e-0ee8-41df-9c6d-c0f93e98f3bc tempest-VolumesSnapshotTestJSON-1454524182 None] Acquiring lock "cinder-7877a22c-c181-4570-96c0-2b5e2d8bbd12-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:58:32 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-b2fde03e-0ee8-41df-9c6d-c0f93e98f3bc tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "cinder-7877a22c-c181-4570-96c0-2b5e2d8bbd12-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:58:32 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-b2fde03e-0ee8-41df-9c6d-c0f93e98f3bc tempest-VolumesSnapshotTestJSON-1454524182 None] Acquiring lock "cinder-quobyte-7877a22c-c181-4570-96c0-2b5e2d8bbd12" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:58:32 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-b2fde03e-0ee8-41df-9c6d-c0f93e98f3bc tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "cinder-quobyte-7877a22c-c181-4570-96c0-2b5e2d8bbd12" acquired by "delete_volume" :: waited 0.024s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:58:32 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f0fb7b-c19f-44a7-ae86-640bce2cd93e]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:58:32 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-b2fde03e-0ee8-41df-9c6d-c0f93e98f3bc tempest-VolumesSnapshotTestJSON-1454524182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7877a22c-c181-4570-96c0-2b5e2d8bbd12 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:32 devstack sudo[99648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7877a22c-c181-4570-96c0-2b5e2d8bbd12 Jul 30 16:58:32 devstack sudo[99648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:32 devstack sudo[99645]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:32 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-347f5b72-2c66-4686-91ad-71d0aae6dff8 tempest-VolumesDeleteCascade-824361553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61.c7ecf819-30ca-48ed-942a-b79d00b27929 1G" returned: 0 in 0.415s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:32 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-347f5b72-2c66-4686-91ad-71d0aae6dff8 tempest-VolumesDeleteCascade-824361553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61.c7ecf819-30ca-48ed-942a-b79d00b27929 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:32 devstack sudo[99652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61.c7ecf819-30ca-48ed-942a-b79d00b27929 Jul 30 16:58:32 devstack sudo[99652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:32 devstack sudo[99648]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:32 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-b2fde03e-0ee8-41df-9c6d-c0f93e98f3bc tempest-VolumesSnapshotTestJSON-1454524182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7877a22c-c181-4570-96c0-2b5e2d8bbd12" returned: 0 in 0.388s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:32 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-b2fde03e-0ee8-41df-9c6d-c0f93e98f3bc tempest-VolumesSnapshotTestJSON-1454524182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7877a22c-c181-4570-96c0-2b5e2d8bbd12 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:32 devstack sudo[99657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7877a22c-c181-4570-96c0-2b5e2d8bbd12 Jul 30 16:58:32 devstack sudo[99657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:33 devstack sudo[99652]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:33 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-347f5b72-2c66-4686-91ad-71d0aae6dff8 tempest-VolumesDeleteCascade-824361553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61.c7ecf819-30ca-48ed-942a-b79d00b27929" returned: 0 in 0.344s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:33 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-347f5b72-2c66-4686-91ad-71d0aae6dff8 tempest-VolumesDeleteCascade-824361553 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61.c7ecf819-30ca-48ed-942a-b79d00b27929 is being set with open permissions: ugo+rw Jul 30 16:58:33 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-347f5b72-2c66-4686-91ad-71d0aae6dff8 tempest-VolumesDeleteCascade-824361553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61.c7ecf819-30ca-48ed-942a-b79d00b27929 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:33 devstack sudo[99662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61.c7ecf819-30ca-48ed-942a-b79d00b27929 Jul 30 16:58:33 devstack sudo[99662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:33 devstack sudo[99657]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:33 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-b2fde03e-0ee8-41df-9c6d-c0f93e98f3bc tempest-VolumesSnapshotTestJSON-1454524182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7877a22c-c181-4570-96c0-2b5e2d8bbd12" returned: 0 in 0.284s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:33 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-b2fde03e-0ee8-41df-9c6d-c0f93e98f3bc tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "cinder-quobyte-7877a22c-c181-4570-96c0-2b5e2d8bbd12" released by "delete_volume" :: held 0.719s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:58:33 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-b2fde03e-0ee8-41df-9c6d-c0f93e98f3bc tempest-VolumesSnapshotTestJSON-1454524182 None] Created reservations ['42855a08-2b36-4299-b7b4-33093b10ec1a', '1eba2570-a7e2-45e0-9856-483b1738179f', '41b1cd3e-1e1c-475e-b23d-c24c5a8b2e8d', 'f84698d3-0eca-43fd-b4ee-b3d9053f43e9'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:58:33 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-b2fde03e-0ee8-41df-9c6d-c0f93e98f3bc tempest-VolumesSnapshotTestJSON-1454524182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:58:33 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-b2fde03e-0ee8-41df-9c6d-c0f93e98f3bc tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:58:33 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-b2fde03e-0ee8-41df-9c6d-c0f93e98f3bc tempest-VolumesSnapshotTestJSON-1454524182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:58:33 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-b2fde03e-0ee8-41df-9c6d-c0f93e98f3bc tempest-VolumesSnapshotTestJSON-1454524182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:58:33 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-b2fde03e-0ee8-41df-9c6d-c0f93e98f3bc tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:58:33 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-b2fde03e-0ee8-41df-9c6d-c0f93e98f3bc tempest-VolumesSnapshotTestJSON-1454524182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:33 devstack sudo[99666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:58:33 devstack sudo[99666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:33 devstack sudo[99662]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:33 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-347f5b72-2c66-4686-91ad-71d0aae6dff8 tempest-VolumesDeleteCascade-824361553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61.c7ecf819-30ca-48ed-942a-b79d00b27929" returned: 0 in 0.325s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:33 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-347f5b72-2c66-4686-91ad-71d0aae6dff8 tempest-VolumesDeleteCascade-824361553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:33 devstack sudo[99668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61.info Jul 30 16:58:33 devstack sudo[99668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:33 devstack sudo[99666]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:33 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-b2fde03e-0ee8-41df-9c6d-c0f93e98f3bc tempest-VolumesSnapshotTestJSON-1454524182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.337s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:33 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-b2fde03e-0ee8-41df-9c6d-c0f93e98f3bc tempest-VolumesSnapshotTestJSON-1454524182 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:58:33 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-b2fde03e-0ee8-41df-9c6d-c0f93e98f3bc tempest-VolumesSnapshotTestJSON-1454524182 None] Deleted volume successfully. Jul 30 16:58:33 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-35472d57-dcd8-4aad-9f1b-093f062184c8 tempest-VolumesSnapshotTestJSON-1454524182 None] Acquiring lock "cinder-c19ce9ca-976a-4653-8cfe-ff5409ecc347-delete_snapshot" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:58:33 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-b2fde03e-0ee8-41df-9c6d-c0f93e98f3bc tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "cinder-7877a22c-c181-4570-96c0-2b5e2d8bbd12-delete_volume" released by "delete_volume" :: held 1.342s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:58:33 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-35472d57-dcd8-4aad-9f1b-093f062184c8 tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "cinder-c19ce9ca-976a-4653-8cfe-ff5409ecc347-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:58:33 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-35472d57-dcd8-4aad-9f1b-093f062184c8 tempest-VolumesSnapshotTestJSON-1454524182 None] Acquiring lock "cinder-quobyte-764a7e2c-ef7a-407e-bf01-7a297257f31a" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:58:33 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-35472d57-dcd8-4aad-9f1b-093f062184c8 tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "cinder-quobyte-764a7e2c-ef7a-407e-bf01-7a297257f31a" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:58:33 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-35472d57-dcd8-4aad-9f1b-093f062184c8 tempest-VolumesSnapshotTestJSON-1454524182 None] Acquiring lock "cinder-quobyte-c19ce9ca-976a-4653-8cfe-ff5409ecc347" by "_delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:58:33 devstack sudo[99668]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:33 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-347f5b72-2c66-4686-91ad-71d0aae6dff8 tempest-VolumesDeleteCascade-824361553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61.info" returned: 0 in 0.367s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:33 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-347f5b72-2c66-4686-91ad-71d0aae6dff8 tempest-VolumesDeleteCascade-824361553 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61.info is being set with open permissions: ugo+rw Jul 30 16:58:33 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-347f5b72-2c66-4686-91ad-71d0aae6dff8 tempest-VolumesDeleteCascade-824361553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:33 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-35472d57-dcd8-4aad-9f1b-093f062184c8 tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "cinder-quobyte-c19ce9ca-976a-4653-8cfe-ff5409ecc347" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:58:33 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-35472d57-dcd8-4aad-9f1b-093f062184c8 tempest-VolumesSnapshotTestJSON-1454524182 None] Deleting offline snapshot c19ce9ca-976a-4653-8cfe-ff5409ecc347 of volume 764a7e2c-ef7a-407e-bf01-7a297257f31a {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:58:33 devstack sudo[99672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61.info Jul 30 16:58:33 devstack sudo[99672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:33 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-35472d57-dcd8-4aad-9f1b-093f062184c8 tempest-VolumesSnapshotTestJSON-1454524182 None] snapshot_file for this snap is: volume-764a7e2c-ef7a-407e-bf01-7a297257f31a.c19ce9ca-976a-4653-8cfe-ff5409ecc347 {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:58:33 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6398eaa-6a31-4ae4-ab50-15199efbd53d]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:58:33 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-35472d57-dcd8-4aad-9f1b-093f062184c8 tempest-VolumesSnapshotTestJSON-1454524182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-764a7e2c-ef7a-407e-bf01-7a297257f31a.c19ce9ca-976a-4653-8cfe-ff5409ecc347 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:33 devstack sudo[99674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-764a7e2c-ef7a-407e-bf01-7a297257f31a.c19ce9ca-976a-4653-8cfe-ff5409ecc347 Jul 30 16:58:33 devstack sudo[99674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:34 devstack sudo[99672]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:34 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-347f5b72-2c66-4686-91ad-71d0aae6dff8 tempest-VolumesDeleteCascade-824361553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61.info" returned: 0 in 0.248s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:34 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-347f5b72-2c66-4686-91ad-71d0aae6dff8 tempest-VolumesDeleteCascade-824361553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.201s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:58:34 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-f9c9fe7d-9c1e-494a-9180-8f51477df27a tempest-VolumesGetTest-1105605191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.773s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:58:34 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-f9c9fe7d-9c1e-494a-9180-8f51477df27a tempest-VolumesGetTest-1105605191 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:58:25Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2025130900',display_name='tempest-VolumesGetTest-Volume-1206599739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3ba3e96-10a0-4d6f-b24c-ad8fa68d7743,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bea33560340472bac2e4927a1080f4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:58:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:58:25Z,use_quota=True,user_id='7079e6f8867c456bbafdd16180e334f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:58:34 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-f9c9fe7d-9c1e-494a-9180-8f51477df27a tempest-VolumesGetTest-1105605191 None] Creating volume f3ba3e96-10a0-4d6f-b24c-ad8fa68d7743 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:58:34 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-f9c9fe7d-9c1e-494a-9180-8f51477df27a tempest-VolumesGetTest-1105605191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:58:34 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-f9c9fe7d-9c1e-494a-9180-8f51477df27a tempest-VolumesGetTest-1105605191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:58:34 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-f9c9fe7d-9c1e-494a-9180-8f51477df27a tempest-VolumesGetTest-1105605191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:58:34 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-f9c9fe7d-9c1e-494a-9180-8f51477df27a tempest-VolumesGetTest-1105605191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:58:34 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-f9c9fe7d-9c1e-494a-9180-8f51477df27a tempest-VolumesGetTest-1105605191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:58:34 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-f9c9fe7d-9c1e-494a-9180-8f51477df27a tempest-VolumesGetTest-1105605191 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:58:34 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-f9c9fe7d-9c1e-494a-9180-8f51477df27a tempest-VolumesGetTest-1105605191 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 16:58:34 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f9c9fe7d-9c1e-494a-9180-8f51477df27a tempest-VolumesGetTest-1105605191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f3ba3e96-10a0-4d6f-b24c-ad8fa68d7743 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:34 devstack sudo[99691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f3ba3e96-10a0-4d6f-b24c-ad8fa68d7743 1073741824 Jul 30 16:58:34 devstack sudo[99691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:34 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-347f5b72-2c66-4686-91ad-71d0aae6dff8 tempest-VolumesDeleteCascade-824361553 None] Create snapshot completed successfully Jul 30 16:58:34 devstack sudo[99674]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:34 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-35472d57-dcd8-4aad-9f1b-093f062184c8 tempest-VolumesSnapshotTestJSON-1454524182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-764a7e2c-ef7a-407e-bf01-7a297257f31a.c19ce9ca-976a-4653-8cfe-ff5409ecc347" returned: 0 in 0.572s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:34 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-35472d57-dcd8-4aad-9f1b-093f062184c8 tempest-VolumesSnapshotTestJSON-1454524182 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-764a7e2c-ef7a-407e-bf01-7a297257f31a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:58:34 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e1c4f1-3d82-4f80-9495-e0a69d86f890]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:58:34 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-35472d57-dcd8-4aad-9f1b-093f062184c8 tempest-VolumesSnapshotTestJSON-1454524182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-764a7e2c-ef7a-407e-bf01-7a297257f31a {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:34 devstack sudo[99718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-764a7e2c-ef7a-407e-bf01-7a297257f31a Jul 30 16:58:34 devstack sudo[99718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:34 devstack sudo[99691]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:34 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f9c9fe7d-9c1e-494a-9180-8f51477df27a tempest-VolumesGetTest-1105605191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f3ba3e96-10a0-4d6f-b24c-ad8fa68d7743 1073741824" returned: 0 in 0.776s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:34 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f9c9fe7d-9c1e-494a-9180-8f51477df27a tempest-VolumesGetTest-1105605191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f3ba3e96-10a0-4d6f-b24c-ad8fa68d7743 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:34 devstack sudo[99746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f3ba3e96-10a0-4d6f-b24c-ad8fa68d7743 Jul 30 16:58:34 devstack sudo[99746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:35 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-678c62cf-3fc9-4b6f-b6c6-beb10f0fb638 tempest-VolumesDeleteCascade-824361553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:58:35 devstack sudo[99718]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:35 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-678c62cf-3fc9-4b6f-b6c6-beb10f0fb638 tempest-VolumesDeleteCascade-824361553 None] Flow 'volume_create_manager' (01f26eca-1aff-4bbe-b609-b19e97412a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:58:35 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-678c62cf-3fc9-4b6f-b6c6-beb10f0fb638 tempest-VolumesDeleteCascade-824361553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6427d278-e15a-4df7-bd2a-2be854be1f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-35472d57-dcd8-4aad-9f1b-093f062184c8 tempest-VolumesSnapshotTestJSON-1454524182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-764a7e2c-ef7a-407e-bf01-7a297257f31a" returned: 0 in 0.774s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-35472d57-dcd8-4aad-9f1b-093f062184c8 tempest-VolumesSnapshotTestJSON-1454524182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-764a7e2c-ef7a-407e-bf01-7a297257f31a.c19ce9ca-976a-4653-8cfe-ff5409ecc347 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:35 devstack sudo[99750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-764a7e2c-ef7a-407e-bf01-7a297257f31a.c19ce9ca-976a-4653-8cfe-ff5409ecc347 Jul 30 16:58:35 devstack sudo[99750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:35 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-678c62cf-3fc9-4b6f-b6c6-beb10f0fb638 tempest-VolumesDeleteCascade-824361553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6427d278-e15a-4df7-bd2a-2be854be1f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:58:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1537947837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f49a2cf-5e75-4d31-82c4-da2171fa9521,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d24cfc404784d1fa2288ea0de5982de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:58:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c7ecf819-30ca-48ed-942a-b79d00b27929,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:58:35Z,use_quota=True,user_id='472c553d709946489f0703e6c0c6e054',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:35 devstack sudo[99746]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:35 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-678c62cf-3fc9-4b6f-b6c6-beb10f0fb638 tempest-VolumesDeleteCascade-824361553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (605da76a-4da8-4cb3-a19e-3122f4afe5bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:35 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-678c62cf-3fc9-4b6f-b6c6-beb10f0fb638 tempest-VolumesDeleteCascade-824361553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (605da76a-4da8-4cb3-a19e-3122f4afe5bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:35 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-678c62cf-3fc9-4b6f-b6c6-beb10f0fb638 tempest-VolumesDeleteCascade-824361553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7809d97-f336-4eb0-8c29-27ab095dfb6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:35 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-678c62cf-3fc9-4b6f-b6c6-beb10f0fb638 tempest-VolumesDeleteCascade-824361553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7809d97-f336-4eb0-8c29-27ab095dfb6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5f49a2cf-5e75-4d31-82c4-da2171fa9521', 'volume_name': 'volume-5f49a2cf-5e75-4d31-82c4-da2171fa9521', 'volume_size': 1, 'snapshot_id': 'c7ecf819-30ca-48ed-942a-b79d00b27929'}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:35 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-678c62cf-3fc9-4b6f-b6c6-beb10f0fb638 tempest-VolumesDeleteCascade-824361553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d6242f2-359d-4ceb-9082-c33c4ac77120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:35 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-678c62cf-3fc9-4b6f-b6c6-beb10f0fb638 tempest-VolumesDeleteCascade-824361553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d6242f2-359d-4ceb-9082-c33c4ac77120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:35 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-678c62cf-3fc9-4b6f-b6c6-beb10f0fb638 tempest-VolumesDeleteCascade-824361553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfa1302a-97e4-4daf-b294-78cce4b3ebf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:35 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-678c62cf-3fc9-4b6f-b6c6-beb10f0fb638 tempest-VolumesDeleteCascade-824361553 None] Volume 5f49a2cf-5e75-4d31-82c4-da2171fa9521: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5f49a2cf-5e75-4d31-82c4-da2171fa9521', 'volume_size': 1, 'snapshot_id': 'c7ecf819-30ca-48ed-942a-b79d00b27929'} Jul 30 16:58:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f9c9fe7d-9c1e-494a-9180-8f51477df27a tempest-VolumesGetTest-1105605191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f3ba3e96-10a0-4d6f-b24c-ad8fa68d7743" returned: 0 in 0.403s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:35 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-f9c9fe7d-9c1e-494a-9180-8f51477df27a tempest-VolumesGetTest-1105605191 None] <== create_volume: return (1242ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:58:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-f9c9fe7d-9c1e-494a-9180-8f51477df27a tempest-VolumesGetTest-1105605191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.245s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:58:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-678c62cf-3fc9-4b6f-b6c6-beb10f0fb638 tempest-VolumesDeleteCascade-824361553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:58:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-678c62cf-3fc9-4b6f-b6c6-beb10f0fb638 tempest-VolumesDeleteCascade-824361553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:58:35 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-678c62cf-3fc9-4b6f-b6c6-beb10f0fb638 tempest-VolumesDeleteCascade-824361553 None] Acquiring lock "cinder-quobyte-c7ecf819-30ca-48ed-942a-b79d00b27929-5f49a2cf-5e75-4d31-82c4-da2171fa9521" by "_create_volume_from_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:58:35 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f9c9fe7d-9c1e-494a-9180-8f51477df27a tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1beecded-2653-46d3-a21f-06ef12e4c4b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3ba3e96-10a0-4d6f-b24c-ad8fa68d7743', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:35 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f9c9fe7d-9c1e-494a-9180-8f51477df27a tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6628c557-8774-4947-b889-72c6bfe1bd6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:35 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-f9c9fe7d-9c1e-494a-9180-8f51477df27a tempest-VolumesGetTest-1105605191 None] Volume volume-f3ba3e96-10a0-4d6f-b24c-ad8fa68d7743 (f3ba3e96-10a0-4d6f-b24c-ad8fa68d7743): created successfully Jul 30 16:58:35 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f9c9fe7d-9c1e-494a-9180-8f51477df27a tempest-VolumesGetTest-1105605191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6628c557-8774-4947-b889-72c6bfe1bd6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:35 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-f9c9fe7d-9c1e-494a-9180-8f51477df27a tempest-VolumesGetTest-1105605191 None] Flow 'volume_create_manager' (e85e9c3b-4c67-4c89-be23-efefc4183607) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:58:35 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-678c62cf-3fc9-4b6f-b6c6-beb10f0fb638 tempest-VolumesDeleteCascade-824361553 None] Lock "cinder-quobyte-c7ecf819-30ca-48ed-942a-b79d00b27929-5f49a2cf-5e75-4d31-82c4-da2171fa9521" acquired by "_create_volume_from_snapshot" :: waited 0.046s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:58:35 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-678c62cf-3fc9-4b6f-b6c6-beb10f0fb638 tempest-VolumesDeleteCascade-824361553 None] Creating volume 5f49a2cf-5e75-4d31-82c4-da2171fa9521 from snapshot c7ecf819-30ca-48ed-942a-b79d00b27929 {{(pid=88568) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 30 16:58:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-678c62cf-3fc9-4b6f-b6c6-beb10f0fb638 tempest-VolumesDeleteCascade-824361553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:58:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-678c62cf-3fc9-4b6f-b6c6-beb10f0fb638 tempest-VolumesDeleteCascade-824361553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:58:35 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-678c62cf-3fc9-4b6f-b6c6-beb10f0fb638 tempest-VolumesDeleteCascade-824361553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:58:35 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-678c62cf-3fc9-4b6f-b6c6-beb10f0fb638 tempest-VolumesDeleteCascade-824361553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:58:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-678c62cf-3fc9-4b6f-b6c6-beb10f0fb638 tempest-VolumesDeleteCascade-824361553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:58:35 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-678c62cf-3fc9-4b6f-b6c6-beb10f0fb638 tempest-VolumesDeleteCascade-824361553 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:58:35 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-678c62cf-3fc9-4b6f-b6c6-beb10f0fb638 tempest-VolumesDeleteCascade-824361553 None] Acquiring lock "cinder-quobyte-5f49a2cf-5e75-4d31-82c4-da2171fa9521" by "_copy_volume_from_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:58:35 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-678c62cf-3fc9-4b6f-b6c6-beb10f0fb638 tempest-VolumesDeleteCascade-824361553 None] Lock "cinder-quobyte-5f49a2cf-5e75-4d31-82c4-da2171fa9521" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:58:35 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-678c62cf-3fc9-4b6f-b6c6-beb10f0fb638 tempest-VolumesDeleteCascade-824361553 None] snapshot: c7ecf819-30ca-48ed-942a-b79d00b27929, volume: 5f49a2cf-5e75-4d31-82c4-da2171fa9521, {{(pid=88568) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 30 16:58:35 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-f9c9fe7d-9c1e-494a-9180-8f51477df27a tempest-VolumesGetTest-1105605191 None] Created volume successfully. Jul 30 16:58:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-678c62cf-3fc9-4b6f-b6c6-beb10f0fb638 tempest-VolumesDeleteCascade-824361553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:58:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-678c62cf-3fc9-4b6f-b6c6-beb10f0fb638 tempest-VolumesDeleteCascade-824361553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:58:35 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-678c62cf-3fc9-4b6f-b6c6-beb10f0fb638 tempest-VolumesDeleteCascade-824361553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:58:35 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-678c62cf-3fc9-4b6f-b6c6-beb10f0fb638 tempest-VolumesDeleteCascade-824361553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:58:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-678c62cf-3fc9-4b6f-b6c6-beb10f0fb638 tempest-VolumesDeleteCascade-824361553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:58:35 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[e010f443-d0ca-49b2-83fa-6c5bf5210404]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:58:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-678c62cf-3fc9-4b6f-b6c6-beb10f0fb638 tempest-VolumesDeleteCascade-824361553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61.c7ecf819-30ca-48ed-942a-b79d00b27929 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:35 devstack sudo[99752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61.c7ecf819-30ca-48ed-942a-b79d00b27929 Jul 30 16:58:35 devstack sudo[99752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:35 devstack sudo[99750]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-35472d57-dcd8-4aad-9f1b-093f062184c8 tempest-VolumesSnapshotTestJSON-1454524182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-764a7e2c-ef7a-407e-bf01-7a297257f31a.c19ce9ca-976a-4653-8cfe-ff5409ecc347" returned: 0 in 0.366s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-35472d57-dcd8-4aad-9f1b-093f062184c8 tempest-VolumesSnapshotTestJSON-1454524182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-764a7e2c-ef7a-407e-bf01-7a297257f31a.c19ce9ca-976a-4653-8cfe-ff5409ecc347 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:35 devstack sudo[99757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-764a7e2c-ef7a-407e-bf01-7a297257f31a.c19ce9ca-976a-4653-8cfe-ff5409ecc347 Jul 30 16:58:35 devstack sudo[99757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:35 devstack sudo[99752]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-678c62cf-3fc9-4b6f-b6c6-beb10f0fb638 tempest-VolumesDeleteCascade-824361553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61.c7ecf819-30ca-48ed-942a-b79d00b27929" returned: 0 in 0.365s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:35 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-678c62cf-3fc9-4b6f-b6c6-beb10f0fb638 tempest-VolumesDeleteCascade-824361553 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:58:35 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d2de268-d0d9-42dd-bba0-9292ada7732f]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:58:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-678c62cf-3fc9-4b6f-b6c6-beb10f0fb638 tempest-VolumesDeleteCascade-824361553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:35 devstack sudo[99757]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-35472d57-dcd8-4aad-9f1b-093f062184c8 tempest-VolumesSnapshotTestJSON-1454524182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-764a7e2c-ef7a-407e-bf01-7a297257f31a.c19ce9ca-976a-4653-8cfe-ff5409ecc347" returned: 0 in 0.253s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:35 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-35472d57-dcd8-4aad-9f1b-093f062184c8 tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "cinder-quobyte-c19ce9ca-976a-4653-8cfe-ff5409ecc347" released by "_delete_snapshot" :: held 2.086s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:58:35 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-35472d57-dcd8-4aad-9f1b-093f062184c8 tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "cinder-quobyte-764a7e2c-ef7a-407e-bf01-7a297257f31a" released by "delete_snapshot" :: held 2.125s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:58:35 devstack sudo[99763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61 Jul 30 16:58:35 devstack sudo[99763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:35 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-35472d57-dcd8-4aad-9f1b-093f062184c8 tempest-VolumesSnapshotTestJSON-1454524182 None] Created reservations ['292873cd-92dd-4d7e-8740-56e3883e62b7', 'ac028aa3-8eb0-4173-bb6e-ac409b16b28c', 'f93decb1-fcaf-4b68-bdde-51f5bb918f68', '8b3da85d-7a61-4ba4-b030-85ee7a6e3018'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:58:36 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-35472d57-dcd8-4aad-9f1b-093f062184c8 tempest-VolumesSnapshotTestJSON-1454524182 None] Delete snapshot completed successfully. Jul 30 16:58:36 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-35472d57-dcd8-4aad-9f1b-093f062184c8 tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "cinder-c19ce9ca-976a-4653-8cfe-ff5409ecc347-delete_snapshot" released by "delete_snapshot" :: held 2.269s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:58:36 devstack sudo[99763]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-678c62cf-3fc9-4b6f-b6c6-beb10f0fb638 tempest-VolumesDeleteCascade-824361553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61" returned: 0 in 0.361s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:36 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-678c62cf-3fc9-4b6f-b6c6-beb10f0fb638 tempest-VolumesDeleteCascade-824361553 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61 {{(pid=88568) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 30 16:58:36 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-678c62cf-3fc9-4b6f-b6c6-beb10f0fb638 tempest-VolumesDeleteCascade-824361553 None] Creating direct copy from snapshot {{(pid=88568) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 30 16:58:36 devstack cinder-volume[88568]: DEBUG cinder.utils [None req-678c62cf-3fc9-4b6f-b6c6-beb10f0fb638 tempest-VolumesDeleteCascade-824361553 None] Path /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5f49a2cf-5e75-4d31-82c4-da2171fa9521 not found in is_blk_device check {{(pid=88568) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 30 16:58:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-678c62cf-3fc9-4b6f-b6c6-beb10f0fb638 tempest-VolumesDeleteCascade-824361553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5f49a2cf-5e75-4d31-82c4-da2171fa9521 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:36 devstack sudo[99768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5f49a2cf-5e75-4d31-82c4-da2171fa9521 Jul 30 16:58:36 devstack sudo[99768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:36 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-0c16c5a1-417f-4570-bd3b-a18401cb3114 tempest-VolumesGetTest-1105605191 None] Acquiring lock "cinder-f3ba3e96-10a0-4d6f-b24c-ad8fa68d7743-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:58:36 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-0c16c5a1-417f-4570-bd3b-a18401cb3114 tempest-VolumesGetTest-1105605191 None] Lock "cinder-f3ba3e96-10a0-4d6f-b24c-ad8fa68d7743-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:58:36 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-0c16c5a1-417f-4570-bd3b-a18401cb3114 tempest-VolumesGetTest-1105605191 None] Acquiring lock "cinder-quobyte-f3ba3e96-10a0-4d6f-b24c-ad8fa68d7743" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:58:36 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-0c16c5a1-417f-4570-bd3b-a18401cb3114 tempest-VolumesGetTest-1105605191 None] Lock "cinder-quobyte-f3ba3e96-10a0-4d6f-b24c-ad8fa68d7743" acquired by "delete_volume" :: waited 0.034s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:58:36 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a684d5-6c15-4835-8780-f813943d21ed]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:58:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0c16c5a1-417f-4570-bd3b-a18401cb3114 tempest-VolumesGetTest-1105605191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f3ba3e96-10a0-4d6f-b24c-ad8fa68d7743 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:36 devstack sudo[99780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f3ba3e96-10a0-4d6f-b24c-ad8fa68d7743 Jul 30 16:58:36 devstack sudo[99780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:37 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-73f5451d-48b7-4897-a3e8-2ed34d3d3a03 tempest-VolumesSnapshotTestJSON-1454524182 None] Acquiring lock "cinder-764a7e2c-ef7a-407e-bf01-7a297257f31a-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:58:37 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-73f5451d-48b7-4897-a3e8-2ed34d3d3a03 tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "cinder-764a7e2c-ef7a-407e-bf01-7a297257f31a-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:58:37 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-73f5451d-48b7-4897-a3e8-2ed34d3d3a03 tempest-VolumesSnapshotTestJSON-1454524182 None] Acquiring lock "cinder-quobyte-764a7e2c-ef7a-407e-bf01-7a297257f31a" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:58:37 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-73f5451d-48b7-4897-a3e8-2ed34d3d3a03 tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "cinder-quobyte-764a7e2c-ef7a-407e-bf01-7a297257f31a" acquired by "delete_volume" :: waited 0.028s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:58:37 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c3bfa6-33c7-48cc-91dd-3cb90e5df588]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:58:37 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-73f5451d-48b7-4897-a3e8-2ed34d3d3a03 tempest-VolumesSnapshotTestJSON-1454524182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-764a7e2c-ef7a-407e-bf01-7a297257f31a {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:37 devstack sudo[99784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-764a7e2c-ef7a-407e-bf01-7a297257f31a Jul 30 16:58:37 devstack sudo[99784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:37 devstack sudo[99780]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:37 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0c16c5a1-417f-4570-bd3b-a18401cb3114 tempest-VolumesGetTest-1105605191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f3ba3e96-10a0-4d6f-b24c-ad8fa68d7743" returned: 0 in 1.048s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:37 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0c16c5a1-417f-4570-bd3b-a18401cb3114 tempest-VolumesGetTest-1105605191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f3ba3e96-10a0-4d6f-b24c-ad8fa68d7743 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:37 devstack sudo[99789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f3ba3e96-10a0-4d6f-b24c-ad8fa68d7743 Jul 30 16:58:37 devstack sudo[99789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:38 devstack sudo[99789]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:38 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0c16c5a1-417f-4570-bd3b-a18401cb3114 tempest-VolumesGetTest-1105605191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f3ba3e96-10a0-4d6f-b24c-ad8fa68d7743" returned: 0 in 0.502s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:38 devstack sudo[99784]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:38 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-0c16c5a1-417f-4570-bd3b-a18401cb3114 tempest-VolumesGetTest-1105605191 None] Lock "cinder-quobyte-f3ba3e96-10a0-4d6f-b24c-ad8fa68d7743" released by "delete_volume" :: held 1.625s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:58:38 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-73f5451d-48b7-4897-a3e8-2ed34d3d3a03 tempest-VolumesSnapshotTestJSON-1454524182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-764a7e2c-ef7a-407e-bf01-7a297257f31a" returned: 0 in 0.898s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:38 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-73f5451d-48b7-4897-a3e8-2ed34d3d3a03 tempest-VolumesSnapshotTestJSON-1454524182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-764a7e2c-ef7a-407e-bf01-7a297257f31a {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:38 devstack sudo[99795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-764a7e2c-ef7a-407e-bf01-7a297257f31a Jul 30 16:58:38 devstack sudo[99795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:38 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-0c16c5a1-417f-4570-bd3b-a18401cb3114 tempest-VolumesGetTest-1105605191 None] Created reservations ['8456ef29-3bf4-4883-b8ca-30f9e653db07', '84d2a0e1-4d5c-428f-bd60-ab4cb9c349b9', 'efeb98d9-a5fc-4c71-89c0-2a32ad29965a', 'e3a948c3-0deb-42ea-9893-6a33eea4d84e'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:58:38 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-0c16c5a1-417f-4570-bd3b-a18401cb3114 tempest-VolumesGetTest-1105605191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:58:38 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-0c16c5a1-417f-4570-bd3b-a18401cb3114 tempest-VolumesGetTest-1105605191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:58:38 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-0c16c5a1-417f-4570-bd3b-a18401cb3114 tempest-VolumesGetTest-1105605191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:58:38 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-0c16c5a1-417f-4570-bd3b-a18401cb3114 tempest-VolumesGetTest-1105605191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:58:38 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-0c16c5a1-417f-4570-bd3b-a18401cb3114 tempest-VolumesGetTest-1105605191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:58:38 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0c16c5a1-417f-4570-bd3b-a18401cb3114 tempest-VolumesGetTest-1105605191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:38 devstack sudo[99797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:58:38 devstack sudo[99797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:38 devstack sudo[99795]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:38 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-73f5451d-48b7-4897-a3e8-2ed34d3d3a03 tempest-VolumesSnapshotTestJSON-1454524182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-764a7e2c-ef7a-407e-bf01-7a297257f31a" returned: 0 in 0.694s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:39 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-73f5451d-48b7-4897-a3e8-2ed34d3d3a03 tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "cinder-quobyte-764a7e2c-ef7a-407e-bf01-7a297257f31a" released by "delete_volume" :: held 1.722s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:58:39 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-73f5451d-48b7-4897-a3e8-2ed34d3d3a03 tempest-VolumesSnapshotTestJSON-1454524182 None] Created reservations ['8f1c2dcb-9ce0-42e5-b040-66dd994b2618', '7d4d15c8-adc0-4d9a-adf6-50f70d11581f', 'dd0493f4-00b4-4b76-8833-be1b35602888', '59b66b89-4b97-4472-9830-e86725a20a09'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:58:39 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-59b2e014-a822-4fb8-bf53-a7e2265a73d6 tempest-VolumesGetTest-1105605191 None] Acquiring lock "cinder-8817d7bc-693d-4a64-94b3-eac381a4a544-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:58:39 devstack sudo[99797]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:39 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0c16c5a1-417f-4570-bd3b-a18401cb3114 tempest-VolumesGetTest-1105605191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.725s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:39 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-0c16c5a1-417f-4570-bd3b-a18401cb3114 tempest-VolumesGetTest-1105605191 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:58:39 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-0c16c5a1-417f-4570-bd3b-a18401cb3114 tempest-VolumesGetTest-1105605191 None] Deleted volume successfully. Jul 30 16:58:39 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-59b2e014-a822-4fb8-bf53-a7e2265a73d6 tempest-VolumesGetTest-1105605191 None] Lock "cinder-8817d7bc-693d-4a64-94b3-eac381a4a544-delete_volume" acquired by "delete_volume" :: waited 0.107s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:58:39 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-0c16c5a1-417f-4570-bd3b-a18401cb3114 tempest-VolumesGetTest-1105605191 None] Lock "cinder-f3ba3e96-10a0-4d6f-b24c-ad8fa68d7743-delete_volume" released by "delete_volume" :: held 2.923s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:58:39 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-59b2e014-a822-4fb8-bf53-a7e2265a73d6 tempest-VolumesGetTest-1105605191 None] Acquiring lock "cinder-quobyte-8817d7bc-693d-4a64-94b3-eac381a4a544" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:58:39 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-73f5451d-48b7-4897-a3e8-2ed34d3d3a03 tempest-VolumesSnapshotTestJSON-1454524182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:58:39 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-73f5451d-48b7-4897-a3e8-2ed34d3d3a03 tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:58:39 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-73f5451d-48b7-4897-a3e8-2ed34d3d3a03 tempest-VolumesSnapshotTestJSON-1454524182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:58:39 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-73f5451d-48b7-4897-a3e8-2ed34d3d3a03 tempest-VolumesSnapshotTestJSON-1454524182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:58:39 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-73f5451d-48b7-4897-a3e8-2ed34d3d3a03 tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:58:39 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-73f5451d-48b7-4897-a3e8-2ed34d3d3a03 tempest-VolumesSnapshotTestJSON-1454524182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:39 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-59b2e014-a822-4fb8-bf53-a7e2265a73d6 tempest-VolumesGetTest-1105605191 None] Lock "cinder-quobyte-8817d7bc-693d-4a64-94b3-eac381a4a544" acquired by "delete_volume" :: waited 0.101s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:58:39 devstack sudo[99801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:58:39 devstack sudo[99801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:39 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[2986ac83-0ed2-4085-a0dc-fd19252770f5]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:58:39 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-59b2e014-a822-4fb8-bf53-a7e2265a73d6 tempest-VolumesGetTest-1105605191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8817d7bc-693d-4a64-94b3-eac381a4a544 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:40 devstack sudo[99803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8817d7bc-693d-4a64-94b3-eac381a4a544 Jul 30 16:58:40 devstack sudo[99803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:40 devstack sudo[99801]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:40 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-73f5451d-48b7-4897-a3e8-2ed34d3d3a03 tempest-VolumesSnapshotTestJSON-1454524182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.641s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:40 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-73f5451d-48b7-4897-a3e8-2ed34d3d3a03 tempest-VolumesSnapshotTestJSON-1454524182 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:58:40 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-73f5451d-48b7-4897-a3e8-2ed34d3d3a03 tempest-VolumesSnapshotTestJSON-1454524182 None] Deleted volume successfully. Jul 30 16:58:40 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-73f5451d-48b7-4897-a3e8-2ed34d3d3a03 tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "cinder-764a7e2c-ef7a-407e-bf01-7a297257f31a-delete_volume" released by "delete_volume" :: held 3.044s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:58:41 devstack sudo[99803]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:41 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-59b2e014-a822-4fb8-bf53-a7e2265a73d6 tempest-VolumesGetTest-1105605191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8817d7bc-693d-4a64-94b3-eac381a4a544" returned: 0 in 1.420s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:41 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-59b2e014-a822-4fb8-bf53-a7e2265a73d6 tempest-VolumesGetTest-1105605191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8817d7bc-693d-4a64-94b3-eac381a4a544 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:41 devstack sudo[99810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8817d7bc-693d-4a64-94b3-eac381a4a544 Jul 30 16:58:41 devstack sudo[99810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:41 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b396136-f78e-424e-97d2-db2e2d0aea43 tempest-VolumesSnapshotTestJSON-1454524182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:58:41 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-0b396136-f78e-424e-97d2-db2e2d0aea43 tempest-VolumesSnapshotTestJSON-1454524182 None] Flow 'volume_create_manager' (73d9ba91-e2b5-4466-ae7a-e6ebad5bc5f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:58:41 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-0b396136-f78e-424e-97d2-db2e2d0aea43 tempest-VolumesSnapshotTestJSON-1454524182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e3ec51f-7be0-4dff-a1c3-e6f93df0dc43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:41 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-0b396136-f78e-424e-97d2-db2e2d0aea43 tempest-VolumesSnapshotTestJSON-1454524182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e3ec51f-7be0-4dff-a1c3-e6f93df0dc43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:58:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2004931996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d883ab43-6486-4ba5-a0da-87142eba516e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26d8b9dd9f954ebf908cd619fefa3523',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:58:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:58:41Z,use_quota=True,user_id='05c871db56e4469bbcc891874329eee6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:41 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-0b396136-f78e-424e-97d2-db2e2d0aea43 tempest-VolumesSnapshotTestJSON-1454524182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a86812b9-17ce-48a0-95d9-bf1d3411c115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:41 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-0b396136-f78e-424e-97d2-db2e2d0aea43 tempest-VolumesSnapshotTestJSON-1454524182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a86812b9-17ce-48a0-95d9-bf1d3411c115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:41 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-0b396136-f78e-424e-97d2-db2e2d0aea43 tempest-VolumesSnapshotTestJSON-1454524182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cb80380-341a-4e35-a6c6-ab38ddf96b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:41 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-0b396136-f78e-424e-97d2-db2e2d0aea43 tempest-VolumesSnapshotTestJSON-1454524182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cb80380-341a-4e35-a6c6-ab38ddf96b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd883ab43-6486-4ba5-a0da-87142eba516e', 'volume_name': 'volume-d883ab43-6486-4ba5-a0da-87142eba516e', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:41 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-0b396136-f78e-424e-97d2-db2e2d0aea43 tempest-VolumesSnapshotTestJSON-1454524182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8d46dbb-861d-4c20-a338-01474405c9ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:41 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-0b396136-f78e-424e-97d2-db2e2d0aea43 tempest-VolumesSnapshotTestJSON-1454524182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8d46dbb-861d-4c20-a338-01474405c9ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:41 devstack sudo[99810]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:41 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-0b396136-f78e-424e-97d2-db2e2d0aea43 tempest-VolumesSnapshotTestJSON-1454524182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c759e51-9ade-4def-96d1-cde6d317181e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:41 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-0b396136-f78e-424e-97d2-db2e2d0aea43 tempest-VolumesSnapshotTestJSON-1454524182 None] Volume d883ab43-6486-4ba5-a0da-87142eba516e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d883ab43-6486-4ba5-a0da-87142eba516e', 'volume_size': 1} Jul 30 16:58:41 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-0b396136-f78e-424e-97d2-db2e2d0aea43 tempest-VolumesSnapshotTestJSON-1454524182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:58:41 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-59b2e014-a822-4fb8-bf53-a7e2265a73d6 tempest-VolumesGetTest-1105605191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8817d7bc-693d-4a64-94b3-eac381a4a544" returned: 0 in 0.507s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:41 devstack sudo[99768]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:41 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-678c62cf-3fc9-4b6f-b6c6-beb10f0fb638 tempest-VolumesDeleteCascade-824361553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5f49a2cf-5e75-4d31-82c4-da2171fa9521" returned: 0 in 5.479s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:41 devstack cinder-volume[88568]: DEBUG cinder.image.image_utils [None req-678c62cf-3fc9-4b6f-b6c6-beb10f0fb638 tempest-VolumesDeleteCascade-824361553 None] Image conversion details: src /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61, size 1024.00 MB, duration 5.48 sec, destination /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5f49a2cf-5e75-4d31-82c4-da2171fa9521 {{(pid=88568) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 16:58:41 devstack cinder-volume[88568]: INFO cinder.image.image_utils [None req-678c62cf-3fc9-4b6f-b6c6-beb10f0fb638 tempest-VolumesDeleteCascade-824361553 None] Converted 1024.00 MB image at 186.88 MB/s Jul 30 16:58:41 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-678c62cf-3fc9-4b6f-b6c6-beb10f0fb638 tempest-VolumesDeleteCascade-824361553 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5f49a2cf-5e75-4d31-82c4-da2171fa9521 is being set with open permissions: ugo+rw Jul 30 16:58:41 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-678c62cf-3fc9-4b6f-b6c6-beb10f0fb638 tempest-VolumesDeleteCascade-824361553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5f49a2cf-5e75-4d31-82c4-da2171fa9521 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:41 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-59b2e014-a822-4fb8-bf53-a7e2265a73d6 tempest-VolumesGetTest-1105605191 None] Lock "cinder-quobyte-8817d7bc-693d-4a64-94b3-eac381a4a544" released by "delete_volume" :: held 2.039s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:58:41 devstack sudo[99813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5f49a2cf-5e75-4d31-82c4-da2171fa9521 Jul 30 16:58:41 devstack sudo[99813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:41 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-59b2e014-a822-4fb8-bf53-a7e2265a73d6 tempest-VolumesGetTest-1105605191 None] Created reservations ['08a37684-4035-4326-a623-d89808b12747', '4679a352-0b36-4fe9-8354-69a46a87218b', 'fde84a1b-21a9-49bd-b34c-7bef1c95293c', '67185e9a-18a9-4d47-897f-18bb866e9ec6'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:58:41 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-59b2e014-a822-4fb8-bf53-a7e2265a73d6 tempest-VolumesGetTest-1105605191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:58:41 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-59b2e014-a822-4fb8-bf53-a7e2265a73d6 tempest-VolumesGetTest-1105605191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:58:41 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-59b2e014-a822-4fb8-bf53-a7e2265a73d6 tempest-VolumesGetTest-1105605191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:58:41 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-59b2e014-a822-4fb8-bf53-a7e2265a73d6 tempest-VolumesGetTest-1105605191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:58:41 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-59b2e014-a822-4fb8-bf53-a7e2265a73d6 tempest-VolumesGetTest-1105605191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:58:41 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-59b2e014-a822-4fb8-bf53-a7e2265a73d6 tempest-VolumesGetTest-1105605191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:41 devstack sudo[99815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:58:41 devstack sudo[99815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:41 devstack sudo[99813]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:41 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-678c62cf-3fc9-4b6f-b6c6-beb10f0fb638 tempest-VolumesDeleteCascade-824361553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5f49a2cf-5e75-4d31-82c4-da2171fa9521" returned: 0 in 0.318s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:41 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-678c62cf-3fc9-4b6f-b6c6-beb10f0fb638 tempest-VolumesDeleteCascade-824361553 None] Lock "cinder-quobyte-5f49a2cf-5e75-4d31-82c4-da2171fa9521" released by "_copy_volume_from_snapshot" :: held 6.619s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:58:42 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-678c62cf-3fc9-4b6f-b6c6-beb10f0fb638 tempest-VolumesDeleteCascade-824361553 None] Lock "cinder-quobyte-c7ecf819-30ca-48ed-942a-b79d00b27929-5f49a2cf-5e75-4d31-82c4-da2171fa9521" released by "_create_volume_from_snapshot" :: held 6.722s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:58:42 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-678c62cf-3fc9-4b6f-b6c6-beb10f0fb638 tempest-VolumesDeleteCascade-824361553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.769s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:58:42 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-0b396136-f78e-424e-97d2-db2e2d0aea43 tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.456s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:58:42 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-0b396136-f78e-424e-97d2-db2e2d0aea43 tempest-VolumesSnapshotTestJSON-1454524182 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:58:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2004931996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d883ab43-6486-4ba5-a0da-87142eba516e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26d8b9dd9f954ebf908cd619fefa3523',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:58:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:58:41Z,use_quota=True,user_id='05c871db56e4469bbcc891874329eee6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:58:42 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-0b396136-f78e-424e-97d2-db2e2d0aea43 tempest-VolumesSnapshotTestJSON-1454524182 None] Creating volume d883ab43-6486-4ba5-a0da-87142eba516e {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:58:42 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-0b396136-f78e-424e-97d2-db2e2d0aea43 tempest-VolumesSnapshotTestJSON-1454524182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:58:42 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-0b396136-f78e-424e-97d2-db2e2d0aea43 tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:58:42 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-0b396136-f78e-424e-97d2-db2e2d0aea43 tempest-VolumesSnapshotTestJSON-1454524182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:58:42 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-0b396136-f78e-424e-97d2-db2e2d0aea43 tempest-VolumesSnapshotTestJSON-1454524182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:58:42 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-0b396136-f78e-424e-97d2-db2e2d0aea43 tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:58:42 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-0b396136-f78e-424e-97d2-db2e2d0aea43 tempest-VolumesSnapshotTestJSON-1454524182 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:58:42 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-0b396136-f78e-424e-97d2-db2e2d0aea43 tempest-VolumesSnapshotTestJSON-1454524182 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 16:58:42 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0b396136-f78e-424e-97d2-db2e2d0aea43 tempest-VolumesSnapshotTestJSON-1454524182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d883ab43-6486-4ba5-a0da-87142eba516e 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:42 devstack sudo[99818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d883ab43-6486-4ba5-a0da-87142eba516e 1073741824 Jul 30 16:58:42 devstack sudo[99818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:42 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-678c62cf-3fc9-4b6f-b6c6-beb10f0fb638 tempest-VolumesDeleteCascade-824361553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfa1302a-97e4-4daf-b294-78cce4b3ebf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f49a2cf-5e75-4d31-82c4-da2171fa9521', 'volume_size': 1, 'snapshot_id': 'c7ecf819-30ca-48ed-942a-b79d00b27929'}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:42 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-678c62cf-3fc9-4b6f-b6c6-beb10f0fb638 tempest-VolumesDeleteCascade-824361553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c74e924-e738-4c06-be80-993cb0ae3975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:42 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-678c62cf-3fc9-4b6f-b6c6-beb10f0fb638 tempest-VolumesDeleteCascade-824361553 None] Volume volume-5f49a2cf-5e75-4d31-82c4-da2171fa9521 (5f49a2cf-5e75-4d31-82c4-da2171fa9521): created successfully Jul 30 16:58:42 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-678c62cf-3fc9-4b6f-b6c6-beb10f0fb638 tempest-VolumesDeleteCascade-824361553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c74e924-e738-4c06-be80-993cb0ae3975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:42 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-678c62cf-3fc9-4b6f-b6c6-beb10f0fb638 tempest-VolumesDeleteCascade-824361553 None] Flow 'volume_create_manager' (01f26eca-1aff-4bbe-b609-b19e97412a14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:58:42 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-678c62cf-3fc9-4b6f-b6c6-beb10f0fb638 tempest-VolumesDeleteCascade-824361553 None] Created volume successfully. Jul 30 16:58:42 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-59b2e014-a822-4fb8-bf53-a7e2265a73d6 tempest-VolumesGetTest-1105605191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.413s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:42 devstack sudo[99815]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:42 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-59b2e014-a822-4fb8-bf53-a7e2265a73d6 tempest-VolumesGetTest-1105605191 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:58:42 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-59b2e014-a822-4fb8-bf53-a7e2265a73d6 tempest-VolumesGetTest-1105605191 None] Deleted volume successfully. Jul 30 16:58:42 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-59b2e014-a822-4fb8-bf53-a7e2265a73d6 tempest-VolumesGetTest-1105605191 None] Lock "cinder-8817d7bc-693d-4a64-94b3-eac381a4a544-delete_volume" released by "delete_volume" :: held 2.900s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:58:42 devstack sudo[99818]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:42 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0b396136-f78e-424e-97d2-db2e2d0aea43 tempest-VolumesSnapshotTestJSON-1454524182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d883ab43-6486-4ba5-a0da-87142eba516e 1073741824" returned: 0 in 0.538s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:42 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0b396136-f78e-424e-97d2-db2e2d0aea43 tempest-VolumesSnapshotTestJSON-1454524182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d883ab43-6486-4ba5-a0da-87142eba516e {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:42 devstack sudo[99825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d883ab43-6486-4ba5-a0da-87142eba516e Jul 30 16:58:42 devstack sudo[99825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:43 devstack sudo[99825]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:43 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0b396136-f78e-424e-97d2-db2e2d0aea43 tempest-VolumesSnapshotTestJSON-1454524182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d883ab43-6486-4ba5-a0da-87142eba516e" returned: 0 in 0.338s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:43 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-0b396136-f78e-424e-97d2-db2e2d0aea43 tempest-VolumesSnapshotTestJSON-1454524182 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:58:43 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-0b396136-f78e-424e-97d2-db2e2d0aea43 tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:58:43 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-0b396136-f78e-424e-97d2-db2e2d0aea43 tempest-VolumesSnapshotTestJSON-1454524182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c759e51-9ade-4def-96d1-cde6d317181e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d883ab43-6486-4ba5-a0da-87142eba516e', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:43 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-0b396136-f78e-424e-97d2-db2e2d0aea43 tempest-VolumesSnapshotTestJSON-1454524182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02dfd57a-ecbf-4021-8629-3d40dae600eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:43 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-0b396136-f78e-424e-97d2-db2e2d0aea43 tempest-VolumesSnapshotTestJSON-1454524182 None] Volume volume-d883ab43-6486-4ba5-a0da-87142eba516e (d883ab43-6486-4ba5-a0da-87142eba516e): created successfully Jul 30 16:58:43 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-0b396136-f78e-424e-97d2-db2e2d0aea43 tempest-VolumesSnapshotTestJSON-1454524182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02dfd57a-ecbf-4021-8629-3d40dae600eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:43 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-0b396136-f78e-424e-97d2-db2e2d0aea43 tempest-VolumesSnapshotTestJSON-1454524182 None] Flow 'volume_create_manager' (73d9ba91-e2b5-4466-ae7a-e6ebad5bc5f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:58:43 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-0b396136-f78e-424e-97d2-db2e2d0aea43 tempest-VolumesSnapshotTestJSON-1454524182 None] Created volume successfully. Jul 30 16:58:43 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-365c6fb2-a909-4363-ab62-bab901be924d tempest-VolumesDeleteCascade-824361553 None] Acquiring lock "cinder-e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:58:43 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-365c6fb2-a909-4363-ab62-bab901be924d tempest-VolumesDeleteCascade-824361553 None] Lock "cinder-e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:58:43 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-365c6fb2-a909-4363-ab62-bab901be924d tempest-VolumesDeleteCascade-824361553 None] Performing cascade delete. {{(pid=88568) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 30 16:58:43 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-365c6fb2-a909-4363-ab62-bab901be924d tempest-VolumesDeleteCascade-824361553 None] Acquiring lock "cinder-c7ecf819-30ca-48ed-942a-b79d00b27929-delete_snapshot" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:58:43 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-365c6fb2-a909-4363-ab62-bab901be924d tempest-VolumesDeleteCascade-824361553 None] Lock "cinder-c7ecf819-30ca-48ed-942a-b79d00b27929-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:58:43 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-365c6fb2-a909-4363-ab62-bab901be924d tempest-VolumesDeleteCascade-824361553 None] Acquiring lock "cinder-quobyte-e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:58:43 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-365c6fb2-a909-4363-ab62-bab901be924d tempest-VolumesDeleteCascade-824361553 None] Lock "cinder-quobyte-e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:58:43 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-365c6fb2-a909-4363-ab62-bab901be924d tempest-VolumesDeleteCascade-824361553 None] Acquiring lock "cinder-quobyte-c7ecf819-30ca-48ed-942a-b79d00b27929" by "_delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:58:43 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-365c6fb2-a909-4363-ab62-bab901be924d tempest-VolumesDeleteCascade-824361553 None] Lock "cinder-quobyte-c7ecf819-30ca-48ed-942a-b79d00b27929" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:58:43 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-365c6fb2-a909-4363-ab62-bab901be924d tempest-VolumesDeleteCascade-824361553 None] Deleting offline snapshot c7ecf819-30ca-48ed-942a-b79d00b27929 of volume e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61 {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:58:43 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-365c6fb2-a909-4363-ab62-bab901be924d tempest-VolumesDeleteCascade-824361553 None] snapshot_file for this snap is: volume-e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61.c7ecf819-30ca-48ed-942a-b79d00b27929 {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:58:43 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[5765bb94-6d41-46ab-9aec-cd100912e58a]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:58:43 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-365c6fb2-a909-4363-ab62-bab901be924d tempest-VolumesDeleteCascade-824361553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61.c7ecf819-30ca-48ed-942a-b79d00b27929 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:43 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-1bbd2dec-a9f2-4f73-9427-90b66dbf1be4 tempest-VolumesSnapshotTestJSON-1454524182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:58:43 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-1bbd2dec-a9f2-4f73-9427-90b66dbf1be4 tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:58:43 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-1bbd2dec-a9f2-4f73-9427-90b66dbf1be4 tempest-VolumesSnapshotTestJSON-1454524182 None] Creating offline snapshot c9a92a9a-c10b-4d8a-88b8-3de40d21d531 of volume d883ab43-6486-4ba5-a0da-87142eba516e {{(pid=88568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:58:43 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[9078f03b-0f8e-4187-a596-1606cbfc576b]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:58:43 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-1bbd2dec-a9f2-4f73-9427-90b66dbf1be4 tempest-VolumesSnapshotTestJSON-1454524182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d883ab43-6486-4ba5-a0da-87142eba516e {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:43 devstack sudo[99828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61.c7ecf819-30ca-48ed-942a-b79d00b27929 Jul 30 16:58:43 devstack sudo[99828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:43 devstack sudo[99829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d883ab43-6486-4ba5-a0da-87142eba516e Jul 30 16:58:43 devstack sudo[99829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:43 devstack sudo[99828]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:43 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-365c6fb2-a909-4363-ab62-bab901be924d tempest-VolumesDeleteCascade-824361553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61.c7ecf819-30ca-48ed-942a-b79d00b27929" returned: 0 in 0.413s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:43 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-365c6fb2-a909-4363-ab62-bab901be924d tempest-VolumesDeleteCascade-824361553 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:58:43 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1a89ec-50e0-4b70-9bf1-a12d2048fd12]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:58:43 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-365c6fb2-a909-4363-ab62-bab901be924d tempest-VolumesDeleteCascade-824361553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:44 devstack sudo[99829]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:44 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-1bbd2dec-a9f2-4f73-9427-90b66dbf1be4 tempest-VolumesSnapshotTestJSON-1454524182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d883ab43-6486-4ba5-a0da-87142eba516e" returned: 0 in 0.403s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:44 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-1bbd2dec-a9f2-4f73-9427-90b66dbf1be4 tempest-VolumesSnapshotTestJSON-1454524182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d883ab43-6486-4ba5-a0da-87142eba516e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d883ab43-6486-4ba5-a0da-87142eba516e.c9a92a9a-c10b-4d8a-88b8-3de40d21d531 1G {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:44 devstack sudo[99840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d883ab43-6486-4ba5-a0da-87142eba516e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d883ab43-6486-4ba5-a0da-87142eba516e.c9a92a9a-c10b-4d8a-88b8-3de40d21d531 1G Jul 30 16:58:44 devstack sudo[99840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:44 devstack sudo[99839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61 Jul 30 16:58:44 devstack sudo[99839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:44 devstack sudo[99840]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:44 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-1bbd2dec-a9f2-4f73-9427-90b66dbf1be4 tempest-VolumesSnapshotTestJSON-1454524182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d883ab43-6486-4ba5-a0da-87142eba516e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d883ab43-6486-4ba5-a0da-87142eba516e.c9a92a9a-c10b-4d8a-88b8-3de40d21d531 1G" returned: 0 in 0.446s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:44 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-1bbd2dec-a9f2-4f73-9427-90b66dbf1be4 tempest-VolumesSnapshotTestJSON-1454524182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d883ab43-6486-4ba5-a0da-87142eba516e -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d883ab43-6486-4ba5-a0da-87142eba516e.c9a92a9a-c10b-4d8a-88b8-3de40d21d531 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:44 devstack sudo[99849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d883ab43-6486-4ba5-a0da-87142eba516e -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d883ab43-6486-4ba5-a0da-87142eba516e.c9a92a9a-c10b-4d8a-88b8-3de40d21d531 Jul 30 16:58:44 devstack sudo[99849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:44 devstack sudo[99839]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:44 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-365c6fb2-a909-4363-ab62-bab901be924d tempest-VolumesDeleteCascade-824361553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61" returned: 0 in 0.593s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:44 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-365c6fb2-a909-4363-ab62-bab901be924d tempest-VolumesDeleteCascade-824361553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61.c7ecf819-30ca-48ed-942a-b79d00b27929 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:44 devstack sudo[99853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61.c7ecf819-30ca-48ed-942a-b79d00b27929 Jul 30 16:58:44 devstack sudo[99853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:44 devstack sudo[99849]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:44 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-1bbd2dec-a9f2-4f73-9427-90b66dbf1be4 tempest-VolumesSnapshotTestJSON-1454524182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d883ab43-6486-4ba5-a0da-87142eba516e -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d883ab43-6486-4ba5-a0da-87142eba516e.c9a92a9a-c10b-4d8a-88b8-3de40d21d531" returned: 0 in 0.329s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:44 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-1bbd2dec-a9f2-4f73-9427-90b66dbf1be4 tempest-VolumesSnapshotTestJSON-1454524182 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d883ab43-6486-4ba5-a0da-87142eba516e.c9a92a9a-c10b-4d8a-88b8-3de40d21d531 is being set with open permissions: ugo+rw Jul 30 16:58:44 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-1bbd2dec-a9f2-4f73-9427-90b66dbf1be4 tempest-VolumesSnapshotTestJSON-1454524182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d883ab43-6486-4ba5-a0da-87142eba516e.c9a92a9a-c10b-4d8a-88b8-3de40d21d531 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:44 devstack sudo[99860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d883ab43-6486-4ba5-a0da-87142eba516e.c9a92a9a-c10b-4d8a-88b8-3de40d21d531 Jul 30 16:58:44 devstack sudo[99860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:44 devstack sudo[99853]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:44 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-365c6fb2-a909-4363-ab62-bab901be924d tempest-VolumesDeleteCascade-824361553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61.c7ecf819-30ca-48ed-942a-b79d00b27929" returned: 0 in 0.369s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:44 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-365c6fb2-a909-4363-ab62-bab901be924d tempest-VolumesDeleteCascade-824361553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61.c7ecf819-30ca-48ed-942a-b79d00b27929 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:44 devstack sudo[99865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61.c7ecf819-30ca-48ed-942a-b79d00b27929 Jul 30 16:58:44 devstack sudo[99865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:45 devstack sudo[99860]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:45 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-1bbd2dec-a9f2-4f73-9427-90b66dbf1be4 tempest-VolumesSnapshotTestJSON-1454524182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d883ab43-6486-4ba5-a0da-87142eba516e.c9a92a9a-c10b-4d8a-88b8-3de40d21d531" returned: 0 in 0.262s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:45 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-1bbd2dec-a9f2-4f73-9427-90b66dbf1be4 tempest-VolumesSnapshotTestJSON-1454524182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d883ab43-6486-4ba5-a0da-87142eba516e.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:45 devstack sudo[99868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d883ab43-6486-4ba5-a0da-87142eba516e.info Jul 30 16:58:45 devstack sudo[99868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:45 devstack sudo[99865]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:45 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-365c6fb2-a909-4363-ab62-bab901be924d tempest-VolumesDeleteCascade-824361553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61.c7ecf819-30ca-48ed-942a-b79d00b27929" returned: 0 in 0.251s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:45 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-365c6fb2-a909-4363-ab62-bab901be924d tempest-VolumesDeleteCascade-824361553 None] Lock "cinder-quobyte-c7ecf819-30ca-48ed-942a-b79d00b27929" released by "_delete_snapshot" :: held 1.752s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:58:45 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-365c6fb2-a909-4363-ab62-bab901be924d tempest-VolumesDeleteCascade-824361553 None] Lock "cinder-quobyte-e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61" released by "delete_snapshot" :: held 1.789s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:58:45 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-365c6fb2-a909-4363-ab62-bab901be924d tempest-VolumesDeleteCascade-824361553 None] Created reservations ['e07e45b2-6ba2-40a2-84ac-70d968052f6b', 'c9ff4db8-d503-4e00-afc2-b3f226695d78', 'c9e35e1b-3cdc-42cb-996c-c6ef1cdc2040', 'a14463d4-af34-4b09-a020-bea7662472b5'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:58:45 devstack sudo[99868]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:45 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-1bbd2dec-a9f2-4f73-9427-90b66dbf1be4 tempest-VolumesSnapshotTestJSON-1454524182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d883ab43-6486-4ba5-a0da-87142eba516e.info" returned: 0 in 0.272s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:45 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-1bbd2dec-a9f2-4f73-9427-90b66dbf1be4 tempest-VolumesSnapshotTestJSON-1454524182 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d883ab43-6486-4ba5-a0da-87142eba516e.info is being set with open permissions: ugo+rw Jul 30 16:58:45 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-1bbd2dec-a9f2-4f73-9427-90b66dbf1be4 tempest-VolumesSnapshotTestJSON-1454524182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d883ab43-6486-4ba5-a0da-87142eba516e.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:45 devstack sudo[99872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d883ab43-6486-4ba5-a0da-87142eba516e.info Jul 30 16:58:45 devstack sudo[99872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:45 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-365c6fb2-a909-4363-ab62-bab901be924d tempest-VolumesDeleteCascade-824361553 None] Delete snapshot completed successfully. Jul 30 16:58:45 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-365c6fb2-a909-4363-ab62-bab901be924d tempest-VolumesDeleteCascade-824361553 None] Lock "cinder-c7ecf819-30ca-48ed-942a-b79d00b27929-delete_snapshot" released by "delete_snapshot" :: held 2.004s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:58:45 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-365c6fb2-a909-4363-ab62-bab901be924d tempest-VolumesDeleteCascade-824361553 None] Snapshots deleted, issuing volume delete {{(pid=88568) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 30 16:58:45 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-365c6fb2-a909-4363-ab62-bab901be924d tempest-VolumesDeleteCascade-824361553 None] Acquiring lock "cinder-quobyte-e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:58:45 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-365c6fb2-a909-4363-ab62-bab901be924d tempest-VolumesDeleteCascade-824361553 None] Lock "cinder-quobyte-e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61" acquired by "delete_volume" :: waited 0.023s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:58:45 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c83b957-db15-4b4a-8206-bb72d7f7c9cc]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:58:45 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-365c6fb2-a909-4363-ab62-bab901be924d tempest-VolumesDeleteCascade-824361553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:45 devstack sudo[99874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61 Jul 30 16:58:45 devstack sudo[99874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:45 devstack sudo[99872]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:45 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-1bbd2dec-a9f2-4f73-9427-90b66dbf1be4 tempest-VolumesSnapshotTestJSON-1454524182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d883ab43-6486-4ba5-a0da-87142eba516e.info" returned: 0 in 0.288s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:45 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-1bbd2dec-a9f2-4f73-9427-90b66dbf1be4 tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.103s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:58:45 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-1bbd2dec-a9f2-4f73-9427-90b66dbf1be4 tempest-VolumesSnapshotTestJSON-1454524182 None] Create snapshot completed successfully Jul 30 16:58:45 devstack sudo[99874]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:45 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-365c6fb2-a909-4363-ab62-bab901be924d tempest-VolumesDeleteCascade-824361553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61" returned: 0 in 0.404s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:45 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-365c6fb2-a909-4363-ab62-bab901be924d tempest-VolumesDeleteCascade-824361553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:45 devstack sudo[99882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61 Jul 30 16:58:45 devstack sudo[99882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:46 devstack sudo[99882]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:46 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-365c6fb2-a909-4363-ab62-bab901be924d tempest-VolumesDeleteCascade-824361553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61" returned: 0 in 0.284s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:46 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-365c6fb2-a909-4363-ab62-bab901be924d tempest-VolumesDeleteCascade-824361553 None] Lock "cinder-quobyte-e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61" released by "delete_volume" :: held 0.774s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:58:46 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-365c6fb2-a909-4363-ab62-bab901be924d tempest-VolumesDeleteCascade-824361553 None] Created reservations ['f5dd5c3c-9d01-41bd-99e3-c5e4e11db4bd', '01cd88da-d619-481c-8358-8ce136a253a5', '10cd5160-7fd9-40cc-80be-d64cdb923c97', '4296d34e-5091-4116-8cc8-f5cb833619aa'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:58:46 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-365c6fb2-a909-4363-ab62-bab901be924d tempest-VolumesDeleteCascade-824361553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:58:46 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-365c6fb2-a909-4363-ab62-bab901be924d tempest-VolumesDeleteCascade-824361553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:58:46 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-365c6fb2-a909-4363-ab62-bab901be924d tempest-VolumesDeleteCascade-824361553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:58:46 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-365c6fb2-a909-4363-ab62-bab901be924d tempest-VolumesDeleteCascade-824361553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:58:46 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-365c6fb2-a909-4363-ab62-bab901be924d tempest-VolumesDeleteCascade-824361553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:58:46 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-365c6fb2-a909-4363-ab62-bab901be924d tempest-VolumesDeleteCascade-824361553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:46 devstack sudo[99885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:58:46 devstack sudo[99885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:46 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-063d43d3-ff3d-4f5b-b093-f930ae620e16 tempest-AttachVolumeNegativeTest-1037417113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:58:46 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-063d43d3-ff3d-4f5b-b093-f930ae620e16 tempest-AttachVolumeNegativeTest-1037417113 None] Flow 'volume_create_manager' (8949edc2-bf74-44e9-b222-9767a527c144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:58:46 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-063d43d3-ff3d-4f5b-b093-f930ae620e16 tempest-AttachVolumeNegativeTest-1037417113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (157686a2-9e33-4f7c-843b-701128ff0d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:46 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-063d43d3-ff3d-4f5b-b093-f930ae620e16 tempest-AttachVolumeNegativeTest-1037417113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (157686a2-9e33-4f7c-843b-701128ff0d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:58:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-981388021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d062b521-f575-4e5e-a2e7-2a91e1aca586,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9e601affb8f4aecbadcf75c60187e20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:58:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:58:47Z,use_quota=True,user_id='6bbe8f4a440a4bf18642093e7843287b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:46 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-063d43d3-ff3d-4f5b-b093-f930ae620e16 tempest-AttachVolumeNegativeTest-1037417113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08a4bb7f-efa4-41c7-8624-7fd01b347354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:46 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-063d43d3-ff3d-4f5b-b093-f930ae620e16 tempest-AttachVolumeNegativeTest-1037417113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08a4bb7f-efa4-41c7-8624-7fd01b347354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:46 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-063d43d3-ff3d-4f5b-b093-f930ae620e16 tempest-AttachVolumeNegativeTest-1037417113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76eb4d21-513f-4d3f-b057-63e3e7fbf51c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:46 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-063d43d3-ff3d-4f5b-b093-f930ae620e16 tempest-AttachVolumeNegativeTest-1037417113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76eb4d21-513f-4d3f-b057-63e3e7fbf51c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd062b521-f575-4e5e-a2e7-2a91e1aca586', 'volume_name': 'volume-d062b521-f575-4e5e-a2e7-2a91e1aca586', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:46 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-063d43d3-ff3d-4f5b-b093-f930ae620e16 tempest-AttachVolumeNegativeTest-1037417113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83b56bcf-d0cd-4a66-8aaa-73d249febcf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:46 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-063d43d3-ff3d-4f5b-b093-f930ae620e16 tempest-AttachVolumeNegativeTest-1037417113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83b56bcf-d0cd-4a66-8aaa-73d249febcf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:46 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-063d43d3-ff3d-4f5b-b093-f930ae620e16 tempest-AttachVolumeNegativeTest-1037417113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93276dfb-f942-497c-bcb6-062f08135a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:46 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-063d43d3-ff3d-4f5b-b093-f930ae620e16 tempest-AttachVolumeNegativeTest-1037417113 None] Volume d062b521-f575-4e5e-a2e7-2a91e1aca586: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d062b521-f575-4e5e-a2e7-2a91e1aca586', 'volume_size': 1} Jul 30 16:58:46 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-063d43d3-ff3d-4f5b-b093-f930ae620e16 tempest-AttachVolumeNegativeTest-1037417113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:58:46 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-063d43d3-ff3d-4f5b-b093-f930ae620e16 tempest-AttachVolumeNegativeTest-1037417113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:58:46 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-063d43d3-ff3d-4f5b-b093-f930ae620e16 tempest-AttachVolumeNegativeTest-1037417113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:58:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-981388021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d062b521-f575-4e5e-a2e7-2a91e1aca586,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9e601affb8f4aecbadcf75c60187e20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:58:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:58:47Z,use_quota=True,user_id='6bbe8f4a440a4bf18642093e7843287b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:58:46 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-063d43d3-ff3d-4f5b-b093-f930ae620e16 tempest-AttachVolumeNegativeTest-1037417113 None] Creating volume d062b521-f575-4e5e-a2e7-2a91e1aca586 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:58:46 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-063d43d3-ff3d-4f5b-b093-f930ae620e16 tempest-AttachVolumeNegativeTest-1037417113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:58:46 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-063d43d3-ff3d-4f5b-b093-f930ae620e16 tempest-AttachVolumeNegativeTest-1037417113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:58:46 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-063d43d3-ff3d-4f5b-b093-f930ae620e16 tempest-AttachVolumeNegativeTest-1037417113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:58:46 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-063d43d3-ff3d-4f5b-b093-f930ae620e16 tempest-AttachVolumeNegativeTest-1037417113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:58:46 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-063d43d3-ff3d-4f5b-b093-f930ae620e16 tempest-AttachVolumeNegativeTest-1037417113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:58:46 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-063d43d3-ff3d-4f5b-b093-f930ae620e16 tempest-AttachVolumeNegativeTest-1037417113 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:58:46 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-063d43d3-ff3d-4f5b-b093-f930ae620e16 tempest-AttachVolumeNegativeTest-1037417113 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 16:58:46 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-063d43d3-ff3d-4f5b-b093-f930ae620e16 tempest-AttachVolumeNegativeTest-1037417113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d062b521-f575-4e5e-a2e7-2a91e1aca586 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:46 devstack sudo[99885]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:46 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-365c6fb2-a909-4363-ab62-bab901be924d tempest-VolumesDeleteCascade-824361553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.337s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:46 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-365c6fb2-a909-4363-ab62-bab901be924d tempest-VolumesDeleteCascade-824361553 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:58:46 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-365c6fb2-a909-4363-ab62-bab901be924d tempest-VolumesDeleteCascade-824361553 None] Deleted volume successfully. Jul 30 16:58:46 devstack sudo[99888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d062b521-f575-4e5e-a2e7-2a91e1aca586 1073741824 Jul 30 16:58:46 devstack sudo[99888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:46 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-365c6fb2-a909-4363-ab62-bab901be924d tempest-VolumesDeleteCascade-824361553 None] Lock "cinder-e03766a5-ac0f-4bfa-a8b7-5b2a861e6a61-delete_volume" released by "delete_volume" :: held 3.423s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:58:46 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-dc5ada6b-dfc8-4668-82b2-992e9c37233f tempest-VolumesDeleteCascade-824361553 None] Acquiring lock "cinder-5f49a2cf-5e75-4d31-82c4-da2171fa9521-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:58:46 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-dc5ada6b-dfc8-4668-82b2-992e9c37233f tempest-VolumesDeleteCascade-824361553 None] Lock "cinder-5f49a2cf-5e75-4d31-82c4-da2171fa9521-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:58:46 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-dc5ada6b-dfc8-4668-82b2-992e9c37233f tempest-VolumesDeleteCascade-824361553 None] Acquiring lock "cinder-quobyte-5f49a2cf-5e75-4d31-82c4-da2171fa9521" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:58:47 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-dc5ada6b-dfc8-4668-82b2-992e9c37233f tempest-VolumesDeleteCascade-824361553 None] Lock "cinder-quobyte-5f49a2cf-5e75-4d31-82c4-da2171fa9521" acquired by "delete_volume" :: waited 0.023s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:58:47 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f30bd2-6ea9-480c-ab59-e4f8ef4ef564]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:58:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-dc5ada6b-dfc8-4668-82b2-992e9c37233f tempest-VolumesDeleteCascade-824361553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5f49a2cf-5e75-4d31-82c4-da2171fa9521 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:47 devstack sudo[99899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5f49a2cf-5e75-4d31-82c4-da2171fa9521 Jul 30 16:58:47 devstack sudo[99899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:47 devstack sudo[99888]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-063d43d3-ff3d-4f5b-b093-f930ae620e16 tempest-AttachVolumeNegativeTest-1037417113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d062b521-f575-4e5e-a2e7-2a91e1aca586 1073741824" returned: 0 in 0.619s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-063d43d3-ff3d-4f5b-b093-f930ae620e16 tempest-AttachVolumeNegativeTest-1037417113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d062b521-f575-4e5e-a2e7-2a91e1aca586 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:47 devstack sudo[99902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d062b521-f575-4e5e-a2e7-2a91e1aca586 Jul 30 16:58:47 devstack sudo[99902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:47 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-eed65a88-c5ea-4628-abcc-e8ff860f2988 tempest-VolumesSnapshotTestJSON-1454524182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:58:47 devstack sudo[99899]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-dc5ada6b-dfc8-4668-82b2-992e9c37233f tempest-VolumesDeleteCascade-824361553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5f49a2cf-5e75-4d31-82c4-da2171fa9521" returned: 0 in 0.587s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-dc5ada6b-dfc8-4668-82b2-992e9c37233f tempest-VolumesDeleteCascade-824361553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5f49a2cf-5e75-4d31-82c4-da2171fa9521 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:47 devstack sudo[99908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5f49a2cf-5e75-4d31-82c4-da2171fa9521 Jul 30 16:58:47 devstack sudo[99908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-eed65a88-c5ea-4628-abcc-e8ff860f2988 tempest-VolumesSnapshotTestJSON-1454524182 None] Flow 'volume_create_manager' (6772ed98-ed8b-410d-a5f2-2c376d28510e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:58:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-eed65a88-c5ea-4628-abcc-e8ff860f2988 tempest-VolumesSnapshotTestJSON-1454524182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (853efb07-2768-4141-ae3a-e4848bd7e1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:47 devstack sudo[99902]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-eed65a88-c5ea-4628-abcc-e8ff860f2988 tempest-VolumesSnapshotTestJSON-1454524182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (853efb07-2768-4141-ae3a-e4848bd7e1b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:58:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-948237558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4e04582-d51b-4bdd-82a8-a73467cc3cb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26d8b9dd9f954ebf908cd619fefa3523',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:58:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c9a92a9a-c10b-4d8a-88b8-3de40d21d531,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:58:48Z,use_quota=True,user_id='05c871db56e4469bbcc891874329eee6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-eed65a88-c5ea-4628-abcc-e8ff860f2988 tempest-VolumesSnapshotTestJSON-1454524182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d912ad2-6096-4d1b-843b-c2d87a10572e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-eed65a88-c5ea-4628-abcc-e8ff860f2988 tempest-VolumesSnapshotTestJSON-1454524182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d912ad2-6096-4d1b-843b-c2d87a10572e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-eed65a88-c5ea-4628-abcc-e8ff860f2988 tempest-VolumesSnapshotTestJSON-1454524182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1be7ab56-4fb8-4d5a-b87a-dc15d2ccb8f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-eed65a88-c5ea-4628-abcc-e8ff860f2988 tempest-VolumesSnapshotTestJSON-1454524182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1be7ab56-4fb8-4d5a-b87a-dc15d2ccb8f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b4e04582-d51b-4bdd-82a8-a73467cc3cb9', 'volume_name': 'volume-b4e04582-d51b-4bdd-82a8-a73467cc3cb9', 'volume_size': 1, 'snapshot_id': 'c9a92a9a-c10b-4d8a-88b8-3de40d21d531'}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-eed65a88-c5ea-4628-abcc-e8ff860f2988 tempest-VolumesSnapshotTestJSON-1454524182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d60cb99-b051-407c-bec0-f79fa69993f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-eed65a88-c5ea-4628-abcc-e8ff860f2988 tempest-VolumesSnapshotTestJSON-1454524182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d60cb99-b051-407c-bec0-f79fa69993f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-eed65a88-c5ea-4628-abcc-e8ff860f2988 tempest-VolumesSnapshotTestJSON-1454524182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fbac777-4dbe-4969-8695-83b1bb5227af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:47 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-eed65a88-c5ea-4628-abcc-e8ff860f2988 tempest-VolumesSnapshotTestJSON-1454524182 None] Volume b4e04582-d51b-4bdd-82a8-a73467cc3cb9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b4e04582-d51b-4bdd-82a8-a73467cc3cb9', 'volume_size': 1, 'snapshot_id': 'c9a92a9a-c10b-4d8a-88b8-3de40d21d531'} Jul 30 16:58:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-063d43d3-ff3d-4f5b-b093-f930ae620e16 tempest-AttachVolumeNegativeTest-1037417113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d062b521-f575-4e5e-a2e7-2a91e1aca586" returned: 0 in 0.372s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:47 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-063d43d3-ff3d-4f5b-b093-f930ae620e16 tempest-AttachVolumeNegativeTest-1037417113 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:58:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-063d43d3-ff3d-4f5b-b093-f930ae620e16 tempest-AttachVolumeNegativeTest-1037417113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:58:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-063d43d3-ff3d-4f5b-b093-f930ae620e16 tempest-AttachVolumeNegativeTest-1037417113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93276dfb-f942-497c-bcb6-062f08135a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d062b521-f575-4e5e-a2e7-2a91e1aca586', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-063d43d3-ff3d-4f5b-b093-f930ae620e16 tempest-AttachVolumeNegativeTest-1037417113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be8aba5d-3a50-4627-90a0-66887ebb630f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-eed65a88-c5ea-4628-abcc-e8ff860f2988 tempest-VolumesSnapshotTestJSON-1454524182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:58:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-eed65a88-c5ea-4628-abcc-e8ff860f2988 tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:58:47 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-eed65a88-c5ea-4628-abcc-e8ff860f2988 tempest-VolumesSnapshotTestJSON-1454524182 None] Acquiring lock "cinder-quobyte-c9a92a9a-c10b-4d8a-88b8-3de40d21d531-b4e04582-d51b-4bdd-82a8-a73467cc3cb9" by "_create_volume_from_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:58:47 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-063d43d3-ff3d-4f5b-b093-f930ae620e16 tempest-AttachVolumeNegativeTest-1037417113 None] Volume volume-d062b521-f575-4e5e-a2e7-2a91e1aca586 (d062b521-f575-4e5e-a2e7-2a91e1aca586): created successfully Jul 30 16:58:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-063d43d3-ff3d-4f5b-b093-f930ae620e16 tempest-AttachVolumeNegativeTest-1037417113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be8aba5d-3a50-4627-90a0-66887ebb630f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-063d43d3-ff3d-4f5b-b093-f930ae620e16 tempest-AttachVolumeNegativeTest-1037417113 None] Flow 'volume_create_manager' (8949edc2-bf74-44e9-b222-9767a527c144) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:58:47 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-eed65a88-c5ea-4628-abcc-e8ff860f2988 tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "cinder-quobyte-c9a92a9a-c10b-4d8a-88b8-3de40d21d531-b4e04582-d51b-4bdd-82a8-a73467cc3cb9" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:58:47 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-eed65a88-c5ea-4628-abcc-e8ff860f2988 tempest-VolumesSnapshotTestJSON-1454524182 None] Creating volume b4e04582-d51b-4bdd-82a8-a73467cc3cb9 from snapshot c9a92a9a-c10b-4d8a-88b8-3de40d21d531 {{(pid=88568) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 30 16:58:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-eed65a88-c5ea-4628-abcc-e8ff860f2988 tempest-VolumesSnapshotTestJSON-1454524182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:58:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-eed65a88-c5ea-4628-abcc-e8ff860f2988 tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:58:47 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-eed65a88-c5ea-4628-abcc-e8ff860f2988 tempest-VolumesSnapshotTestJSON-1454524182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:58:47 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-eed65a88-c5ea-4628-abcc-e8ff860f2988 tempest-VolumesSnapshotTestJSON-1454524182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:58:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-eed65a88-c5ea-4628-abcc-e8ff860f2988 tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:58:47 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-eed65a88-c5ea-4628-abcc-e8ff860f2988 tempest-VolumesSnapshotTestJSON-1454524182 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:58:47 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-eed65a88-c5ea-4628-abcc-e8ff860f2988 tempest-VolumesSnapshotTestJSON-1454524182 None] Acquiring lock "cinder-quobyte-b4e04582-d51b-4bdd-82a8-a73467cc3cb9" by "_copy_volume_from_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:58:47 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-eed65a88-c5ea-4628-abcc-e8ff860f2988 tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "cinder-quobyte-b4e04582-d51b-4bdd-82a8-a73467cc3cb9" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:58:47 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-eed65a88-c5ea-4628-abcc-e8ff860f2988 tempest-VolumesSnapshotTestJSON-1454524182 None] snapshot: c9a92a9a-c10b-4d8a-88b8-3de40d21d531, volume: b4e04582-d51b-4bdd-82a8-a73467cc3cb9, {{(pid=88568) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 30 16:58:47 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-063d43d3-ff3d-4f5b-b093-f930ae620e16 tempest-AttachVolumeNegativeTest-1037417113 None] Created volume successfully. Jul 30 16:58:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-eed65a88-c5ea-4628-abcc-e8ff860f2988 tempest-VolumesSnapshotTestJSON-1454524182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:58:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-eed65a88-c5ea-4628-abcc-e8ff860f2988 tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:58:47 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-eed65a88-c5ea-4628-abcc-e8ff860f2988 tempest-VolumesSnapshotTestJSON-1454524182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:58:47 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-eed65a88-c5ea-4628-abcc-e8ff860f2988 tempest-VolumesSnapshotTestJSON-1454524182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:58:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-eed65a88-c5ea-4628-abcc-e8ff860f2988 tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:58:47 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c46085e-ad12-43ca-924a-0b26df2348e3]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:58:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-eed65a88-c5ea-4628-abcc-e8ff860f2988 tempest-VolumesSnapshotTestJSON-1454524182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d883ab43-6486-4ba5-a0da-87142eba516e.c9a92a9a-c10b-4d8a-88b8-3de40d21d531 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:47 devstack sudo[99908]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-dc5ada6b-dfc8-4668-82b2-992e9c37233f tempest-VolumesDeleteCascade-824361553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5f49a2cf-5e75-4d31-82c4-da2171fa9521" returned: 0 in 0.338s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:47 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-dc5ada6b-dfc8-4668-82b2-992e9c37233f tempest-VolumesDeleteCascade-824361553 None] Lock "cinder-quobyte-5f49a2cf-5e75-4d31-82c4-da2171fa9521" released by "delete_volume" :: held 0.978s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:58:48 devstack sudo[99911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d883ab43-6486-4ba5-a0da-87142eba516e.c9a92a9a-c10b-4d8a-88b8-3de40d21d531 Jul 30 16:58:48 devstack sudo[99911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:48 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-dc5ada6b-dfc8-4668-82b2-992e9c37233f tempest-VolumesDeleteCascade-824361553 None] Created reservations ['4f03e745-c295-4d1a-8110-2a59fa206fd5', 'f330692f-3009-4d9c-97fb-a51659aedb2a', '37aaae9f-c623-4174-bbd0-2fc23165030f', '7b2705b2-0c63-46b4-828e-e7547f92d169'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:58:48 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-dc5ada6b-dfc8-4668-82b2-992e9c37233f tempest-VolumesDeleteCascade-824361553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:58:48 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-dc5ada6b-dfc8-4668-82b2-992e9c37233f tempest-VolumesDeleteCascade-824361553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:58:48 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-dc5ada6b-dfc8-4668-82b2-992e9c37233f tempest-VolumesDeleteCascade-824361553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:58:48 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-dc5ada6b-dfc8-4668-82b2-992e9c37233f tempest-VolumesDeleteCascade-824361553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:58:48 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-dc5ada6b-dfc8-4668-82b2-992e9c37233f tempest-VolumesDeleteCascade-824361553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:58:48 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-dc5ada6b-dfc8-4668-82b2-992e9c37233f tempest-VolumesDeleteCascade-824361553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:48 devstack sudo[99914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:58:48 devstack sudo[99914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:48 devstack sudo[99911]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:48 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-eed65a88-c5ea-4628-abcc-e8ff860f2988 tempest-VolumesSnapshotTestJSON-1454524182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d883ab43-6486-4ba5-a0da-87142eba516e.c9a92a9a-c10b-4d8a-88b8-3de40d21d531" returned: 0 in 0.415s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:48 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-eed65a88-c5ea-4628-abcc-e8ff860f2988 tempest-VolumesSnapshotTestJSON-1454524182 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d883ab43-6486-4ba5-a0da-87142eba516e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:58:48 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[477603ad-0663-4fda-8217-485465c411bb]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:58:48 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-eed65a88-c5ea-4628-abcc-e8ff860f2988 tempest-VolumesSnapshotTestJSON-1454524182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d883ab43-6486-4ba5-a0da-87142eba516e {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:48 devstack sudo[99914]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:48 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-dc5ada6b-dfc8-4668-82b2-992e9c37233f tempest-VolumesDeleteCascade-824361553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.299s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:48 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-dc5ada6b-dfc8-4668-82b2-992e9c37233f tempest-VolumesDeleteCascade-824361553 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:58:48 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-dc5ada6b-dfc8-4668-82b2-992e9c37233f tempest-VolumesDeleteCascade-824361553 None] Deleted volume successfully. Jul 30 16:58:48 devstack sudo[99919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d883ab43-6486-4ba5-a0da-87142eba516e Jul 30 16:58:48 devstack sudo[99919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:48 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-dc5ada6b-dfc8-4668-82b2-992e9c37233f tempest-VolumesDeleteCascade-824361553 None] Lock "cinder-5f49a2cf-5e75-4d31-82c4-da2171fa9521-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:58:48 devstack sudo[99919]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:48 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-eed65a88-c5ea-4628-abcc-e8ff860f2988 tempest-VolumesSnapshotTestJSON-1454524182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d883ab43-6486-4ba5-a0da-87142eba516e" returned: 0 in 0.422s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:48 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-eed65a88-c5ea-4628-abcc-e8ff860f2988 tempest-VolumesSnapshotTestJSON-1454524182 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d883ab43-6486-4ba5-a0da-87142eba516e {{(pid=88568) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 30 16:58:48 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-eed65a88-c5ea-4628-abcc-e8ff860f2988 tempest-VolumesSnapshotTestJSON-1454524182 None] Creating direct copy from snapshot {{(pid=88568) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 30 16:58:48 devstack cinder-volume[88568]: DEBUG cinder.utils [None req-eed65a88-c5ea-4628-abcc-e8ff860f2988 tempest-VolumesSnapshotTestJSON-1454524182 None] Path /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b4e04582-d51b-4bdd-82a8-a73467cc3cb9 not found in is_blk_device check {{(pid=88568) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 30 16:58:48 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-eed65a88-c5ea-4628-abcc-e8ff860f2988 tempest-VolumesSnapshotTestJSON-1454524182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d883ab43-6486-4ba5-a0da-87142eba516e /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b4e04582-d51b-4bdd-82a8-a73467cc3cb9 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:48 devstack sudo[99928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d883ab43-6486-4ba5-a0da-87142eba516e /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b4e04582-d51b-4bdd-82a8-a73467cc3cb9 Jul 30 16:58:48 devstack sudo[99928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:49 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-27301fc2-c9ce-4d62-babb-2424e42b9f5e tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:58:49 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-27301fc2-c9ce-4d62-babb-2424e42b9f5e tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] Flow 'volume_create_manager' (03966017-9e9b-4601-bb99-b530b897fe6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:58:49 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-27301fc2-c9ce-4d62-babb-2424e42b9f5e tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55e28e74-b0fc-4c76-9bbb-1a4fbcc12a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:49 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-27301fc2-c9ce-4d62-babb-2424e42b9f5e tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55e28e74-b0fc-4c76-9bbb-1a4fbcc12a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:58:49Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5602a757-dfd7-4372-8e4b-c16d1a38e3ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f8a3af10d6042cdb70d7c9c388c845d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:58:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:58:49Z,use_quota=True,user_id='4429e93ef7b94da69f36ca1d019769bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6bb790b0-12cb-4602-ae56-4d56aafe8e6e),volume_type_id=6bb790b0-12cb-4602-ae56-4d56aafe8e6e)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:49 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-27301fc2-c9ce-4d62-babb-2424e42b9f5e tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d7b93b5-e4eb-4532-9f48-b46bfc46d31e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:49 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-27301fc2-c9ce-4d62-babb-2424e42b9f5e tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d7b93b5-e4eb-4532-9f48-b46bfc46d31e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:49 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-27301fc2-c9ce-4d62-babb-2424e42b9f5e tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (549a6328-4370-48d8-b361-faf3452b6b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:49 devstack cinder-volume[88568]: DEBUG cinder.image.glance [None req-27301fc2-c9ce-4d62-babb-2424e42b9f5e tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] Creating Keystone auth plugin from conf {{(pid=88568) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 30 16:58:49 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-9b521607-ff80-4b08-a0b2-c0e01c52339f req-07d86df4-f41c-444e-8412-0162e2d0bcf3 tempest-AttachVolumeNegativeTest-1037417113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:58:50 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-27301fc2-c9ce-4d62-babb-2424e42b9f5e tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (549a6328-4370-48d8-b361-faf3452b6b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5602a757-dfd7-4372-8e4b-c16d1a38e3ff', 'volume_name': 'volume-5602a757-dfd7-4372-8e4b-c16d1a38e3ff', 'volume_size': 1, 'image_id': '9aaba0cd-2275-48cf-a22c-e614cc8a8cba', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9aaba0cd-2275-48cf-a22c-e614cc8a8cba', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c4591713e128dd20a73c620903884aa8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4f8a3af10d6042cdb70d7c9c388c845d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd2eb5d807d3427961b5371228d80aab5cf77af9199d15253c4e0935bfce1cfcb693b77364adce3eaaf67c70c476abd3348286dd0aa01ce8240573907f14e980e', 'id': '9aaba0cd-2275-48cf-a22c-e614cc8a8cba', 'created_at': datetime.datetime(2026, 7, 30, 14, 58, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 58, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9aaba0cd-2275-48cf-a22c-e614cc8a8cba/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:50 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-27301fc2-c9ce-4d62-babb-2424e42b9f5e tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4bcc772-8d5e-46ce-a8f7-54ae670d31b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:50 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-27301fc2-c9ce-4d62-babb-2424e42b9f5e tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4bcc772-8d5e-46ce-a8f7-54ae670d31b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:50 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-27301fc2-c9ce-4d62-babb-2424e42b9f5e tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8869446d-d332-454b-82d2-2b66ababc12b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:50 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-27301fc2-c9ce-4d62-babb-2424e42b9f5e tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] Volume 5602a757-dfd7-4372-8e4b-c16d1a38e3ff: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5602a757-dfd7-4372-8e4b-c16d1a38e3ff', 'volume_size': 1, 'image_id': '9aaba0cd-2275-48cf-a22c-e614cc8a8cba', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9aaba0cd-2275-48cf-a22c-e614cc8a8cba', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c4591713e128dd20a73c620903884aa8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4f8a3af10d6042cdb70d7c9c388c845d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd2eb5d807d3427961b5371228d80aab5cf77af9199d15253c4e0935bfce1cfcb693b77364adce3eaaf67c70c476abd3348286dd0aa01ce8240573907f14e980e', 'id': '9aaba0cd-2275-48cf-a22c-e614cc8a8cba', 'created_at': datetime.datetime(2026, 7, 30, 14, 58, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 58, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9aaba0cd-2275-48cf-a22c-e614cc8a8cba/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 30 16:58:50 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-27301fc2-c9ce-4d62-babb-2424e42b9f5e tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] Trying to clone 5602a757-dfd7-4372-8e4b-c16d1a38e3ff from image 9aaba0cd-2275-48cf-a22c-e614cc8a8cba at location (None, [{'url': 'file:///opt/stack/data/glance/images/9aaba0cd-2275-48cf-a22c-e614cc8a8cba', 'metadata': {}}]). {{(pid=88568) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 30 16:58:51 devstack cinder-volume[88568]: DEBUG cinder.image.image_utils [None req-27301fc2-c9ce-4d62-babb-2424e42b9f5e tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9aaba0cd-2275-48cf-a22c-e614cc8a8cba_dxhzoh_4devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88568) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 30 16:58:51 devstack cinder-volume[88568]: INFO cinder.image.image_utils [None req-27301fc2-c9ce-4d62-babb-2424e42b9f5e tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] Image download 0.00 MB at 0.00 MB/s Jul 30 16:58:51 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3774f1-959b-43be-ad0a-3c2c33a75e6f]: (4, 'raw') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:58:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-27301fc2-c9ce-4d62-babb-2424e42b9f5e tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9aaba0cd-2275-48cf-a22c-e614cc8a8cba_dxhzoh_4devstack@QuobyteHD {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:51 devstack sudo[99949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9aaba0cd-2275-48cf-a22c-e614cc8a8cba_dxhzoh_4devstack@QuobyteHD Jul 30 16:58:51 devstack sudo[99949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:52 devstack sudo[99949]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-27301fc2-c9ce-4d62-babb-2424e42b9f5e tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9aaba0cd-2275-48cf-a22c-e614cc8a8cba_dxhzoh_4devstack@QuobyteHD" returned: 0 in 1.036s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-27301fc2-c9ce-4d62-babb-2424e42b9f5e tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9aaba0cd-2275-48cf-a22c-e614cc8a8cba_dxhzoh_4devstack@QuobyteHD {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:52 devstack cinder-volume[88568]: DEBUG oslo_service.periodic_task [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:58:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:58:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:58:52 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:58:52 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:58:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:58:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:52 devstack sudo[99954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:58:52 devstack sudo[99954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:52 devstack sudo[99953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9aaba0cd-2275-48cf-a22c-e614cc8a8cba_dxhzoh_4devstack@QuobyteHD Jul 30 16:58:52 devstack sudo[99953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:53 devstack sudo[99954]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:53 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.534s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:53 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:58:53 devstack cinder-volume[88568]: DEBUG oslo_service.periodic_task [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Running periodic task VolumeManager._thread_info {{(pid=88568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:58:53 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] thread count: 28 {{(pid=88568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:58:53 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] thread info: [<_MainThread(MainThread, started 127406866608256)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:58:53 devstack sudo[99953]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:53 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-27301fc2-c9ce-4d62-babb-2424e42b9f5e tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9aaba0cd-2275-48cf-a22c-e614cc8a8cba_dxhzoh_4devstack@QuobyteHD" returned: 1 in 0.722s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:53 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-27301fc2-c9ce-4d62-babb-2424e42b9f5e tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9aaba0cd-2275-48cf-a22c-e614cc8a8cba_dxhzoh_4devstack@QuobyteHD' failed. Not Retrying. {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 16:58:53 devstack cinder-volume[88568]: DEBUG cinder.image.image_utils [None req-27301fc2-c9ce-4d62-babb-2424e42b9f5e tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] Temporary image 9aaba0cd-2275-48cf-a22c-e614cc8a8cba is fetched for user 4429e93ef7b94da69f36ca1d019769bf. {{(pid=88568) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 30 16:58:53 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa66ba6-d7b4-4d67-80c3-59e14a3f1bdd]: (4, 'raw') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:58:53 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-27301fc2-c9ce-4d62-babb-2424e42b9f5e tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9aaba0cd-2275-48cf-a22c-e614cc8a8cba_dxhzoh_4devstack@QuobyteHD {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:53 devstack sudo[99961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9aaba0cd-2275-48cf-a22c-e614cc8a8cba_dxhzoh_4devstack@QuobyteHD Jul 30 16:58:53 devstack sudo[99961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:53 devstack sudo[99961]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:53 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-27301fc2-c9ce-4d62-babb-2424e42b9f5e tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9aaba0cd-2275-48cf-a22c-e614cc8a8cba_dxhzoh_4devstack@QuobyteHD" returned: 0 in 0.640s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-27301fc2-c9ce-4d62-babb-2424e42b9f5e tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9aaba0cd-2275-48cf-a22c-e614cc8a8cba_dxhzoh_4devstack@QuobyteHD {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:54 devstack sudo[99965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9aaba0cd-2275-48cf-a22c-e614cc8a8cba_dxhzoh_4devstack@QuobyteHD Jul 30 16:58:54 devstack sudo[99965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:54 devstack sudo[99928]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-eed65a88-c5ea-4628-abcc-e8ff860f2988 tempest-VolumesSnapshotTestJSON-1454524182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d883ab43-6486-4ba5-a0da-87142eba516e /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b4e04582-d51b-4bdd-82a8-a73467cc3cb9" returned: 0 in 5.640s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:54 devstack cinder-volume[88568]: DEBUG cinder.image.image_utils [None req-eed65a88-c5ea-4628-abcc-e8ff860f2988 tempest-VolumesSnapshotTestJSON-1454524182 None] Image conversion details: src /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d883ab43-6486-4ba5-a0da-87142eba516e, size 1024.00 MB, duration 5.64 sec, destination /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b4e04582-d51b-4bdd-82a8-a73467cc3cb9 {{(pid=88568) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 16:58:54 devstack cinder-volume[88568]: INFO cinder.image.image_utils [None req-eed65a88-c5ea-4628-abcc-e8ff860f2988 tempest-VolumesSnapshotTestJSON-1454524182 None] Converted 1024.00 MB image at 181.52 MB/s Jul 30 16:58:54 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-eed65a88-c5ea-4628-abcc-e8ff860f2988 tempest-VolumesSnapshotTestJSON-1454524182 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b4e04582-d51b-4bdd-82a8-a73467cc3cb9 is being set with open permissions: ugo+rw Jul 30 16:58:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-eed65a88-c5ea-4628-abcc-e8ff860f2988 tempest-VolumesSnapshotTestJSON-1454524182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b4e04582-d51b-4bdd-82a8-a73467cc3cb9 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:54 devstack sudo[99967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b4e04582-d51b-4bdd-82a8-a73467cc3cb9 Jul 30 16:58:54 devstack sudo[99967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:54 devstack sudo[99965]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-27301fc2-c9ce-4d62-babb-2424e42b9f5e tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9aaba0cd-2275-48cf-a22c-e614cc8a8cba_dxhzoh_4devstack@QuobyteHD" returned: 1 in 0.522s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-27301fc2-c9ce-4d62-babb-2424e42b9f5e tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9aaba0cd-2275-48cf-a22c-e614cc8a8cba_dxhzoh_4devstack@QuobyteHD' failed. Not Retrying. {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 16:58:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-27301fc2-c9ce-4d62-babb-2424e42b9f5e tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:58:54 devstack sudo[99967]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-eed65a88-c5ea-4628-abcc-e8ff860f2988 tempest-VolumesSnapshotTestJSON-1454524182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b4e04582-d51b-4bdd-82a8-a73467cc3cb9" returned: 0 in 0.261s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:54 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-eed65a88-c5ea-4628-abcc-e8ff860f2988 tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "cinder-quobyte-b4e04582-d51b-4bdd-82a8-a73467cc3cb9" released by "_copy_volume_from_snapshot" :: held 6.842s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:58:54 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-eed65a88-c5ea-4628-abcc-e8ff860f2988 tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "cinder-quobyte-c9a92a9a-c10b-4d8a-88b8-3de40d21d531-b4e04582-d51b-4bdd-82a8-a73467cc3cb9" released by "_create_volume_from_snapshot" :: held 6.918s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:58:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-eed65a88-c5ea-4628-abcc-e8ff860f2988 tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.947s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:58:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-9b521607-ff80-4b08-a0b2-c0e01c52339f req-07d86df4-f41c-444e-8412-0162e2d0bcf3 tempest-AttachVolumeNegativeTest-1037417113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.899s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:58:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-9b521607-ff80-4b08-a0b2-c0e01c52339f req-07d86df4-f41c-444e-8412-0162e2d0bcf3 tempest-AttachVolumeNegativeTest-1037417113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:58:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-27301fc2-c9ce-4d62-babb-2424e42b9f5e tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.225s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:58:54 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-27301fc2-c9ce-4d62-babb-2424e42b9f5e tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:58:49Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5602a757-dfd7-4372-8e4b-c16d1a38e3ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f8a3af10d6042cdb70d7c9c388c845d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:58:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:58:49Z,use_quota=True,user_id='4429e93ef7b94da69f36ca1d019769bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6bb790b0-12cb-4602-ae56-4d56aafe8e6e),volume_type_id=6bb790b0-12cb-4602-ae56-4d56aafe8e6e)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:58:54 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-27301fc2-c9ce-4d62-babb-2424e42b9f5e tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] Creating volume 5602a757-dfd7-4372-8e4b-c16d1a38e3ff {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:58:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-27301fc2-c9ce-4d62-babb-2424e42b9f5e tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:58:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-27301fc2-c9ce-4d62-babb-2424e42b9f5e tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:58:54 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-27301fc2-c9ce-4d62-babb-2424e42b9f5e tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:58:54 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-27301fc2-c9ce-4d62-babb-2424e42b9f5e tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:58:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-27301fc2-c9ce-4d62-babb-2424e42b9f5e tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:58:54 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-27301fc2-c9ce-4d62-babb-2424e42b9f5e tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:58:54 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-27301fc2-c9ce-4d62-babb-2424e42b9f5e tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 16:58:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-27301fc2-c9ce-4d62-babb-2424e42b9f5e tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5602a757-dfd7-4372-8e4b-c16d1a38e3ff 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:54 devstack sudo[99974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5602a757-dfd7-4372-8e4b-c16d1a38e3ff 1073741824 Jul 30 16:58:54 devstack sudo[99974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:54 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-eed65a88-c5ea-4628-abcc-e8ff860f2988 tempest-VolumesSnapshotTestJSON-1454524182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fbac777-4dbe-4969-8695-83b1bb5227af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4e04582-d51b-4bdd-82a8-a73467cc3cb9', 'volume_size': 1, 'snapshot_id': 'c9a92a9a-c10b-4d8a-88b8-3de40d21d531'}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:54 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-eed65a88-c5ea-4628-abcc-e8ff860f2988 tempest-VolumesSnapshotTestJSON-1454524182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aad2d80e-ce43-4b91-99fd-48ee123d505e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:54 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-eed65a88-c5ea-4628-abcc-e8ff860f2988 tempest-VolumesSnapshotTestJSON-1454524182 None] Volume volume-b4e04582-d51b-4bdd-82a8-a73467cc3cb9 (b4e04582-d51b-4bdd-82a8-a73467cc3cb9): created successfully Jul 30 16:58:54 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-eed65a88-c5ea-4628-abcc-e8ff860f2988 tempest-VolumesSnapshotTestJSON-1454524182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aad2d80e-ce43-4b91-99fd-48ee123d505e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:54 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-eed65a88-c5ea-4628-abcc-e8ff860f2988 tempest-VolumesSnapshotTestJSON-1454524182 None] Flow 'volume_create_manager' (6772ed98-ed8b-410d-a5f2-2c376d28510e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:58:54 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [req-9b521607-ff80-4b08-a0b2-c0e01c52339f req-07d86df4-f41c-444e-8412-0162e2d0bcf3 tempest-AttachVolumeNegativeTest-1037417113 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924', 'name': 'volume-d062b521-f575-4e5e-a2e7-2a91e1aca586', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c0dad1e9-65ef-4f8c-b47f-d225bb5b9216', 'enforce_multipath': True} {{(pid=88568) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 16:58:54 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-eed65a88-c5ea-4628-abcc-e8ff860f2988 tempest-VolumesSnapshotTestJSON-1454524182 None] Created volume successfully. Jul 30 16:58:54 devstack cinder-volume[88568]: INFO cinder.volume.manager [req-9b521607-ff80-4b08-a0b2-c0e01c52339f req-07d86df4-f41c-444e-8412-0162e2d0bcf3 tempest-AttachVolumeNegativeTest-1037417113 None] attachment_update completed successfully. Jul 30 16:58:55 devstack sudo[99974]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-27301fc2-c9ce-4d62-babb-2424e42b9f5e tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5602a757-dfd7-4372-8e4b-c16d1a38e3ff 1073741824" returned: 0 in 0.529s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-27301fc2-c9ce-4d62-babb-2424e42b9f5e tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5602a757-dfd7-4372-8e4b-c16d1a38e3ff {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:55 devstack sudo[100362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5602a757-dfd7-4372-8e4b-c16d1a38e3ff Jul 30 16:58:55 devstack sudo[100362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:55 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-efb2ac50-004f-46d2-b690-0e30630d9763 tempest-VolumesSnapshotTestJSON-1454524182 None] Acquiring lock "cinder-b4e04582-d51b-4bdd-82a8-a73467cc3cb9-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:58:55 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-efb2ac50-004f-46d2-b690-0e30630d9763 tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "cinder-b4e04582-d51b-4bdd-82a8-a73467cc3cb9-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:58:55 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-efb2ac50-004f-46d2-b690-0e30630d9763 tempest-VolumesSnapshotTestJSON-1454524182 None] Acquiring lock "cinder-quobyte-b4e04582-d51b-4bdd-82a8-a73467cc3cb9" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:58:55 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-efb2ac50-004f-46d2-b690-0e30630d9763 tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "cinder-quobyte-b4e04582-d51b-4bdd-82a8-a73467cc3cb9" acquired by "delete_volume" :: waited 0.024s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:58:55 devstack sudo[100362]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-27301fc2-c9ce-4d62-babb-2424e42b9f5e tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5602a757-dfd7-4372-8e4b-c16d1a38e3ff" returned: 0 in 0.361s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:55 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-27301fc2-c9ce-4d62-babb-2424e42b9f5e tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:58:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-27301fc2-c9ce-4d62-babb-2424e42b9f5e tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:58:55 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8016f21-0d2d-49bf-9aa3-1db98488c7d3]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:58:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-efb2ac50-004f-46d2-b690-0e30630d9763 tempest-VolumesSnapshotTestJSON-1454524182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b4e04582-d51b-4bdd-82a8-a73467cc3cb9 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:55 devstack cinder-volume[88568]: DEBUG cinder.volume.volume_utils [None req-27301fc2-c9ce-4d62-babb-2424e42b9f5e tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] Attempting download of 9aaba0cd-2275-48cf-a22c-e614cc8a8cba ((None, [{'url': 'file:///opt/stack/data/glance/images/9aaba0cd-2275-48cf-a22c-e614cc8a8cba', 'metadata': {}}])) to volume 5602a757-dfd7-4372-8e4b-c16d1a38e3ff. {{(pid=88568) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 30 16:58:55 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78a9770-3159-4277-be4b-75eea179e808]: (4, 'raw') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:58:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-27301fc2-c9ce-4d62-babb-2424e42b9f5e tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9aaba0cd-2275-48cf-a22c-e614cc8a8cba_ecmvjoy6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:55 devstack sudo[100368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b4e04582-d51b-4bdd-82a8-a73467cc3cb9 Jul 30 16:58:55 devstack sudo[100368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:56 devstack sudo[100369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9aaba0cd-2275-48cf-a22c-e614cc8a8cba_ecmvjoy6 Jul 30 16:58:56 devstack sudo[100369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:56 devstack sudo[100369]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-27301fc2-c9ce-4d62-babb-2424e42b9f5e tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9aaba0cd-2275-48cf-a22c-e614cc8a8cba_ecmvjoy6" returned: 0 in 0.436s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-27301fc2-c9ce-4d62-babb-2424e42b9f5e tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9aaba0cd-2275-48cf-a22c-e614cc8a8cba_ecmvjoy6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:56 devstack sudo[100368]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-efb2ac50-004f-46d2-b690-0e30630d9763 tempest-VolumesSnapshotTestJSON-1454524182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b4e04582-d51b-4bdd-82a8-a73467cc3cb9" returned: 0 in 0.605s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-efb2ac50-004f-46d2-b690-0e30630d9763 tempest-VolumesSnapshotTestJSON-1454524182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b4e04582-d51b-4bdd-82a8-a73467cc3cb9 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:56 devstack sudo[100378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b4e04582-d51b-4bdd-82a8-a73467cc3cb9 Jul 30 16:58:56 devstack sudo[100378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:56 devstack sudo[100377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9aaba0cd-2275-48cf-a22c-e614cc8a8cba_ecmvjoy6 Jul 30 16:58:56 devstack sudo[100377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:56 devstack sudo[100377]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-27301fc2-c9ce-4d62-babb-2424e42b9f5e tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9aaba0cd-2275-48cf-a22c-e614cc8a8cba_ecmvjoy6" returned: 1 in 0.402s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-27301fc2-c9ce-4d62-babb-2424e42b9f5e tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9aaba0cd-2275-48cf-a22c-e614cc8a8cba_ecmvjoy6' failed. Not Retrying. {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 16:58:56 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a95db5-2c9e-4a9e-ae23-a8a2ffc211e9]: (4, 'raw') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:58:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-27301fc2-c9ce-4d62-babb-2424e42b9f5e tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9aaba0cd-2275-48cf-a22c-e614cc8a8cba_dxhzoh_4devstack@QuobyteHD {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:56 devstack sudo[100378]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-efb2ac50-004f-46d2-b690-0e30630d9763 tempest-VolumesSnapshotTestJSON-1454524182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b4e04582-d51b-4bdd-82a8-a73467cc3cb9" returned: 0 in 0.448s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:56 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-efb2ac50-004f-46d2-b690-0e30630d9763 tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "cinder-quobyte-b4e04582-d51b-4bdd-82a8-a73467cc3cb9" released by "delete_volume" :: held 1.121s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:58:56 devstack sudo[100384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9aaba0cd-2275-48cf-a22c-e614cc8a8cba_dxhzoh_4devstack@QuobyteHD Jul 30 16:58:56 devstack sudo[100384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:56 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-efb2ac50-004f-46d2-b690-0e30630d9763 tempest-VolumesSnapshotTestJSON-1454524182 None] Created reservations ['51b77e3d-e4e1-4326-b951-519810b6fbd3', 'dd9e8632-3a91-419e-bef7-fa8ef45a3677', '2b8e9281-5db7-467b-b1c0-b8536ee656ed', '3e660ca2-8aed-4fbb-95ae-a3c373c7428d'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:58:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-efb2ac50-004f-46d2-b690-0e30630d9763 tempest-VolumesSnapshotTestJSON-1454524182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:58:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-efb2ac50-004f-46d2-b690-0e30630d9763 tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:58:56 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-efb2ac50-004f-46d2-b690-0e30630d9763 tempest-VolumesSnapshotTestJSON-1454524182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:58:57 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-efb2ac50-004f-46d2-b690-0e30630d9763 tempest-VolumesSnapshotTestJSON-1454524182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:58:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-efb2ac50-004f-46d2-b690-0e30630d9763 tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:58:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-efb2ac50-004f-46d2-b690-0e30630d9763 tempest-VolumesSnapshotTestJSON-1454524182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:57 devstack sudo[100386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:58:57 devstack sudo[100386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:57 devstack sudo[100384]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-27301fc2-c9ce-4d62-babb-2424e42b9f5e tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9aaba0cd-2275-48cf-a22c-e614cc8a8cba_dxhzoh_4devstack@QuobyteHD" returned: 0 in 0.478s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-27301fc2-c9ce-4d62-babb-2424e42b9f5e tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9aaba0cd-2275-48cf-a22c-e614cc8a8cba_dxhzoh_4devstack@QuobyteHD {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:57 devstack sudo[100391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9aaba0cd-2275-48cf-a22c-e614cc8a8cba_dxhzoh_4devstack@QuobyteHD Jul 30 16:58:57 devstack sudo[100391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:57 devstack sudo[100386]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-efb2ac50-004f-46d2-b690-0e30630d9763 tempest-VolumesSnapshotTestJSON-1454524182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.378s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:57 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-efb2ac50-004f-46d2-b690-0e30630d9763 tempest-VolumesSnapshotTestJSON-1454524182 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:58:57 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-efb2ac50-004f-46d2-b690-0e30630d9763 tempest-VolumesSnapshotTestJSON-1454524182 None] Deleted volume successfully. Jul 30 16:58:57 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-efb2ac50-004f-46d2-b690-0e30630d9763 tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "cinder-b4e04582-d51b-4bdd-82a8-a73467cc3cb9-delete_volume" released by "delete_volume" :: held 1.828s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:58:57 devstack sudo[100391]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-27301fc2-c9ce-4d62-babb-2424e42b9f5e tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9aaba0cd-2275-48cf-a22c-e614cc8a8cba_dxhzoh_4devstack@QuobyteHD" returned: 1 in 0.429s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-27301fc2-c9ce-4d62-babb-2424e42b9f5e tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9aaba0cd-2275-48cf-a22c-e614cc8a8cba_dxhzoh_4devstack@QuobyteHD' failed. Not Retrying. {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 16:58:57 devstack cinder-volume[88568]: DEBUG cinder.image.image_utils [None req-27301fc2-c9ce-4d62-babb-2424e42b9f5e tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] 9aaba0cd-2275-48cf-a22c-e614cc8a8cba was raw, converting to qcow2 {{(pid=88568) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 30 16:58:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-27301fc2-c9ce-4d62-babb-2424e42b9f5e tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9aaba0cd-2275-48cf-a22c-e614cc8a8cba_dxhzoh_4devstack@QuobyteHD /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5602a757-dfd7-4372-8e4b-c16d1a38e3ff {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:57 devstack sudo[100427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9aaba0cd-2275-48cf-a22c-e614cc8a8cba_dxhzoh_4devstack@QuobyteHD /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5602a757-dfd7-4372-8e4b-c16d1a38e3ff Jul 30 16:58:57 devstack sudo[100427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:57 devstack cinder-volume[88568]: INFO cinder.volume.manager [req-ddf4411a-91ad-4bdb-af53-84a082262842 req-7c365568-d3af-4d7d-a75f-839c5b014b3f tempest-AttachVolumeNegativeTest-1037417113 None] Terminate volume connection completed successfully. Jul 30 16:58:57 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [req-ddf4411a-91ad-4bdb-af53-84a082262842 req-7c365568-d3af-4d7d-a75f-839c5b014b3f tempest-AttachVolumeNegativeTest-1037417113 None] Deleting attachment c0dad1e9-65ef-4f8c-b47f-d225bb5b9216. {{(pid=88568) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 16:58:57 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-efe51702-f770-4d98-93e4-859cb4cea12e tempest-VolumesSnapshotTestJSON-1454524182 None] Acquiring lock "cinder-c9a92a9a-c10b-4d8a-88b8-3de40d21d531-delete_snapshot" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:58:57 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-efe51702-f770-4d98-93e4-859cb4cea12e tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "cinder-c9a92a9a-c10b-4d8a-88b8-3de40d21d531-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:58:57 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-efe51702-f770-4d98-93e4-859cb4cea12e tempest-VolumesSnapshotTestJSON-1454524182 None] Acquiring lock "cinder-quobyte-d883ab43-6486-4ba5-a0da-87142eba516e" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:58:57 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-efe51702-f770-4d98-93e4-859cb4cea12e tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "cinder-quobyte-d883ab43-6486-4ba5-a0da-87142eba516e" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:58:57 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-efe51702-f770-4d98-93e4-859cb4cea12e tempest-VolumesSnapshotTestJSON-1454524182 None] Acquiring lock "cinder-quobyte-c9a92a9a-c10b-4d8a-88b8-3de40d21d531" by "_delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:58:58 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-efe51702-f770-4d98-93e4-859cb4cea12e tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "cinder-quobyte-c9a92a9a-c10b-4d8a-88b8-3de40d21d531" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:58:58 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-efe51702-f770-4d98-93e4-859cb4cea12e tempest-VolumesSnapshotTestJSON-1454524182 None] Deleting offline snapshot c9a92a9a-c10b-4d8a-88b8-3de40d21d531 of volume d883ab43-6486-4ba5-a0da-87142eba516e {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:58:58 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-efe51702-f770-4d98-93e4-859cb4cea12e tempest-VolumesSnapshotTestJSON-1454524182 None] snapshot_file for this snap is: volume-d883ab43-6486-4ba5-a0da-87142eba516e.c9a92a9a-c10b-4d8a-88b8-3de40d21d531 {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:58:58 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b6994c9-4c23-419a-9494-4d96d6fa664b]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:58:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-efe51702-f770-4d98-93e4-859cb4cea12e tempest-VolumesSnapshotTestJSON-1454524182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d883ab43-6486-4ba5-a0da-87142eba516e.c9a92a9a-c10b-4d8a-88b8-3de40d21d531 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:58 devstack sudo[100440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d883ab43-6486-4ba5-a0da-87142eba516e.c9a92a9a-c10b-4d8a-88b8-3de40d21d531 Jul 30 16:58:58 devstack sudo[100440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:58 devstack sudo[100427]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-27301fc2-c9ce-4d62-babb-2424e42b9f5e tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9aaba0cd-2275-48cf-a22c-e614cc8a8cba_dxhzoh_4devstack@QuobyteHD /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5602a757-dfd7-4372-8e4b-c16d1a38e3ff" returned: 0 in 0.683s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:58 devstack cinder-volume[88568]: DEBUG cinder.image.image_utils [None req-27301fc2-c9ce-4d62-babb-2424e42b9f5e tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9aaba0cd-2275-48cf-a22c-e614cc8a8cba_dxhzoh_4devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5602a757-dfd7-4372-8e4b-c16d1a38e3ff {{(pid=88568) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 16:58:58 devstack cinder-volume[88568]: INFO cinder.image.image_utils [None req-27301fc2-c9ce-4d62-babb-2424e42b9f5e tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] Converted 0.00 MB image at 0.00 MB/s Jul 30 16:58:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-27301fc2-c9ce-4d62-babb-2424e42b9f5e tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5602a757-dfd7-4372-8e4b-c16d1a38e3ff 1G {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:58 devstack sudo[100442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5602a757-dfd7-4372-8e4b-c16d1a38e3ff 1G Jul 30 16:58:58 devstack sudo[100442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:58 devstack sudo[100440]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-efe51702-f770-4d98-93e4-859cb4cea12e tempest-VolumesSnapshotTestJSON-1454524182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d883ab43-6486-4ba5-a0da-87142eba516e.c9a92a9a-c10b-4d8a-88b8-3de40d21d531" returned: 0 in 0.691s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:58 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-efe51702-f770-4d98-93e4-859cb4cea12e tempest-VolumesSnapshotTestJSON-1454524182 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d883ab43-6486-4ba5-a0da-87142eba516e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:58:58 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d252bd-cbac-47c5-bc38-bf5f1ae75134]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:58:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-efe51702-f770-4d98-93e4-859cb4cea12e tempest-VolumesSnapshotTestJSON-1454524182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d883ab43-6486-4ba5-a0da-87142eba516e {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:58 devstack sudo[100442]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-27301fc2-c9ce-4d62-babb-2424e42b9f5e tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5602a757-dfd7-4372-8e4b-c16d1a38e3ff 1G" returned: 0 in 0.648s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:58 devstack cinder-volume[88568]: DEBUG cinder.volume.volume_utils [None req-27301fc2-c9ce-4d62-babb-2424e42b9f5e tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] Downloaded image 9aaba0cd-2275-48cf-a22c-e614cc8a8cba ((None, [{'url': 'file:///opt/stack/data/glance/images/9aaba0cd-2275-48cf-a22c-e614cc8a8cba', 'metadata': {}}])) to volume 5602a757-dfd7-4372-8e4b-c16d1a38e3ff successfully. {{(pid=88568) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 30 16:58:58 devstack cinder-volume[88568]: DEBUG cinder.image.image_utils [None req-27301fc2-c9ce-4d62-babb-2424e42b9f5e tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] Temporary image 9aaba0cd-2275-48cf-a22c-e614cc8a8cba for user 4429e93ef7b94da69f36ca1d019769bf is deleted. {{(pid=88568) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 30 16:58:58 devstack cinder-volume[88568]: DEBUG cinder.volume.volume_utils [None req-27301fc2-c9ce-4d62-babb-2424e42b9f5e tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] Marking volume 5602a757-dfd7-4372-8e4b-c16d1a38e3ff as bootable. {{(pid=88568) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 30 16:58:58 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-27301fc2-c9ce-4d62-babb-2424e42b9f5e tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] Copying metadata from image 9aaba0cd-2275-48cf-a22c-e614cc8a8cba to 5602a757-dfd7-4372-8e4b-c16d1a38e3ff. {{(pid=88568) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 30 16:58:58 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-27301fc2-c9ce-4d62-babb-2424e42b9f5e tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] Creating volume glance metadata for volume 5602a757-dfd7-4372-8e4b-c16d1a38e3ff backed by image 9aaba0cd-2275-48cf-a22c-e614cc8a8cba with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '9aaba0cd-2275-48cf-a22c-e614cc8a8cba', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'c4591713e128dd20a73c620903884aa8', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88568) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 30 16:58:59 devstack sudo[100451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d883ab43-6486-4ba5-a0da-87142eba516e Jul 30 16:58:59 devstack sudo[100451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:59 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-27301fc2-c9ce-4d62-babb-2424e42b9f5e tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8869446d-d332-454b-82d2-2b66ababc12b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5602a757-dfd7-4372-8e4b-c16d1a38e3ff', 'volume_size': 1, 'image_id': '9aaba0cd-2275-48cf-a22c-e614cc8a8cba', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9aaba0cd-2275-48cf-a22c-e614cc8a8cba', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c4591713e128dd20a73c620903884aa8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4f8a3af10d6042cdb70d7c9c388c845d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd2eb5d807d3427961b5371228d80aab5cf77af9199d15253c4e0935bfce1cfcb693b77364adce3eaaf67c70c476abd3348286dd0aa01ce8240573907f14e980e', 'id': '9aaba0cd-2275-48cf-a22c-e614cc8a8cba', 'created_at': datetime.datetime(2026, 7, 30, 14, 58, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 58, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9aaba0cd-2275-48cf-a22c-e614cc8a8cba/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:59 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-27301fc2-c9ce-4d62-babb-2424e42b9f5e tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0527345-4707-44f4-8d7d-01483224cbdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:59 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-27301fc2-c9ce-4d62-babb-2424e42b9f5e tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] Volume volume-5602a757-dfd7-4372-8e4b-c16d1a38e3ff (5602a757-dfd7-4372-8e4b-c16d1a38e3ff): created successfully Jul 30 16:58:59 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-27301fc2-c9ce-4d62-babb-2424e42b9f5e tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0527345-4707-44f4-8d7d-01483224cbdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:59 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-27301fc2-c9ce-4d62-babb-2424e42b9f5e tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] Flow 'volume_create_manager' (03966017-9e9b-4601-bb99-b530b897fe6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:58:59 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-27301fc2-c9ce-4d62-babb-2424e42b9f5e tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] Created volume successfully. Jul 30 16:58:59 devstack sudo[100451]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-efe51702-f770-4d98-93e4-859cb4cea12e tempest-VolumesSnapshotTestJSON-1454524182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d883ab43-6486-4ba5-a0da-87142eba516e" returned: 0 in 0.852s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-efe51702-f770-4d98-93e4-859cb4cea12e tempest-VolumesSnapshotTestJSON-1454524182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d883ab43-6486-4ba5-a0da-87142eba516e.c9a92a9a-c10b-4d8a-88b8-3de40d21d531 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:59 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-34ae2a33-850a-473a-8957-137d6986a31d tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] Acquiring lock "cinder-5602a757-dfd7-4372-8e4b-c16d1a38e3ff-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:58:59 devstack sudo[100479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d883ab43-6486-4ba5-a0da-87142eba516e.c9a92a9a-c10b-4d8a-88b8-3de40d21d531 Jul 30 16:58:59 devstack sudo[100479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:59 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-34ae2a33-850a-473a-8957-137d6986a31d tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] Lock "cinder-5602a757-dfd7-4372-8e4b-c16d1a38e3ff-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:58:59 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-34ae2a33-850a-473a-8957-137d6986a31d tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] Acquiring lock "cinder-quobyte-5602a757-dfd7-4372-8e4b-c16d1a38e3ff" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:58:59 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-34ae2a33-850a-473a-8957-137d6986a31d tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] Lock "cinder-quobyte-5602a757-dfd7-4372-8e4b-c16d1a38e3ff" acquired by "delete_volume" :: waited 0.025s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:58:59 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[62688e53-808f-4e8b-beac-2e2d855336c3]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:58:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-34ae2a33-850a-473a-8957-137d6986a31d tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5602a757-dfd7-4372-8e4b-c16d1a38e3ff {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:00 devstack sudo[100481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5602a757-dfd7-4372-8e4b-c16d1a38e3ff Jul 30 16:59:00 devstack sudo[100481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:00 devstack sudo[100479]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:00 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-efe51702-f770-4d98-93e4-859cb4cea12e tempest-VolumesSnapshotTestJSON-1454524182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d883ab43-6486-4ba5-a0da-87142eba516e.c9a92a9a-c10b-4d8a-88b8-3de40d21d531" returned: 0 in 0.610s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:00 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-efe51702-f770-4d98-93e4-859cb4cea12e tempest-VolumesSnapshotTestJSON-1454524182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d883ab43-6486-4ba5-a0da-87142eba516e.c9a92a9a-c10b-4d8a-88b8-3de40d21d531 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:00 devstack sudo[100486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d883ab43-6486-4ba5-a0da-87142eba516e.c9a92a9a-c10b-4d8a-88b8-3de40d21d531 Jul 30 16:59:00 devstack sudo[100486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:00 devstack sudo[100481]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:00 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-34ae2a33-850a-473a-8957-137d6986a31d tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5602a757-dfd7-4372-8e4b-c16d1a38e3ff" returned: 0 in 0.587s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:00 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-34ae2a33-850a-473a-8957-137d6986a31d tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5602a757-dfd7-4372-8e4b-c16d1a38e3ff {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:00 devstack sudo[100491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5602a757-dfd7-4372-8e4b-c16d1a38e3ff Jul 30 16:59:00 devstack sudo[100491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:00 devstack sudo[100486]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:00 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-efe51702-f770-4d98-93e4-859cb4cea12e tempest-VolumesSnapshotTestJSON-1454524182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d883ab43-6486-4ba5-a0da-87142eba516e.c9a92a9a-c10b-4d8a-88b8-3de40d21d531" returned: 0 in 0.355s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:00 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-efe51702-f770-4d98-93e4-859cb4cea12e tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "cinder-quobyte-c9a92a9a-c10b-4d8a-88b8-3de40d21d531" released by "_delete_snapshot" :: held 2.697s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:59:00 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-efe51702-f770-4d98-93e4-859cb4cea12e tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "cinder-quobyte-d883ab43-6486-4ba5-a0da-87142eba516e" released by "delete_snapshot" :: held 2.745s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:59:00 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-efe51702-f770-4d98-93e4-859cb4cea12e tempest-VolumesSnapshotTestJSON-1454524182 None] Created reservations ['82f62b2f-6b8c-44a2-aa0f-7cad97b69ff3', 'a33aee3e-cd6e-4958-beb2-b1a13579ddeb', '932a5b07-5fb6-4172-96df-81c05762de6b', 'd051501c-b2e8-4cc2-8f73-3938c3b96b56'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:59:00 devstack sudo[100491]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:00 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-34ae2a33-850a-473a-8957-137d6986a31d tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5602a757-dfd7-4372-8e4b-c16d1a38e3ff" returned: 0 in 0.425s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:00 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-34ae2a33-850a-473a-8957-137d6986a31d tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] Lock "cinder-quobyte-5602a757-dfd7-4372-8e4b-c16d1a38e3ff" released by "delete_volume" :: held 1.115s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:59:00 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-efe51702-f770-4d98-93e4-859cb4cea12e tempest-VolumesSnapshotTestJSON-1454524182 None] Delete snapshot completed successfully. Jul 30 16:59:00 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-efe51702-f770-4d98-93e4-859cb4cea12e tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "cinder-c9a92a9a-c10b-4d8a-88b8-3de40d21d531-delete_snapshot" released by "delete_snapshot" :: held 3.025s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:59:01 devstack cinder-volume[88568]: WARNING cinder.quota [None req-34ae2a33-850a-473a-8957-137d6986a31d tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:59:01 devstack cinder-volume[88568]: WARNING cinder.quota [None req-34ae2a33-850a-473a-8957-137d6986a31d tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:59:01 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-34ae2a33-850a-473a-8957-137d6986a31d tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] Created reservations ['b83cce44-ece1-46d0-821f-5ded382cc2c6', '7f972f6f-3fff-46d0-a797-99cffbd6164c', '40f6543a-0eee-4684-8727-22093637b612', '4c723b16-4090-4593-b8f5-d6f768ae297d'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:59:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-34ae2a33-850a-473a-8957-137d6986a31d tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:59:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-34ae2a33-850a-473a-8957-137d6986a31d tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:59:01 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-34ae2a33-850a-473a-8957-137d6986a31d tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:59:01 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-34ae2a33-850a-473a-8957-137d6986a31d tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:59:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-34ae2a33-850a-473a-8957-137d6986a31d tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:59:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-34ae2a33-850a-473a-8957-137d6986a31d tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:01 devstack sudo[100496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:59:01 devstack sudo[100496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:01 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-7b4efffb-2553-4b3d-8855-42ff079c176d tempest-VolumesSnapshotTestJSON-1454524182 None] Acquiring lock "cinder-d883ab43-6486-4ba5-a0da-87142eba516e-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:59:01 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-7b4efffb-2553-4b3d-8855-42ff079c176d tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "cinder-d883ab43-6486-4ba5-a0da-87142eba516e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:59:01 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-7b4efffb-2553-4b3d-8855-42ff079c176d tempest-VolumesSnapshotTestJSON-1454524182 None] Acquiring lock "cinder-quobyte-d883ab43-6486-4ba5-a0da-87142eba516e" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:59:01 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-7b4efffb-2553-4b3d-8855-42ff079c176d tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "cinder-quobyte-d883ab43-6486-4ba5-a0da-87142eba516e" acquired by "delete_volume" :: waited 0.018s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:59:01 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c4e9f3-3766-482e-9a61-3c7188fb3a95]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:59:01 devstack sudo[100496]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7b4efffb-2553-4b3d-8855-42ff079c176d tempest-VolumesSnapshotTestJSON-1454524182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d883ab43-6486-4ba5-a0da-87142eba516e {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-34ae2a33-850a-473a-8957-137d6986a31d tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.420s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:01 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-34ae2a33-850a-473a-8957-137d6986a31d tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:59:01 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-34ae2a33-850a-473a-8957-137d6986a31d tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] Deleted volume successfully. Jul 30 16:59:01 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-34ae2a33-850a-473a-8957-137d6986a31d tempest-VolumeAndVolumeTypeFromImageTest-1529304418 None] Lock "cinder-5602a757-dfd7-4372-8e4b-c16d1a38e3ff-delete_volume" released by "delete_volume" :: held 1.852s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:59:01 devstack sudo[100501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d883ab43-6486-4ba5-a0da-87142eba516e Jul 30 16:59:01 devstack sudo[100501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:02 devstack sudo[100501]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7b4efffb-2553-4b3d-8855-42ff079c176d tempest-VolumesSnapshotTestJSON-1454524182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d883ab43-6486-4ba5-a0da-87142eba516e" returned: 0 in 0.606s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7b4efffb-2553-4b3d-8855-42ff079c176d tempest-VolumesSnapshotTestJSON-1454524182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d883ab43-6486-4ba5-a0da-87142eba516e {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:02 devstack sudo[100506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d883ab43-6486-4ba5-a0da-87142eba516e Jul 30 16:59:02 devstack sudo[100506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:02 devstack sudo[100506]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7b4efffb-2553-4b3d-8855-42ff079c176d tempest-VolumesSnapshotTestJSON-1454524182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d883ab43-6486-4ba5-a0da-87142eba516e" returned: 0 in 0.397s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:02 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-7b4efffb-2553-4b3d-8855-42ff079c176d tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "cinder-quobyte-d883ab43-6486-4ba5-a0da-87142eba516e" released by "delete_volume" :: held 1.154s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:59:02 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-7b4efffb-2553-4b3d-8855-42ff079c176d tempest-VolumesSnapshotTestJSON-1454524182 None] Created reservations ['3ef1bea1-26d6-4b79-a4d1-4dad84886750', 'a3b4490a-f7c3-4803-9a30-1147935abb6d', 'd1f14bb7-6fe2-422f-b2f7-7d820f1e60a4', '5845c949-fb9b-457c-8471-49cd122756f2'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:59:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-7b4efffb-2553-4b3d-8855-42ff079c176d tempest-VolumesSnapshotTestJSON-1454524182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:59:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-7b4efffb-2553-4b3d-8855-42ff079c176d tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:59:02 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-7b4efffb-2553-4b3d-8855-42ff079c176d tempest-VolumesSnapshotTestJSON-1454524182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:59:02 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-7b4efffb-2553-4b3d-8855-42ff079c176d tempest-VolumesSnapshotTestJSON-1454524182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:59:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-7b4efffb-2553-4b3d-8855-42ff079c176d tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:59:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7b4efffb-2553-4b3d-8855-42ff079c176d tempest-VolumesSnapshotTestJSON-1454524182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:02 devstack sudo[100509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:59:02 devstack sudo[100509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:03 devstack sudo[100509]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7b4efffb-2553-4b3d-8855-42ff079c176d tempest-VolumesSnapshotTestJSON-1454524182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.302s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:03 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-7b4efffb-2553-4b3d-8855-42ff079c176d tempest-VolumesSnapshotTestJSON-1454524182 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:59:03 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-7b4efffb-2553-4b3d-8855-42ff079c176d tempest-VolumesSnapshotTestJSON-1454524182 None] Deleted volume successfully. Jul 30 16:59:03 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-7b4efffb-2553-4b3d-8855-42ff079c176d tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "cinder-d883ab43-6486-4ba5-a0da-87142eba516e-delete_volume" released by "delete_volume" :: held 1.847s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:59:03 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-7e913799-cc83-498c-8009-d2ecb3077869 tempest-VolumesSnapshotTestJSON-1454524182 None] Acquiring lock "cinder-f214f25c-5e5f-48d9-8df8-8232ce1db9a4-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:59:03 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-7e913799-cc83-498c-8009-d2ecb3077869 tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "cinder-f214f25c-5e5f-48d9-8df8-8232ce1db9a4-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:59:03 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-7e913799-cc83-498c-8009-d2ecb3077869 tempest-VolumesSnapshotTestJSON-1454524182 None] Acquiring lock "cinder-quobyte-f214f25c-5e5f-48d9-8df8-8232ce1db9a4" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:59:03 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-7e913799-cc83-498c-8009-d2ecb3077869 tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "cinder-quobyte-f214f25c-5e5f-48d9-8df8-8232ce1db9a4" acquired by "delete_volume" :: waited 0.028s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:59:03 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7c5228-f768-4955-b5ee-ecfc03d36cda]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:59:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7e913799-cc83-498c-8009-d2ecb3077869 tempest-VolumesSnapshotTestJSON-1454524182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f214f25c-5e5f-48d9-8df8-8232ce1db9a4 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:04 devstack sudo[100512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f214f25c-5e5f-48d9-8df8-8232ce1db9a4 Jul 30 16:59:04 devstack sudo[100512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:04 devstack sudo[100512]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7e913799-cc83-498c-8009-d2ecb3077869 tempest-VolumesSnapshotTestJSON-1454524182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f214f25c-5e5f-48d9-8df8-8232ce1db9a4" returned: 0 in 0.482s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7e913799-cc83-498c-8009-d2ecb3077869 tempest-VolumesSnapshotTestJSON-1454524182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f214f25c-5e5f-48d9-8df8-8232ce1db9a4 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:04 devstack sudo[100517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f214f25c-5e5f-48d9-8df8-8232ce1db9a4 Jul 30 16:59:04 devstack sudo[100517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:04 devstack sudo[100517]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7e913799-cc83-498c-8009-d2ecb3077869 tempest-VolumesSnapshotTestJSON-1454524182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f214f25c-5e5f-48d9-8df8-8232ce1db9a4" returned: 0 in 0.310s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:04 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-7e913799-cc83-498c-8009-d2ecb3077869 tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "cinder-quobyte-f214f25c-5e5f-48d9-8df8-8232ce1db9a4" released by "delete_volume" :: held 0.876s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:59:04 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-7e913799-cc83-498c-8009-d2ecb3077869 tempest-VolumesSnapshotTestJSON-1454524182 None] Created reservations ['0ce2f9e8-36a4-491d-9024-4c86a6e78624', '0eab965f-7b55-42fc-baa3-ab25378f8ca7', 'c9bb271c-3115-49b8-ae57-d861b221d95d', '19f1110c-9fd9-4858-b7e1-d1908d826000'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:59:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-7e913799-cc83-498c-8009-d2ecb3077869 tempest-VolumesSnapshotTestJSON-1454524182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:59:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-7e913799-cc83-498c-8009-d2ecb3077869 tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:59:04 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-7e913799-cc83-498c-8009-d2ecb3077869 tempest-VolumesSnapshotTestJSON-1454524182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:59:04 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-7e913799-cc83-498c-8009-d2ecb3077869 tempest-VolumesSnapshotTestJSON-1454524182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:59:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-7e913799-cc83-498c-8009-d2ecb3077869 tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:59:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7e913799-cc83-498c-8009-d2ecb3077869 tempest-VolumesSnapshotTestJSON-1454524182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:04 devstack sudo[100521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:59:04 devstack sudo[100521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:05 devstack sudo[100521]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:05 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7e913799-cc83-498c-8009-d2ecb3077869 tempest-VolumesSnapshotTestJSON-1454524182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.285s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:05 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-7e913799-cc83-498c-8009-d2ecb3077869 tempest-VolumesSnapshotTestJSON-1454524182 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:59:05 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-7e913799-cc83-498c-8009-d2ecb3077869 tempest-VolumesSnapshotTestJSON-1454524182 None] Deleted volume successfully. Jul 30 16:59:05 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-7e913799-cc83-498c-8009-d2ecb3077869 tempest-VolumesSnapshotTestJSON-1454524182 None] Lock "cinder-f214f25c-5e5f-48d9-8df8-8232ce1db9a4-delete_volume" released by "delete_volume" :: held 1.447s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:59:06 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-7e7aa60a-9e41-4a10-a8fe-16e838af6195 tempest-AttachVolumeNegativeTest-1037417113 None] Acquiring lock "cinder-d062b521-f575-4e5e-a2e7-2a91e1aca586-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:59:06 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-7e7aa60a-9e41-4a10-a8fe-16e838af6195 tempest-AttachVolumeNegativeTest-1037417113 None] Lock "cinder-d062b521-f575-4e5e-a2e7-2a91e1aca586-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:59:06 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-7e7aa60a-9e41-4a10-a8fe-16e838af6195 tempest-AttachVolumeNegativeTest-1037417113 None] Acquiring lock "cinder-quobyte-d062b521-f575-4e5e-a2e7-2a91e1aca586" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:59:06 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-7e7aa60a-9e41-4a10-a8fe-16e838af6195 tempest-AttachVolumeNegativeTest-1037417113 None] Lock "cinder-quobyte-d062b521-f575-4e5e-a2e7-2a91e1aca586" acquired by "delete_volume" :: waited 0.018s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:59:06 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a32f9d4-3902-4896-a47d-bc3889f9a196]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:59:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7e7aa60a-9e41-4a10-a8fe-16e838af6195 tempest-AttachVolumeNegativeTest-1037417113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d062b521-f575-4e5e-a2e7-2a91e1aca586 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:06 devstack sudo[100524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d062b521-f575-4e5e-a2e7-2a91e1aca586 Jul 30 16:59:06 devstack sudo[100524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:07 devstack sudo[100524]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:07 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7e7aa60a-9e41-4a10-a8fe-16e838af6195 tempest-AttachVolumeNegativeTest-1037417113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d062b521-f575-4e5e-a2e7-2a91e1aca586" returned: 0 in 0.494s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:07 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7e7aa60a-9e41-4a10-a8fe-16e838af6195 tempest-AttachVolumeNegativeTest-1037417113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d062b521-f575-4e5e-a2e7-2a91e1aca586 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:07 devstack sudo[100529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d062b521-f575-4e5e-a2e7-2a91e1aca586 Jul 30 16:59:07 devstack sudo[100529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:07 devstack sudo[100529]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:07 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7e7aa60a-9e41-4a10-a8fe-16e838af6195 tempest-AttachVolumeNegativeTest-1037417113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d062b521-f575-4e5e-a2e7-2a91e1aca586" returned: 0 in 0.396s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:07 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-7e7aa60a-9e41-4a10-a8fe-16e838af6195 tempest-AttachVolumeNegativeTest-1037417113 None] Lock "cinder-quobyte-d062b521-f575-4e5e-a2e7-2a91e1aca586" released by "delete_volume" :: held 0.955s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:59:07 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-7e7aa60a-9e41-4a10-a8fe-16e838af6195 tempest-AttachVolumeNegativeTest-1037417113 None] Created reservations ['5cbaa841-7c8a-496e-8893-c6d2d275e798', '0ae1370f-626f-46ce-8e02-97dcb392e011', '5d9f94ca-d937-4c6b-b61e-5400ffe752b6', '6a0db3d2-c94d-4c8c-8c82-ad2a068f6e1e'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:59:07 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-7e7aa60a-9e41-4a10-a8fe-16e838af6195 tempest-AttachVolumeNegativeTest-1037417113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:59:07 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-7e7aa60a-9e41-4a10-a8fe-16e838af6195 tempest-AttachVolumeNegativeTest-1037417113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:59:07 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-7e7aa60a-9e41-4a10-a8fe-16e838af6195 tempest-AttachVolumeNegativeTest-1037417113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:59:07 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-7e7aa60a-9e41-4a10-a8fe-16e838af6195 tempest-AttachVolumeNegativeTest-1037417113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:59:07 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-7e7aa60a-9e41-4a10-a8fe-16e838af6195 tempest-AttachVolumeNegativeTest-1037417113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:59:07 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7e7aa60a-9e41-4a10-a8fe-16e838af6195 tempest-AttachVolumeNegativeTest-1037417113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:07 devstack sudo[100532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:59:07 devstack sudo[100532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:08 devstack sudo[100532]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:08 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7e7aa60a-9e41-4a10-a8fe-16e838af6195 tempest-AttachVolumeNegativeTest-1037417113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.296s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:08 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-7e7aa60a-9e41-4a10-a8fe-16e838af6195 tempest-AttachVolumeNegativeTest-1037417113 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:59:08 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-7e7aa60a-9e41-4a10-a8fe-16e838af6195 tempest-AttachVolumeNegativeTest-1037417113 None] Deleted volume successfully. Jul 30 16:59:08 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-7e7aa60a-9e41-4a10-a8fe-16e838af6195 tempest-AttachVolumeNegativeTest-1037417113 None] Lock "cinder-d062b521-f575-4e5e-a2e7-2a91e1aca586-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:59:08 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-8803a131-e814-400e-b7cd-d886e2add35f tempest-VolumesActionsTest-1414446346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:59:08 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8803a131-e814-400e-b7cd-d886e2add35f tempest-VolumesActionsTest-1414446346 None] Flow 'volume_create_manager' (de792396-4c8a-4384-8ea8-27dbf10bc9eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:59:08 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8803a131-e814-400e-b7cd-d886e2add35f tempest-VolumesActionsTest-1414446346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bfb9f0f-6e68-4254-b10b-4aa2d654a193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:08 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8803a131-e814-400e-b7cd-d886e2add35f tempest-VolumesActionsTest-1414446346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bfb9f0f-6e68-4254-b10b-4aa2d654a193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:59:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-785273055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c1f1086-1cea-4539-b6ee-f2e715ba6810,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc3fd31f4c104ffeb6248fdda02ce329',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:59:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:59:08Z,use_quota=True,user_id='dfa59b6330804cff8eaf14bba1af8c6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:08 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8803a131-e814-400e-b7cd-d886e2add35f tempest-VolumesActionsTest-1414446346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e869027-39d8-4cbc-a313-4864a181d51e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:08 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8803a131-e814-400e-b7cd-d886e2add35f tempest-VolumesActionsTest-1414446346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e869027-39d8-4cbc-a313-4864a181d51e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:08 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8803a131-e814-400e-b7cd-d886e2add35f tempest-VolumesActionsTest-1414446346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30eff7ee-8944-4bb9-8a06-620dc4e0c1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:08 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8803a131-e814-400e-b7cd-d886e2add35f tempest-VolumesActionsTest-1414446346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30eff7ee-8944-4bb9-8a06-620dc4e0c1c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c1f1086-1cea-4539-b6ee-f2e715ba6810', 'volume_name': 'volume-3c1f1086-1cea-4539-b6ee-f2e715ba6810', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:08 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8803a131-e814-400e-b7cd-d886e2add35f tempest-VolumesActionsTest-1414446346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (643f7912-5b9a-425b-88a5-610bc8911f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:08 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8803a131-e814-400e-b7cd-d886e2add35f tempest-VolumesActionsTest-1414446346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (643f7912-5b9a-425b-88a5-610bc8911f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:08 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8803a131-e814-400e-b7cd-d886e2add35f tempest-VolumesActionsTest-1414446346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7f2ba4c-b030-40df-b234-38d1de511ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:08 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-8803a131-e814-400e-b7cd-d886e2add35f tempest-VolumesActionsTest-1414446346 None] Volume 3c1f1086-1cea-4539-b6ee-f2e715ba6810: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c1f1086-1cea-4539-b6ee-f2e715ba6810', 'volume_size': 1} Jul 30 16:59:08 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-8803a131-e814-400e-b7cd-d886e2add35f tempest-VolumesActionsTest-1414446346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:59:08 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-8803a131-e814-400e-b7cd-d886e2add35f tempest-VolumesActionsTest-1414446346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:59:08 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-8803a131-e814-400e-b7cd-d886e2add35f tempest-VolumesActionsTest-1414446346 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:59:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-785273055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c1f1086-1cea-4539-b6ee-f2e715ba6810,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc3fd31f4c104ffeb6248fdda02ce329',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:59:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:59:08Z,use_quota=True,user_id='dfa59b6330804cff8eaf14bba1af8c6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:59:08 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-8803a131-e814-400e-b7cd-d886e2add35f tempest-VolumesActionsTest-1414446346 None] Creating volume 3c1f1086-1cea-4539-b6ee-f2e715ba6810 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:59:08 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-8803a131-e814-400e-b7cd-d886e2add35f tempest-VolumesActionsTest-1414446346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:59:08 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-8803a131-e814-400e-b7cd-d886e2add35f tempest-VolumesActionsTest-1414446346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:59:08 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-8803a131-e814-400e-b7cd-d886e2add35f tempest-VolumesActionsTest-1414446346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:59:08 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-8803a131-e814-400e-b7cd-d886e2add35f tempest-VolumesActionsTest-1414446346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:59:08 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-8803a131-e814-400e-b7cd-d886e2add35f tempest-VolumesActionsTest-1414446346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:59:08 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-8803a131-e814-400e-b7cd-d886e2add35f tempest-VolumesActionsTest-1414446346 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:59:08 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-8803a131-e814-400e-b7cd-d886e2add35f tempest-VolumesActionsTest-1414446346 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 16:59:08 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8803a131-e814-400e-b7cd-d886e2add35f tempest-VolumesActionsTest-1414446346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-3c1f1086-1cea-4539-b6ee-f2e715ba6810 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:08 devstack sudo[100536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-3c1f1086-1cea-4539-b6ee-f2e715ba6810 1073741824 Jul 30 16:59:08 devstack sudo[100536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:09 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-37c7eab2-a33d-4d21-93c6-61d37f6954da tempest-AttachVolumeNegativeTest-1037417113 None] Acquiring lock "cinder-15525624-5a95-43ed-b3e2-6ffbbb3c22ed-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:59:09 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-37c7eab2-a33d-4d21-93c6-61d37f6954da tempest-AttachVolumeNegativeTest-1037417113 None] Lock "cinder-15525624-5a95-43ed-b3e2-6ffbbb3c22ed-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:59:09 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-37c7eab2-a33d-4d21-93c6-61d37f6954da tempest-AttachVolumeNegativeTest-1037417113 None] Acquiring lock "cinder-quobyte-15525624-5a95-43ed-b3e2-6ffbbb3c22ed" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:59:09 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-37c7eab2-a33d-4d21-93c6-61d37f6954da tempest-AttachVolumeNegativeTest-1037417113 None] Lock "cinder-quobyte-15525624-5a95-43ed-b3e2-6ffbbb3c22ed" acquired by "delete_volume" :: waited 0.021s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:59:09 devstack sudo[100536]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:09 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8803a131-e814-400e-b7cd-d886e2add35f tempest-VolumesActionsTest-1414446346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-3c1f1086-1cea-4539-b6ee-f2e715ba6810 1073741824" returned: 0 in 0.610s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:09 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c9a9b4-8758-489f-b246-e78c57756dc1]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:59:09 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-37c7eab2-a33d-4d21-93c6-61d37f6954da tempest-AttachVolumeNegativeTest-1037417113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-15525624-5a95-43ed-b3e2-6ffbbb3c22ed {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:09 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8803a131-e814-400e-b7cd-d886e2add35f tempest-VolumesActionsTest-1414446346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-3c1f1086-1cea-4539-b6ee-f2e715ba6810 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:09 devstack sudo[100543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-3c1f1086-1cea-4539-b6ee-f2e715ba6810 Jul 30 16:59:09 devstack sudo[100543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:09 devstack sudo[100542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-15525624-5a95-43ed-b3e2-6ffbbb3c22ed Jul 30 16:59:09 devstack sudo[100542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:09 devstack sudo[100543]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:09 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8803a131-e814-400e-b7cd-d886e2add35f tempest-VolumesActionsTest-1414446346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-3c1f1086-1cea-4539-b6ee-f2e715ba6810" returned: 0 in 0.335s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:09 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-8803a131-e814-400e-b7cd-d886e2add35f tempest-VolumesActionsTest-1414446346 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:59:09 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-8803a131-e814-400e-b7cd-d886e2add35f tempest-VolumesActionsTest-1414446346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:59:09 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8803a131-e814-400e-b7cd-d886e2add35f tempest-VolumesActionsTest-1414446346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7f2ba4c-b030-40df-b234-38d1de511ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c1f1086-1cea-4539-b6ee-f2e715ba6810', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:09 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8803a131-e814-400e-b7cd-d886e2add35f tempest-VolumesActionsTest-1414446346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c3990c3-e285-4088-8e5a-d593728be1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:09 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-8803a131-e814-400e-b7cd-d886e2add35f tempest-VolumesActionsTest-1414446346 None] Volume volume-3c1f1086-1cea-4539-b6ee-f2e715ba6810 (3c1f1086-1cea-4539-b6ee-f2e715ba6810): created successfully Jul 30 16:59:09 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8803a131-e814-400e-b7cd-d886e2add35f tempest-VolumesActionsTest-1414446346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c3990c3-e285-4088-8e5a-d593728be1e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:09 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8803a131-e814-400e-b7cd-d886e2add35f tempest-VolumesActionsTest-1414446346 None] Flow 'volume_create_manager' (de792396-4c8a-4384-8ea8-27dbf10bc9eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:59:09 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-8803a131-e814-400e-b7cd-d886e2add35f tempest-VolumesActionsTest-1414446346 None] Created volume successfully. Jul 30 16:59:09 devstack sudo[100542]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:09 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-37c7eab2-a33d-4d21-93c6-61d37f6954da tempest-AttachVolumeNegativeTest-1037417113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-15525624-5a95-43ed-b3e2-6ffbbb3c22ed" returned: 0 in 0.596s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:09 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-37c7eab2-a33d-4d21-93c6-61d37f6954da tempest-AttachVolumeNegativeTest-1037417113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-15525624-5a95-43ed-b3e2-6ffbbb3c22ed {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:09 devstack sudo[100550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-15525624-5a95-43ed-b3e2-6ffbbb3c22ed Jul 30 16:59:09 devstack sudo[100550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:10 devstack sudo[100550]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:10 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-37c7eab2-a33d-4d21-93c6-61d37f6954da tempest-AttachVolumeNegativeTest-1037417113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-15525624-5a95-43ed-b3e2-6ffbbb3c22ed" returned: 0 in 0.295s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:10 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-37c7eab2-a33d-4d21-93c6-61d37f6954da tempest-AttachVolumeNegativeTest-1037417113 None] Lock "cinder-quobyte-15525624-5a95-43ed-b3e2-6ffbbb3c22ed" released by "delete_volume" :: held 0.959s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:59:10 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-37c7eab2-a33d-4d21-93c6-61d37f6954da tempest-AttachVolumeNegativeTest-1037417113 None] Created reservations ['e39d53bc-4cad-4c59-b387-9a087e82a23a', '085f667e-ce65-49db-8397-5217ed362ddc', 'abe9c7f1-3c9a-4a90-89da-743a192861d8', 'e4356eda-6c7b-478a-86fe-6f09c6c226e4'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:59:10 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-37c7eab2-a33d-4d21-93c6-61d37f6954da tempest-AttachVolumeNegativeTest-1037417113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:59:10 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-37c7eab2-a33d-4d21-93c6-61d37f6954da tempest-AttachVolumeNegativeTest-1037417113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:59:10 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-37c7eab2-a33d-4d21-93c6-61d37f6954da tempest-AttachVolumeNegativeTest-1037417113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:59:10 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-37c7eab2-a33d-4d21-93c6-61d37f6954da tempest-AttachVolumeNegativeTest-1037417113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:59:10 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-37c7eab2-a33d-4d21-93c6-61d37f6954da tempest-AttachVolumeNegativeTest-1037417113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:59:10 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-37c7eab2-a33d-4d21-93c6-61d37f6954da tempest-AttachVolumeNegativeTest-1037417113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:10 devstack sudo[100554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:59:10 devstack sudo[100554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:10 devstack sudo[100554]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:10 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-37c7eab2-a33d-4d21-93c6-61d37f6954da tempest-AttachVolumeNegativeTest-1037417113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.329s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:10 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-37c7eab2-a33d-4d21-93c6-61d37f6954da tempest-AttachVolumeNegativeTest-1037417113 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:59:10 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-37c7eab2-a33d-4d21-93c6-61d37f6954da tempest-AttachVolumeNegativeTest-1037417113 None] Deleted volume successfully. Jul 30 16:59:10 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-37c7eab2-a33d-4d21-93c6-61d37f6954da tempest-AttachVolumeNegativeTest-1037417113 None] Lock "cinder-15525624-5a95-43ed-b3e2-6ffbbb3c22ed-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:59:11 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-130c2fb3-1bba-4b95-90dc-92eb6c7960d2 tempest-AttachVolumeNegativeTest-1037417113 None] Acquiring lock "cinder-a02b427c-6e26-4fcf-b0ca-6161d756a83a-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:59:11 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-130c2fb3-1bba-4b95-90dc-92eb6c7960d2 tempest-AttachVolumeNegativeTest-1037417113 None] Lock "cinder-a02b427c-6e26-4fcf-b0ca-6161d756a83a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:59:11 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-130c2fb3-1bba-4b95-90dc-92eb6c7960d2 tempest-AttachVolumeNegativeTest-1037417113 None] Acquiring lock "cinder-quobyte-a02b427c-6e26-4fcf-b0ca-6161d756a83a" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:59:11 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-130c2fb3-1bba-4b95-90dc-92eb6c7960d2 tempest-AttachVolumeNegativeTest-1037417113 None] Lock "cinder-quobyte-a02b427c-6e26-4fcf-b0ca-6161d756a83a" acquired by "delete_volume" :: waited 0.027s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:59:11 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c71be8-b393-49e3-b463-41ae1435e110]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:59:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-130c2fb3-1bba-4b95-90dc-92eb6c7960d2 tempest-AttachVolumeNegativeTest-1037417113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-a02b427c-6e26-4fcf-b0ca-6161d756a83a {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:11 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca1fa197-7b6c-486c-b015-ef2e929a4585 tempest-ProjectReaderTests-284310754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:59:11 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ca1fa197-7b6c-486c-b015-ef2e929a4585 tempest-ProjectReaderTests-284310754 None] Flow 'volume_create_manager' (c5b42a10-a27e-4bbc-a770-58188b415119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:59:11 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ca1fa197-7b6c-486c-b015-ef2e929a4585 tempest-ProjectReaderTests-284310754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6215905b-1cb4-43c7-bde0-416eb7641d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:11 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ca1fa197-7b6c-486c-b015-ef2e929a4585 tempest-ProjectReaderTests-284310754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6215905b-1cb4-43c7-bde0-416eb7641d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:59:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1436752165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10032342-89d2-46ff-94a6-92f3b7002059,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7a40213a0b44425a15f0b9caf4c1d77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:59:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:59:12Z,use_quota=True,user_id='de32273ed4b644e08da34e3cd5214f62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:11 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ca1fa197-7b6c-486c-b015-ef2e929a4585 tempest-ProjectReaderTests-284310754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34bf2b14-3d92-456c-9cda-d96677d7c1a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:11 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ca1fa197-7b6c-486c-b015-ef2e929a4585 tempest-ProjectReaderTests-284310754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34bf2b14-3d92-456c-9cda-d96677d7c1a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:11 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ca1fa197-7b6c-486c-b015-ef2e929a4585 tempest-ProjectReaderTests-284310754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e87b681c-d6b4-49ab-8088-1297afef484a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:11 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ca1fa197-7b6c-486c-b015-ef2e929a4585 tempest-ProjectReaderTests-284310754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e87b681c-d6b4-49ab-8088-1297afef484a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10032342-89d2-46ff-94a6-92f3b7002059', 'volume_name': 'volume-10032342-89d2-46ff-94a6-92f3b7002059', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:11 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ca1fa197-7b6c-486c-b015-ef2e929a4585 tempest-ProjectReaderTests-284310754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f9b3711-ed18-4a0a-80e0-fdda63d02895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:11 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ca1fa197-7b6c-486c-b015-ef2e929a4585 tempest-ProjectReaderTests-284310754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f9b3711-ed18-4a0a-80e0-fdda63d02895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:11 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ca1fa197-7b6c-486c-b015-ef2e929a4585 tempest-ProjectReaderTests-284310754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18e9f773-41b5-4890-998a-1e578b36b250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:11 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-ca1fa197-7b6c-486c-b015-ef2e929a4585 tempest-ProjectReaderTests-284310754 None] Volume 10032342-89d2-46ff-94a6-92f3b7002059: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10032342-89d2-46ff-94a6-92f3b7002059', 'volume_size': 1} Jul 30 16:59:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-ca1fa197-7b6c-486c-b015-ef2e929a4585 tempest-ProjectReaderTests-284310754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:59:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-ca1fa197-7b6c-486c-b015-ef2e929a4585 tempest-ProjectReaderTests-284310754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:59:11 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-ca1fa197-7b6c-486c-b015-ef2e929a4585 tempest-ProjectReaderTests-284310754 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:59:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1436752165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10032342-89d2-46ff-94a6-92f3b7002059,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7a40213a0b44425a15f0b9caf4c1d77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:59:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:59:12Z,use_quota=True,user_id='de32273ed4b644e08da34e3cd5214f62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:59:11 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-ca1fa197-7b6c-486c-b015-ef2e929a4585 tempest-ProjectReaderTests-284310754 None] Creating volume 10032342-89d2-46ff-94a6-92f3b7002059 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:59:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-ca1fa197-7b6c-486c-b015-ef2e929a4585 tempest-ProjectReaderTests-284310754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:59:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-ca1fa197-7b6c-486c-b015-ef2e929a4585 tempest-ProjectReaderTests-284310754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:59:11 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-ca1fa197-7b6c-486c-b015-ef2e929a4585 tempest-ProjectReaderTests-284310754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:59:11 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-ca1fa197-7b6c-486c-b015-ef2e929a4585 tempest-ProjectReaderTests-284310754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:59:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-ca1fa197-7b6c-486c-b015-ef2e929a4585 tempest-ProjectReaderTests-284310754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:59:11 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-ca1fa197-7b6c-486c-b015-ef2e929a4585 tempest-ProjectReaderTests-284310754 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:59:11 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-ca1fa197-7b6c-486c-b015-ef2e929a4585 tempest-ProjectReaderTests-284310754 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 16:59:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-ca1fa197-7b6c-486c-b015-ef2e929a4585 tempest-ProjectReaderTests-284310754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-10032342-89d2-46ff-94a6-92f3b7002059 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:11 devstack sudo[100561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-a02b427c-6e26-4fcf-b0ca-6161d756a83a Jul 30 16:59:11 devstack sudo[100561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:12 devstack sudo[100563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-10032342-89d2-46ff-94a6-92f3b7002059 1073741824 Jul 30 16:59:12 devstack sudo[100563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:12 devstack sudo[100561]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-130c2fb3-1bba-4b95-90dc-92eb6c7960d2 tempest-AttachVolumeNegativeTest-1037417113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-a02b427c-6e26-4fcf-b0ca-6161d756a83a" returned: 0 in 0.493s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-130c2fb3-1bba-4b95-90dc-92eb6c7960d2 tempest-AttachVolumeNegativeTest-1037417113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-a02b427c-6e26-4fcf-b0ca-6161d756a83a {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:12 devstack sudo[100572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-a02b427c-6e26-4fcf-b0ca-6161d756a83a Jul 30 16:59:12 devstack sudo[100572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:12 devstack sudo[100563]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-ca1fa197-7b6c-486c-b015-ef2e929a4585 tempest-ProjectReaderTests-284310754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-10032342-89d2-46ff-94a6-92f3b7002059 1073741824" returned: 0 in 0.591s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-ca1fa197-7b6c-486c-b015-ef2e929a4585 tempest-ProjectReaderTests-284310754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-10032342-89d2-46ff-94a6-92f3b7002059 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:12 devstack sudo[100577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-10032342-89d2-46ff-94a6-92f3b7002059 Jul 30 16:59:12 devstack sudo[100577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:12 devstack sudo[100572]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-130c2fb3-1bba-4b95-90dc-92eb6c7960d2 tempest-AttachVolumeNegativeTest-1037417113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-a02b427c-6e26-4fcf-b0ca-6161d756a83a" returned: 0 in 0.389s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:12 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-130c2fb3-1bba-4b95-90dc-92eb6c7960d2 tempest-AttachVolumeNegativeTest-1037417113 None] Lock "cinder-quobyte-a02b427c-6e26-4fcf-b0ca-6161d756a83a" released by "delete_volume" :: held 0.975s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:59:12 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-130c2fb3-1bba-4b95-90dc-92eb6c7960d2 tempest-AttachVolumeNegativeTest-1037417113 None] Created reservations ['62efcf79-aa18-44cd-bff7-922361447dc6', '106d9aba-1376-4f80-944e-4c7cdf14bd58', '3e73af87-8b87-4d4d-866e-30e18ef5c90d', '702e0ece-c040-435f-ae40-65c74c72305a'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:59:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-130c2fb3-1bba-4b95-90dc-92eb6c7960d2 tempest-AttachVolumeNegativeTest-1037417113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:59:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-130c2fb3-1bba-4b95-90dc-92eb6c7960d2 tempest-AttachVolumeNegativeTest-1037417113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:59:12 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-130c2fb3-1bba-4b95-90dc-92eb6c7960d2 tempest-AttachVolumeNegativeTest-1037417113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:59:12 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-130c2fb3-1bba-4b95-90dc-92eb6c7960d2 tempest-AttachVolumeNegativeTest-1037417113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:59:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-130c2fb3-1bba-4b95-90dc-92eb6c7960d2 tempest-AttachVolumeNegativeTest-1037417113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:59:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-130c2fb3-1bba-4b95-90dc-92eb6c7960d2 tempest-AttachVolumeNegativeTest-1037417113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:12 devstack sudo[100577]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-ca1fa197-7b6c-486c-b015-ef2e929a4585 tempest-ProjectReaderTests-284310754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-10032342-89d2-46ff-94a6-92f3b7002059" returned: 0 in 0.390s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:12 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-ca1fa197-7b6c-486c-b015-ef2e929a4585 tempest-ProjectReaderTests-284310754 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:59:12 devstack sudo[100581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:59:12 devstack sudo[100581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-ca1fa197-7b6c-486c-b015-ef2e929a4585 tempest-ProjectReaderTests-284310754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:59:13 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ca1fa197-7b6c-486c-b015-ef2e929a4585 tempest-ProjectReaderTests-284310754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18e9f773-41b5-4890-998a-1e578b36b250) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10032342-89d2-46ff-94a6-92f3b7002059', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:13 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ca1fa197-7b6c-486c-b015-ef2e929a4585 tempest-ProjectReaderTests-284310754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aab6adb9-df76-4647-ab8b-51c887828978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:13 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-ca1fa197-7b6c-486c-b015-ef2e929a4585 tempest-ProjectReaderTests-284310754 None] Volume volume-10032342-89d2-46ff-94a6-92f3b7002059 (10032342-89d2-46ff-94a6-92f3b7002059): created successfully Jul 30 16:59:13 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ca1fa197-7b6c-486c-b015-ef2e929a4585 tempest-ProjectReaderTests-284310754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aab6adb9-df76-4647-ab8b-51c887828978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:13 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ca1fa197-7b6c-486c-b015-ef2e929a4585 tempest-ProjectReaderTests-284310754 None] Flow 'volume_create_manager' (c5b42a10-a27e-4bbc-a770-58188b415119) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:59:13 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-ca1fa197-7b6c-486c-b015-ef2e929a4585 tempest-ProjectReaderTests-284310754 None] Created volume successfully. Jul 30 16:59:13 devstack sudo[100581]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-130c2fb3-1bba-4b95-90dc-92eb6c7960d2 tempest-AttachVolumeNegativeTest-1037417113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.313s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:13 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-130c2fb3-1bba-4b95-90dc-92eb6c7960d2 tempest-AttachVolumeNegativeTest-1037417113 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:59:13 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-130c2fb3-1bba-4b95-90dc-92eb6c7960d2 tempest-AttachVolumeNegativeTest-1037417113 None] Deleted volume successfully. Jul 30 16:59:13 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-130c2fb3-1bba-4b95-90dc-92eb6c7960d2 tempest-AttachVolumeNegativeTest-1037417113 None] Lock "cinder-a02b427c-6e26-4fcf-b0ca-6161d756a83a-delete_volume" released by "delete_volume" :: held 1.660s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:59:14 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-6d60c15c-b7f3-4d2d-a448-0aba55d91532 tempest-ProjectReaderTests-284310754 None] Acquiring lock "cinder-10032342-89d2-46ff-94a6-92f3b7002059-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:59:14 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-6d60c15c-b7f3-4d2d-a448-0aba55d91532 tempest-ProjectReaderTests-284310754 None] Lock "cinder-10032342-89d2-46ff-94a6-92f3b7002059-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:59:14 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-6d60c15c-b7f3-4d2d-a448-0aba55d91532 tempest-ProjectReaderTests-284310754 None] Acquiring lock "cinder-quobyte-10032342-89d2-46ff-94a6-92f3b7002059" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:59:14 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-6d60c15c-b7f3-4d2d-a448-0aba55d91532 tempest-ProjectReaderTests-284310754 None] Lock "cinder-quobyte-10032342-89d2-46ff-94a6-92f3b7002059" acquired by "delete_volume" :: waited 0.037s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:59:14 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[36997033-8a14-40f5-81c2-0e2a9fc9dfd7]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:59:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-6d60c15c-b7f3-4d2d-a448-0aba55d91532 tempest-ProjectReaderTests-284310754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-10032342-89d2-46ff-94a6-92f3b7002059 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:14 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-71b43fc5-c85f-4f36-9f45-fc507576c197 tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:59:14 devstack sudo[100600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-10032342-89d2-46ff-94a6-92f3b7002059 Jul 30 16:59:14 devstack sudo[100600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:14 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-71b43fc5-c85f-4f36-9f45-fc507576c197 tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] Flow 'volume_create_manager' (1cedf54b-c07b-4d08-871c-e3803b6b723c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:59:14 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-71b43fc5-c85f-4f36-9f45-fc507576c197 tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97279d14-70ac-4aae-a097-0c5d450deb4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:14 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-71b43fc5-c85f-4f36-9f45-fc507576c197 tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97279d14-70ac-4aae-a097-0c5d450deb4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:59:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2017777522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=294647f2-9ee6-472c-9099-51555492638a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89b6fce1736c4c209ccaf654d5df0ae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:59:15Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:59:15Z,use_quota=True,user_id='5997c7db49784ce3a2e73c5a54ed8289',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:14 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-71b43fc5-c85f-4f36-9f45-fc507576c197 tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bafdbaeb-5d3e-4324-b533-83e054a4b6b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:14 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-71b43fc5-c85f-4f36-9f45-fc507576c197 tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bafdbaeb-5d3e-4324-b533-83e054a4b6b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:14 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-71b43fc5-c85f-4f36-9f45-fc507576c197 tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9df40f4e-05fc-457d-83c5-f1681b735c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:14 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-71b43fc5-c85f-4f36-9f45-fc507576c197 tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9df40f4e-05fc-457d-83c5-f1681b735c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '294647f2-9ee6-472c-9099-51555492638a', 'volume_name': 'volume-294647f2-9ee6-472c-9099-51555492638a', 'volume_size': 2}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:14 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-71b43fc5-c85f-4f36-9f45-fc507576c197 tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01ad88eb-9058-4ad3-8be0-b8ff83a9750a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:14 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-71b43fc5-c85f-4f36-9f45-fc507576c197 tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01ad88eb-9058-4ad3-8be0-b8ff83a9750a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:14 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-71b43fc5-c85f-4f36-9f45-fc507576c197 tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54ffbd7f-56c4-4a53-983c-b2ac63035a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:14 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-71b43fc5-c85f-4f36-9f45-fc507576c197 tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] Volume 294647f2-9ee6-472c-9099-51555492638a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-294647f2-9ee6-472c-9099-51555492638a', 'volume_size': 2} Jul 30 16:59:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-71b43fc5-c85f-4f36-9f45-fc507576c197 tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:59:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-71b43fc5-c85f-4f36-9f45-fc507576c197 tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:59:14 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-71b43fc5-c85f-4f36-9f45-fc507576c197 tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:59:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2017777522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=294647f2-9ee6-472c-9099-51555492638a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89b6fce1736c4c209ccaf654d5df0ae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:59:15Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:59:15Z,use_quota=True,user_id='5997c7db49784ce3a2e73c5a54ed8289',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:59:14 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-71b43fc5-c85f-4f36-9f45-fc507576c197 tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] Creating volume 294647f2-9ee6-472c-9099-51555492638a {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:59:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-71b43fc5-c85f-4f36-9f45-fc507576c197 tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:59:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-71b43fc5-c85f-4f36-9f45-fc507576c197 tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:59:14 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-71b43fc5-c85f-4f36-9f45-fc507576c197 tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:59:14 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-71b43fc5-c85f-4f36-9f45-fc507576c197 tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:59:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-71b43fc5-c85f-4f36-9f45-fc507576c197 tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:59:14 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-71b43fc5-c85f-4f36-9f45-fc507576c197 tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:59:14 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-71b43fc5-c85f-4f36-9f45-fc507576c197 tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 16:59:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-71b43fc5-c85f-4f36-9f45-fc507576c197 tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-294647f2-9ee6-472c-9099-51555492638a 2147483648 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:14 devstack sudo[100603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-294647f2-9ee6-472c-9099-51555492638a 2147483648 Jul 30 16:59:14 devstack sudo[100603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:14 devstack sudo[100600]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-6d60c15c-b7f3-4d2d-a448-0aba55d91532 tempest-ProjectReaderTests-284310754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-10032342-89d2-46ff-94a6-92f3b7002059" returned: 0 in 0.496s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-6d60c15c-b7f3-4d2d-a448-0aba55d91532 tempest-ProjectReaderTests-284310754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-10032342-89d2-46ff-94a6-92f3b7002059 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:14 devstack sudo[100608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-10032342-89d2-46ff-94a6-92f3b7002059 Jul 30 16:59:14 devstack sudo[100608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:15 devstack sudo[100608]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:15 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-6d60c15c-b7f3-4d2d-a448-0aba55d91532 tempest-ProjectReaderTests-284310754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-10032342-89d2-46ff-94a6-92f3b7002059" returned: 0 in 0.307s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:15 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-6d60c15c-b7f3-4d2d-a448-0aba55d91532 tempest-ProjectReaderTests-284310754 None] Lock "cinder-quobyte-10032342-89d2-46ff-94a6-92f3b7002059" released by "delete_volume" :: held 0.906s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:59:15 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-6d60c15c-b7f3-4d2d-a448-0aba55d91532 tempest-ProjectReaderTests-284310754 None] Created reservations ['0934bd5e-7130-4ef2-97a8-9ff1cb18b82b', '33a74d28-2050-46e3-a1a7-c0a4834bde34', 'e1666d6d-e2af-4bf4-ba8b-d6632fd9afc0', '864cafec-3063-4617-b1f4-3d6792773303'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:59:15 devstack sudo[100603]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:15 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-71b43fc5-c85f-4f36-9f45-fc507576c197 tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-294647f2-9ee6-472c-9099-51555492638a 2147483648" returned: 0 in 0.645s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:15 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-71b43fc5-c85f-4f36-9f45-fc507576c197 tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-294647f2-9ee6-472c-9099-51555492638a {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:15 devstack sudo[100615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-294647f2-9ee6-472c-9099-51555492638a Jul 30 16:59:15 devstack sudo[100615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:15 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-6d60c15c-b7f3-4d2d-a448-0aba55d91532 tempest-ProjectReaderTests-284310754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:59:15 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-6d60c15c-b7f3-4d2d-a448-0aba55d91532 tempest-ProjectReaderTests-284310754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:59:15 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-6d60c15c-b7f3-4d2d-a448-0aba55d91532 tempest-ProjectReaderTests-284310754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:59:15 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-6d60c15c-b7f3-4d2d-a448-0aba55d91532 tempest-ProjectReaderTests-284310754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:59:15 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-6d60c15c-b7f3-4d2d-a448-0aba55d91532 tempest-ProjectReaderTests-284310754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:59:15 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-6d60c15c-b7f3-4d2d-a448-0aba55d91532 tempest-ProjectReaderTests-284310754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:15 devstack sudo[100617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:59:15 devstack sudo[100617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:15 devstack sudo[100615]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:15 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-71b43fc5-c85f-4f36-9f45-fc507576c197 tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-294647f2-9ee6-472c-9099-51555492638a" returned: 0 in 0.279s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:15 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-71b43fc5-c85f-4f36-9f45-fc507576c197 tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:59:15 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-71b43fc5-c85f-4f36-9f45-fc507576c197 tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:59:15 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-71b43fc5-c85f-4f36-9f45-fc507576c197 tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54ffbd7f-56c4-4a53-983c-b2ac63035a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-294647f2-9ee6-472c-9099-51555492638a', 'volume_size': 2}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:15 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-71b43fc5-c85f-4f36-9f45-fc507576c197 tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3064117e-89c8-4792-823c-389418da4963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:15 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-71b43fc5-c85f-4f36-9f45-fc507576c197 tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] Volume volume-294647f2-9ee6-472c-9099-51555492638a (294647f2-9ee6-472c-9099-51555492638a): created successfully Jul 30 16:59:15 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-71b43fc5-c85f-4f36-9f45-fc507576c197 tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3064117e-89c8-4792-823c-389418da4963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:15 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-71b43fc5-c85f-4f36-9f45-fc507576c197 tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] Flow 'volume_create_manager' (1cedf54b-c07b-4d08-871c-e3803b6b723c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:59:15 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-71b43fc5-c85f-4f36-9f45-fc507576c197 tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] Created volume successfully. Jul 30 16:59:15 devstack sudo[100617]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:15 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-6d60c15c-b7f3-4d2d-a448-0aba55d91532 tempest-ProjectReaderTests-284310754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.358s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:15 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-6d60c15c-b7f3-4d2d-a448-0aba55d91532 tempest-ProjectReaderTests-284310754 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:59:15 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-6d60c15c-b7f3-4d2d-a448-0aba55d91532 tempest-ProjectReaderTests-284310754 None] Deleted volume successfully. Jul 30 16:59:15 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-6d60c15c-b7f3-4d2d-a448-0aba55d91532 tempest-ProjectReaderTests-284310754 None] Lock "cinder-10032342-89d2-46ff-94a6-92f3b7002059-delete_volume" released by "delete_volume" :: held 1.739s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:59:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-18821da9-e155-483b-97ad-c624167a6b2c tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:59:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-18821da9-e155-483b-97ad-c624167a6b2c tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:59:17 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-18821da9-e155-483b-97ad-c624167a6b2c tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] Creating offline snapshot 4ad4fdde-7967-466b-897f-7b2df87b2f5a of volume 294647f2-9ee6-472c-9099-51555492638a {{(pid=88568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:59:17 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[400bc291-a538-4a13-8644-c473df913091]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:59:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-18821da9-e155-483b-97ad-c624167a6b2c tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-294647f2-9ee6-472c-9099-51555492638a {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:17 devstack sudo[100665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-294647f2-9ee6-472c-9099-51555492638a Jul 30 16:59:17 devstack sudo[100665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:17 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-55af38c7-0de4-4db2-a9af-592523bd15d3 tempest-ProjectReaderTests-284310754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:59:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-55af38c7-0de4-4db2-a9af-592523bd15d3 tempest-ProjectReaderTests-284310754 None] Flow 'volume_create_manager' (649e8bfe-4a4a-4283-b140-3c4af23bd862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:59:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-55af38c7-0de4-4db2-a9af-592523bd15d3 tempest-ProjectReaderTests-284310754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba59d394-1d57-4beb-84c4-c0acab27efd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-55af38c7-0de4-4db2-a9af-592523bd15d3 tempest-ProjectReaderTests-284310754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba59d394-1d57-4beb-84c4-c0acab27efd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:59:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2127094046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a71164b-2c46-44d6-af12-4a4cb1016601,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7a40213a0b44425a15f0b9caf4c1d77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:59:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:59:18Z,use_quota=True,user_id='de32273ed4b644e08da34e3cd5214f62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-55af38c7-0de4-4db2-a9af-592523bd15d3 tempest-ProjectReaderTests-284310754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85e4244c-c8ce-4920-9dc2-fad48b64eae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-55af38c7-0de4-4db2-a9af-592523bd15d3 tempest-ProjectReaderTests-284310754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85e4244c-c8ce-4920-9dc2-fad48b64eae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-55af38c7-0de4-4db2-a9af-592523bd15d3 tempest-ProjectReaderTests-284310754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab287663-5991-4243-ad8b-7ef29630758f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-55af38c7-0de4-4db2-a9af-592523bd15d3 tempest-ProjectReaderTests-284310754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab287663-5991-4243-ad8b-7ef29630758f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a71164b-2c46-44d6-af12-4a4cb1016601', 'volume_name': 'volume-7a71164b-2c46-44d6-af12-4a4cb1016601', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-55af38c7-0de4-4db2-a9af-592523bd15d3 tempest-ProjectReaderTests-284310754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79c27669-f462-4f96-9cb3-93389276100b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-55af38c7-0de4-4db2-a9af-592523bd15d3 tempest-ProjectReaderTests-284310754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79c27669-f462-4f96-9cb3-93389276100b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-55af38c7-0de4-4db2-a9af-592523bd15d3 tempest-ProjectReaderTests-284310754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e86ef97b-f301-42d7-a806-79e1c5929ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:17 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-55af38c7-0de4-4db2-a9af-592523bd15d3 tempest-ProjectReaderTests-284310754 None] Volume 7a71164b-2c46-44d6-af12-4a4cb1016601: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a71164b-2c46-44d6-af12-4a4cb1016601', 'volume_size': 1} Jul 30 16:59:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-55af38c7-0de4-4db2-a9af-592523bd15d3 tempest-ProjectReaderTests-284310754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:59:18 devstack sudo[100665]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-18821da9-e155-483b-97ad-c624167a6b2c tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-294647f2-9ee6-472c-9099-51555492638a" returned: 0 in 0.743s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-18821da9-e155-483b-97ad-c624167a6b2c tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-294647f2-9ee6-472c-9099-51555492638a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-294647f2-9ee6-472c-9099-51555492638a.4ad4fdde-7967-466b-897f-7b2df87b2f5a 2G {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:18 devstack sudo[100696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-294647f2-9ee6-472c-9099-51555492638a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-294647f2-9ee6-472c-9099-51555492638a.4ad4fdde-7967-466b-897f-7b2df87b2f5a 2G Jul 30 16:59:18 devstack sudo[100696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:18 devstack sudo[100696]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-18821da9-e155-483b-97ad-c624167a6b2c tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-294647f2-9ee6-472c-9099-51555492638a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-294647f2-9ee6-472c-9099-51555492638a.4ad4fdde-7967-466b-897f-7b2df87b2f5a 2G" returned: 0 in 0.627s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-18821da9-e155-483b-97ad-c624167a6b2c tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-294647f2-9ee6-472c-9099-51555492638a -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-294647f2-9ee6-472c-9099-51555492638a.4ad4fdde-7967-466b-897f-7b2df87b2f5a {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:18 devstack sudo[100717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-294647f2-9ee6-472c-9099-51555492638a -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-294647f2-9ee6-472c-9099-51555492638a.4ad4fdde-7967-466b-897f-7b2df87b2f5a Jul 30 16:59:18 devstack sudo[100717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:19 devstack sudo[100717]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:19 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-18821da9-e155-483b-97ad-c624167a6b2c tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-294647f2-9ee6-472c-9099-51555492638a -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-294647f2-9ee6-472c-9099-51555492638a.4ad4fdde-7967-466b-897f-7b2df87b2f5a" returned: 0 in 0.372s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:19 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-18821da9-e155-483b-97ad-c624167a6b2c tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-294647f2-9ee6-472c-9099-51555492638a.4ad4fdde-7967-466b-897f-7b2df87b2f5a is being set with open permissions: ugo+rw Jul 30 16:59:19 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-18821da9-e155-483b-97ad-c624167a6b2c tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-294647f2-9ee6-472c-9099-51555492638a.4ad4fdde-7967-466b-897f-7b2df87b2f5a {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:19 devstack sudo[100722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-294647f2-9ee6-472c-9099-51555492638a.4ad4fdde-7967-466b-897f-7b2df87b2f5a Jul 30 16:59:19 devstack sudo[100722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:19 devstack sudo[100722]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:19 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-18821da9-e155-483b-97ad-c624167a6b2c tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-294647f2-9ee6-472c-9099-51555492638a.4ad4fdde-7967-466b-897f-7b2df87b2f5a" returned: 0 in 0.373s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:19 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-18821da9-e155-483b-97ad-c624167a6b2c tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-294647f2-9ee6-472c-9099-51555492638a.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:19 devstack sudo[100726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-294647f2-9ee6-472c-9099-51555492638a.info Jul 30 16:59:19 devstack sudo[100726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:20 devstack sudo[100726]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-18821da9-e155-483b-97ad-c624167a6b2c tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-294647f2-9ee6-472c-9099-51555492638a.info" returned: 0 in 0.514s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:20 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-18821da9-e155-483b-97ad-c624167a6b2c tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-294647f2-9ee6-472c-9099-51555492638a.info is being set with open permissions: ugo+rw Jul 30 16:59:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-18821da9-e155-483b-97ad-c624167a6b2c tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-294647f2-9ee6-472c-9099-51555492638a.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:20 devstack sudo[100730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-294647f2-9ee6-472c-9099-51555492638a.info Jul 30 16:59:20 devstack sudo[100730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:20 devstack sudo[100730]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-18821da9-e155-483b-97ad-c624167a6b2c tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-294647f2-9ee6-472c-9099-51555492638a.info" returned: 0 in 0.322s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-18821da9-e155-483b-97ad-c624167a6b2c tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.116s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:59:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-55af38c7-0de4-4db2-a9af-592523bd15d3 tempest-ProjectReaderTests-284310754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.429s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:59:20 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-55af38c7-0de4-4db2-a9af-592523bd15d3 tempest-ProjectReaderTests-284310754 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:59:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2127094046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a71164b-2c46-44d6-af12-4a4cb1016601,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7a40213a0b44425a15f0b9caf4c1d77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:59:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:59:18Z,use_quota=True,user_id='de32273ed4b644e08da34e3cd5214f62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:59:20 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-55af38c7-0de4-4db2-a9af-592523bd15d3 tempest-ProjectReaderTests-284310754 None] Creating volume 7a71164b-2c46-44d6-af12-4a4cb1016601 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:59:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-55af38c7-0de4-4db2-a9af-592523bd15d3 tempest-ProjectReaderTests-284310754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:59:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-55af38c7-0de4-4db2-a9af-592523bd15d3 tempest-ProjectReaderTests-284310754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:59:20 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-55af38c7-0de4-4db2-a9af-592523bd15d3 tempest-ProjectReaderTests-284310754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:59:20 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-55af38c7-0de4-4db2-a9af-592523bd15d3 tempest-ProjectReaderTests-284310754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:59:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-55af38c7-0de4-4db2-a9af-592523bd15d3 tempest-ProjectReaderTests-284310754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:59:20 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-55af38c7-0de4-4db2-a9af-592523bd15d3 tempest-ProjectReaderTests-284310754 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:59:20 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-55af38c7-0de4-4db2-a9af-592523bd15d3 tempest-ProjectReaderTests-284310754 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 16:59:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-55af38c7-0de4-4db2-a9af-592523bd15d3 tempest-ProjectReaderTests-284310754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7a71164b-2c46-44d6-af12-4a4cb1016601 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:20 devstack sudo[100733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7a71164b-2c46-44d6-af12-4a4cb1016601 1073741824 Jul 30 16:59:20 devstack sudo[100733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:20 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-18821da9-e155-483b-97ad-c624167a6b2c tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] Create snapshot completed successfully Jul 30 16:59:20 devstack sudo[100733]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-55af38c7-0de4-4db2-a9af-592523bd15d3 tempest-ProjectReaderTests-284310754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7a71164b-2c46-44d6-af12-4a4cb1016601 1073741824" returned: 0 in 0.551s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:21 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-55af38c7-0de4-4db2-a9af-592523bd15d3 tempest-ProjectReaderTests-284310754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7a71164b-2c46-44d6-af12-4a4cb1016601 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:21 devstack sudo[100740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7a71164b-2c46-44d6-af12-4a4cb1016601 Jul 30 16:59:21 devstack sudo[100740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:21 devstack sudo[100740]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:21 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-55af38c7-0de4-4db2-a9af-592523bd15d3 tempest-ProjectReaderTests-284310754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7a71164b-2c46-44d6-af12-4a4cb1016601" returned: 0 in 0.308s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:21 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-55af38c7-0de4-4db2-a9af-592523bd15d3 tempest-ProjectReaderTests-284310754 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:59:21 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-55af38c7-0de4-4db2-a9af-592523bd15d3 tempest-ProjectReaderTests-284310754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:59:21 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-55af38c7-0de4-4db2-a9af-592523bd15d3 tempest-ProjectReaderTests-284310754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e86ef97b-f301-42d7-a806-79e1c5929ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a71164b-2c46-44d6-af12-4a4cb1016601', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:21 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-55af38c7-0de4-4db2-a9af-592523bd15d3 tempest-ProjectReaderTests-284310754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (077fd3c7-2a47-4c7f-bc56-db10ea420888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:21 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-55af38c7-0de4-4db2-a9af-592523bd15d3 tempest-ProjectReaderTests-284310754 None] Volume volume-7a71164b-2c46-44d6-af12-4a4cb1016601 (7a71164b-2c46-44d6-af12-4a4cb1016601): created successfully Jul 30 16:59:21 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-55af38c7-0de4-4db2-a9af-592523bd15d3 tempest-ProjectReaderTests-284310754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (077fd3c7-2a47-4c7f-bc56-db10ea420888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:21 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-55af38c7-0de4-4db2-a9af-592523bd15d3 tempest-ProjectReaderTests-284310754 None] Flow 'volume_create_manager' (649e8bfe-4a4a-4283-b140-3c4af23bd862) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:59:21 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-55af38c7-0de4-4db2-a9af-592523bd15d3 tempest-ProjectReaderTests-284310754 None] Created volume successfully. Jul 30 16:59:21 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-87f9c300-b902-49c0-b890-a826fc0784af tempest-VolumesActionsTest-1414446346 None] Acquiring lock "cinder-3c1f1086-1cea-4539-b6ee-f2e715ba6810" by "attach_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:59:21 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-87f9c300-b902-49c0-b890-a826fc0784af tempest-VolumesActionsTest-1414446346 None] Lock "cinder-3c1f1086-1cea-4539-b6ee-f2e715ba6810" acquired by "attach_volume" :: waited 0.038s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:59:21 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-8fa86989-8319-4eed-9a9b-c22c5bcdc3c9 tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] Acquiring lock "cinder-4ad4fdde-7967-466b-897f-7b2df87b2f5a-delete_snapshot" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:59:21 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-87f9c300-b902-49c0-b890-a826fc0784af tempest-VolumesActionsTest-1414446346 None] Attaching volume 3c1f1086-1cea-4539-b6ee-f2e715ba6810 to instance 53bbcfdf-5c64-4752-b83c-a85fb2335dfe at mountpoint /dev/vdb on host None. Jul 30 16:59:21 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-8fa86989-8319-4eed-9a9b-c22c5bcdc3c9 tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] Lock "cinder-4ad4fdde-7967-466b-897f-7b2df87b2f5a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.074s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:59:21 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-8fa86989-8319-4eed-9a9b-c22c5bcdc3c9 tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] Acquiring lock "cinder-quobyte-294647f2-9ee6-472c-9099-51555492638a" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:59:21 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-87f9c300-b902-49c0-b890-a826fc0784af tempest-VolumesActionsTest-1414446346 None] Attach volume completed successfully. Jul 30 16:59:21 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-8fa86989-8319-4eed-9a9b-c22c5bcdc3c9 tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] Lock "cinder-quobyte-294647f2-9ee6-472c-9099-51555492638a" acquired by "delete_snapshot" :: waited 0.049s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:59:21 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-8fa86989-8319-4eed-9a9b-c22c5bcdc3c9 tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] Acquiring lock "cinder-quobyte-4ad4fdde-7967-466b-897f-7b2df87b2f5a" by "_delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:59:21 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-87f9c300-b902-49c0-b890-a826fc0784af tempest-VolumesActionsTest-1414446346 None] Lock "cinder-3c1f1086-1cea-4539-b6ee-f2e715ba6810" released by "attach_volume" :: held 0.196s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:59:21 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-8fa86989-8319-4eed-9a9b-c22c5bcdc3c9 tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] Lock "cinder-quobyte-4ad4fdde-7967-466b-897f-7b2df87b2f5a" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:59:21 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-8fa86989-8319-4eed-9a9b-c22c5bcdc3c9 tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] Deleting offline snapshot 4ad4fdde-7967-466b-897f-7b2df87b2f5a of volume 294647f2-9ee6-472c-9099-51555492638a {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:59:21 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-8fa86989-8319-4eed-9a9b-c22c5bcdc3c9 tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] snapshot_file for this snap is: volume-294647f2-9ee6-472c-9099-51555492638a.4ad4fdde-7967-466b-897f-7b2df87b2f5a {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:59:21 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f91c912-e816-4d8b-8b55-2f47e3a667a6]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:59:21 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8fa86989-8319-4eed-9a9b-c22c5bcdc3c9 tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-294647f2-9ee6-472c-9099-51555492638a.4ad4fdde-7967-466b-897f-7b2df87b2f5a {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:21 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-e140b75f-20ee-471b-9eff-44892d4b679b tempest-VolumesActionsTest-1414446346 None] Acquiring lock "cinder-3c1f1086-1cea-4539-b6ee-f2e715ba6810-detach_volume" by "detach_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:59:22 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-e140b75f-20ee-471b-9eff-44892d4b679b tempest-VolumesActionsTest-1414446346 None] Lock "cinder-3c1f1086-1cea-4539-b6ee-f2e715ba6810-detach_volume" acquired by "detach_volume" :: waited 0.043s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:59:22 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-e140b75f-20ee-471b-9eff-44892d4b679b tempest-VolumesActionsTest-1414446346 None] Detaching volume 3c1f1086-1cea-4539-b6ee-f2e715ba6810 from instance 53bbcfdf-5c64-4752-b83c-a85fb2335dfe. Jul 30 16:59:22 devstack sudo[100743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-294647f2-9ee6-472c-9099-51555492638a.4ad4fdde-7967-466b-897f-7b2df87b2f5a Jul 30 16:59:22 devstack sudo[100743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:22 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-5bcfafdb-1310-456c-af43-605b7cb738f8 tempest-ProjectReaderTests-284310754 None] Acquiring lock "cinder-7a71164b-2c46-44d6-af12-4a4cb1016601-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:59:22 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-e140b75f-20ee-471b-9eff-44892d4b679b tempest-VolumesActionsTest-1414446346 None] Detach volume completed successfully. Jul 30 16:59:22 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-5bcfafdb-1310-456c-af43-605b7cb738f8 tempest-ProjectReaderTests-284310754 None] Lock "cinder-7a71164b-2c46-44d6-af12-4a4cb1016601-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:59:22 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-e140b75f-20ee-471b-9eff-44892d4b679b tempest-VolumesActionsTest-1414446346 None] Lock "cinder-3c1f1086-1cea-4539-b6ee-f2e715ba6810-detach_volume" released by "detach_volume" :: held 0.190s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:59:22 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-5bcfafdb-1310-456c-af43-605b7cb738f8 tempest-ProjectReaderTests-284310754 None] Acquiring lock "cinder-quobyte-7a71164b-2c46-44d6-af12-4a4cb1016601" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:59:22 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-5bcfafdb-1310-456c-af43-605b7cb738f8 tempest-ProjectReaderTests-284310754 None] Lock "cinder-quobyte-7a71164b-2c46-44d6-af12-4a4cb1016601" acquired by "delete_volume" :: waited 0.035s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:59:22 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e163bf4-971e-4e4e-88a6-517e8dc533ce]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:59:22 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-5bcfafdb-1310-456c-af43-605b7cb738f8 tempest-ProjectReaderTests-284310754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7a71164b-2c46-44d6-af12-4a4cb1016601 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:22 devstack sudo[100743]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:22 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8fa86989-8319-4eed-9a9b-c22c5bcdc3c9 tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-294647f2-9ee6-472c-9099-51555492638a.4ad4fdde-7967-466b-897f-7b2df87b2f5a" returned: 0 in 0.649s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:22 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-8fa86989-8319-4eed-9a9b-c22c5bcdc3c9 tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-294647f2-9ee6-472c-9099-51555492638a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:59:22 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cca8017-52bf-41dd-9184-19a3d6bb2bfd]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:59:22 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8fa86989-8319-4eed-9a9b-c22c5bcdc3c9 tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-294647f2-9ee6-472c-9099-51555492638a {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:22 devstack sudo[100749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7a71164b-2c46-44d6-af12-4a4cb1016601 Jul 30 16:59:22 devstack sudo[100749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:22 devstack sudo[100750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-294647f2-9ee6-472c-9099-51555492638a Jul 30 16:59:22 devstack sudo[100750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:23 devstack sudo[100749]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:23 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-5bcfafdb-1310-456c-af43-605b7cb738f8 tempest-ProjectReaderTests-284310754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7a71164b-2c46-44d6-af12-4a4cb1016601" returned: 0 in 0.628s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:23 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-5bcfafdb-1310-456c-af43-605b7cb738f8 tempest-ProjectReaderTests-284310754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7a71164b-2c46-44d6-af12-4a4cb1016601 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:23 devstack sudo[100761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7a71164b-2c46-44d6-af12-4a4cb1016601 Jul 30 16:59:23 devstack sudo[100761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:23 devstack sudo[100750]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:23 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8fa86989-8319-4eed-9a9b-c22c5bcdc3c9 tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-294647f2-9ee6-472c-9099-51555492638a" returned: 0 in 0.528s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:23 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8fa86989-8319-4eed-9a9b-c22c5bcdc3c9 tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-294647f2-9ee6-472c-9099-51555492638a.4ad4fdde-7967-466b-897f-7b2df87b2f5a {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:23 devstack sudo[100766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-294647f2-9ee6-472c-9099-51555492638a.4ad4fdde-7967-466b-897f-7b2df87b2f5a Jul 30 16:59:23 devstack sudo[100766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:23 devstack sudo[100761]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:23 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-5bcfafdb-1310-456c-af43-605b7cb738f8 tempest-ProjectReaderTests-284310754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7a71164b-2c46-44d6-af12-4a4cb1016601" returned: 0 in 0.322s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:23 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-5bcfafdb-1310-456c-af43-605b7cb738f8 tempest-ProjectReaderTests-284310754 None] Lock "cinder-quobyte-7a71164b-2c46-44d6-af12-4a4cb1016601" released by "delete_volume" :: held 1.020s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:59:23 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-5bcfafdb-1310-456c-af43-605b7cb738f8 tempest-ProjectReaderTests-284310754 None] Created reservations ['654ce9e9-2467-4699-801c-b6554ebb0aad', '13f89c39-c22b-4803-96a8-29c2a91bbe79', '9d9dbe90-d11a-4952-94f0-db23a79a4fd4', '7c3a546b-ea2b-413e-83ea-46a331e9fea5'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:59:23 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-5bcfafdb-1310-456c-af43-605b7cb738f8 tempest-ProjectReaderTests-284310754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:59:23 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-5bcfafdb-1310-456c-af43-605b7cb738f8 tempest-ProjectReaderTests-284310754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:59:23 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-5bcfafdb-1310-456c-af43-605b7cb738f8 tempest-ProjectReaderTests-284310754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:59:23 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-5bcfafdb-1310-456c-af43-605b7cb738f8 tempest-ProjectReaderTests-284310754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:59:23 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-5bcfafdb-1310-456c-af43-605b7cb738f8 tempest-ProjectReaderTests-284310754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:59:23 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-5bcfafdb-1310-456c-af43-605b7cb738f8 tempest-ProjectReaderTests-284310754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:23 devstack sudo[100791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:59:23 devstack sudo[100791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:23 devstack sudo[100766]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:23 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8fa86989-8319-4eed-9a9b-c22c5bcdc3c9 tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-294647f2-9ee6-472c-9099-51555492638a.4ad4fdde-7967-466b-897f-7b2df87b2f5a" returned: 0 in 0.603s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:23 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8fa86989-8319-4eed-9a9b-c22c5bcdc3c9 tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-294647f2-9ee6-472c-9099-51555492638a.4ad4fdde-7967-466b-897f-7b2df87b2f5a {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:23 devstack sudo[100794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-294647f2-9ee6-472c-9099-51555492638a.4ad4fdde-7967-466b-897f-7b2df87b2f5a Jul 30 16:59:23 devstack sudo[100794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:24 devstack sudo[100791]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-5bcfafdb-1310-456c-af43-605b7cb738f8 tempest-ProjectReaderTests-284310754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.365s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:24 devstack sudo[100794]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:24 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-5bcfafdb-1310-456c-af43-605b7cb738f8 tempest-ProjectReaderTests-284310754 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:59:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8fa86989-8319-4eed-9a9b-c22c5bcdc3c9 tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-294647f2-9ee6-472c-9099-51555492638a.4ad4fdde-7967-466b-897f-7b2df87b2f5a" returned: 0 in 0.301s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:24 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-5bcfafdb-1310-456c-af43-605b7cb738f8 tempest-ProjectReaderTests-284310754 None] Deleted volume successfully. Jul 30 16:59:24 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-8fa86989-8319-4eed-9a9b-c22c5bcdc3c9 tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] Lock "cinder-quobyte-4ad4fdde-7967-466b-897f-7b2df87b2f5a" released by "_delete_snapshot" :: held 2.293s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:59:24 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-5bcfafdb-1310-456c-af43-605b7cb738f8 tempest-ProjectReaderTests-284310754 None] Lock "cinder-7a71164b-2c46-44d6-af12-4a4cb1016601-delete_volume" released by "delete_volume" :: held 1.889s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:59:24 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-8fa86989-8319-4eed-9a9b-c22c5bcdc3c9 tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] Lock "cinder-quobyte-294647f2-9ee6-472c-9099-51555492638a" released by "delete_snapshot" :: held 2.353s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:59:24 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-8fa86989-8319-4eed-9a9b-c22c5bcdc3c9 tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] Created reservations ['77f439e2-cb2f-447e-aca4-ddbecf72987a', '741b081b-f978-4fbd-aefa-a292b7ddbd30', '83267241-9996-40a1-946e-022e19e7b23c', '3b40128f-9b69-4c5c-8009-16581e35f1d7'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:59:24 devstack cinder-volume[88568]: DEBUG dbcounter [-] [88568] Writing DB stats cinder:SELECT=164,cinder:UPDATE=175,cinder:DELETE=15,cinder:INSERT=49 {{(pid=88568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:59:24 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-8fa86989-8319-4eed-9a9b-c22c5bcdc3c9 tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] Delete snapshot completed successfully. Jul 30 16:59:24 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-8fa86989-8319-4eed-9a9b-c22c5bcdc3c9 tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] Lock "cinder-4ad4fdde-7967-466b-897f-7b2df87b2f5a-delete_snapshot" released by "delete_snapshot" :: held 2.600s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:59:25 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-70639e4f-4b64-4066-aa71-650823ef7cab tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] Acquiring lock "cinder-294647f2-9ee6-472c-9099-51555492638a-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:59:25 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-70639e4f-4b64-4066-aa71-650823ef7cab tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] Lock "cinder-294647f2-9ee6-472c-9099-51555492638a-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:59:25 devstack cinder-volume[88568]: DEBUG dbcounter [-] [88568] Writing DB stats cinder:SELECT=143,cinder:INSERT=53,cinder:UPDATE=196,cinder:DELETE=14 {{(pid=88568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:59:25 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-70639e4f-4b64-4066-aa71-650823ef7cab tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] Acquiring lock "cinder-quobyte-294647f2-9ee6-472c-9099-51555492638a" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:59:25 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-70639e4f-4b64-4066-aa71-650823ef7cab tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] Lock "cinder-quobyte-294647f2-9ee6-472c-9099-51555492638a" acquired by "delete_volume" :: waited 0.032s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:59:25 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb678e8d-fab9-449b-b3ed-2dc0d1003904]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:59:25 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-70639e4f-4b64-4066-aa71-650823ef7cab tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-294647f2-9ee6-472c-9099-51555492638a {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:25 devstack sudo[100801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-294647f2-9ee6-472c-9099-51555492638a Jul 30 16:59:25 devstack sudo[100801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:25 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-0937b3fd-f607-4071-ac08-cb3cdc1ea842 tempest-BackendsCapabilitiesAdminTestsJSON-1049971030 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6410598754883, 'free_capacity_gb': 1775.6410598754883, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88568) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 30 16:59:25 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-029db669-5c3f-4a82-a3a1-13a001dbf9bb tempest-BackendsCapabilitiesAdminTestsJSON-1049971030 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6410598754883, 'free_capacity_gb': 1775.6410598754883, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88568) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 30 16:59:25 devstack sudo[100801]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:25 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-70639e4f-4b64-4066-aa71-650823ef7cab tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-294647f2-9ee6-472c-9099-51555492638a" returned: 0 in 0.505s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:25 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-70639e4f-4b64-4066-aa71-650823ef7cab tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-294647f2-9ee6-472c-9099-51555492638a {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:25 devstack sudo[100806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-294647f2-9ee6-472c-9099-51555492638a Jul 30 16:59:25 devstack sudo[100806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:26 devstack sudo[100806]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-70639e4f-4b64-4066-aa71-650823ef7cab tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-294647f2-9ee6-472c-9099-51555492638a" returned: 0 in 0.326s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:26 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-70639e4f-4b64-4066-aa71-650823ef7cab tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] Lock "cinder-quobyte-294647f2-9ee6-472c-9099-51555492638a" released by "delete_volume" :: held 0.921s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:59:26 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-70639e4f-4b64-4066-aa71-650823ef7cab tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] Created reservations ['03cd3833-57f4-40da-8fc4-21df12d0d75f', '35875734-ae9a-4545-b8ea-711f640cbee9', 'b8a1e9d2-acc3-40e8-9877-e215eac84c60', '0964a103-d381-4ba5-aa84-143da3784502'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:59:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-70639e4f-4b64-4066-aa71-650823ef7cab tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:59:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-70639e4f-4b64-4066-aa71-650823ef7cab tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:59:26 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-70639e4f-4b64-4066-aa71-650823ef7cab tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:59:26 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-70639e4f-4b64-4066-aa71-650823ef7cab tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:59:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-70639e4f-4b64-4066-aa71-650823ef7cab tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:59:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-70639e4f-4b64-4066-aa71-650823ef7cab tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:26 devstack sudo[100809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:59:26 devstack sudo[100809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:26 devstack sudo[100809]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-70639e4f-4b64-4066-aa71-650823ef7cab tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.346s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:26 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-70639e4f-4b64-4066-aa71-650823ef7cab tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:59:26 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-70639e4f-4b64-4066-aa71-650823ef7cab tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] Deleted volume successfully. Jul 30 16:59:26 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-70639e4f-4b64-4066-aa71-650823ef7cab tempest-VolumesSnapshotNegativeTestJSON-1571399958 None] Lock "cinder-294647f2-9ee6-472c-9099-51555492638a-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:59:33 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-4496cac9-9e4a-4d6a-8e3a-a0e679afb1a3 tempest-GroupSnapshotsTest-1016258839 None] Group tempest-GroupSnapshotsTest-Group-858171610: creating Jul 30 16:59:33 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-4496cac9-9e4a-4d6a-8e3a-a0e679afb1a3 tempest-GroupSnapshotsTest-1016258839 None] Group tempest-GroupSnapshotsTest-Group-858171610: created successfully Jul 30 16:59:33 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-4496cac9-9e4a-4d6a-8e3a-a0e679afb1a3 tempest-GroupSnapshotsTest-1016258839 None] Create group completed successfully. Jul 30 16:59:35 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2d83a64-8a68-44ba-a297-1bbbf37a6866 tempest-GroupSnapshotsTest-1016258839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:59:35 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e2d83a64-8a68-44ba-a297-1bbbf37a6866 tempest-GroupSnapshotsTest-1016258839 None] Flow 'volume_create_manager' (fa710e41-5655-464b-8954-43dcc301e9f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:59:35 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e2d83a64-8a68-44ba-a297-1bbbf37a6866 tempest-GroupSnapshotsTest-1016258839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3caca6f-49a7-426a-b77f-a2db6caea898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:35 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e2d83a64-8a68-44ba-a297-1bbbf37a6866 tempest-GroupSnapshotsTest-1016258839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3caca6f-49a7-426a-b77f-a2db6caea898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:59:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1423450913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=49d8f4aa-823e-4657-847c-cd0cf92074b5,host='devstack@QuobyteHD#QuobyteHD',id=d4df3c89-9740-43d2-8b29-74f412d3524b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b492a05000f4134822a5d9ffd72aa2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:59:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:59:36Z,use_quota=True,user_id='6c9b5dc45fb14a9c8a7df96de3b9b516',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e2f750a2-25f2-4afb-ba6a-39857e1515dc),volume_type_id=e2f750a2-25f2-4afb-ba6a-39857e1515dc)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:35 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e2d83a64-8a68-44ba-a297-1bbbf37a6866 tempest-GroupSnapshotsTest-1016258839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4dd75bc-7222-460a-af22-39bfccc0acec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:35 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e2d83a64-8a68-44ba-a297-1bbbf37a6866 tempest-GroupSnapshotsTest-1016258839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4dd75bc-7222-460a-af22-39bfccc0acec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:35 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e2d83a64-8a68-44ba-a297-1bbbf37a6866 tempest-GroupSnapshotsTest-1016258839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c786cb85-fdcc-42ce-864a-71f65640e141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:35 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e2d83a64-8a68-44ba-a297-1bbbf37a6866 tempest-GroupSnapshotsTest-1016258839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c786cb85-fdcc-42ce-864a-71f65640e141) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4df3c89-9740-43d2-8b29-74f412d3524b', 'volume_name': 'volume-d4df3c89-9740-43d2-8b29-74f412d3524b', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:35 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e2d83a64-8a68-44ba-a297-1bbbf37a6866 tempest-GroupSnapshotsTest-1016258839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9382f2c3-efe4-46bd-9808-d1981409e2c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:35 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e2d83a64-8a68-44ba-a297-1bbbf37a6866 tempest-GroupSnapshotsTest-1016258839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9382f2c3-efe4-46bd-9808-d1981409e2c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:35 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e2d83a64-8a68-44ba-a297-1bbbf37a6866 tempest-GroupSnapshotsTest-1016258839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45a7de07-3618-49c9-984d-778cc80bcca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:36 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-e2d83a64-8a68-44ba-a297-1bbbf37a6866 tempest-GroupSnapshotsTest-1016258839 None] Volume d4df3c89-9740-43d2-8b29-74f412d3524b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4df3c89-9740-43d2-8b29-74f412d3524b', 'volume_size': 1} Jul 30 16:59:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-e2d83a64-8a68-44ba-a297-1bbbf37a6866 tempest-GroupSnapshotsTest-1016258839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:59:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-e2d83a64-8a68-44ba-a297-1bbbf37a6866 tempest-GroupSnapshotsTest-1016258839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:59:36 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-e2d83a64-8a68-44ba-a297-1bbbf37a6866 tempest-GroupSnapshotsTest-1016258839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=49d8f4aa-823e-4657-847c-cd0cf92074b5,created_at=2026-07-30T14:59:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1423450913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=49d8f4aa-823e-4657-847c-cd0cf92074b5,host='devstack@QuobyteHD#QuobyteHD',id=d4df3c89-9740-43d2-8b29-74f412d3524b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b492a05000f4134822a5d9ffd72aa2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:59:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:59:36Z,use_quota=True,user_id='6c9b5dc45fb14a9c8a7df96de3b9b516',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e2f750a2-25f2-4afb-ba6a-39857e1515dc),volume_type_id=e2f750a2-25f2-4afb-ba6a-39857e1515dc)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:59:36 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-e2d83a64-8a68-44ba-a297-1bbbf37a6866 tempest-GroupSnapshotsTest-1016258839 None] Creating volume d4df3c89-9740-43d2-8b29-74f412d3524b {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:59:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-e2d83a64-8a68-44ba-a297-1bbbf37a6866 tempest-GroupSnapshotsTest-1016258839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:59:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-e2d83a64-8a68-44ba-a297-1bbbf37a6866 tempest-GroupSnapshotsTest-1016258839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:59:36 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-e2d83a64-8a68-44ba-a297-1bbbf37a6866 tempest-GroupSnapshotsTest-1016258839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:59:36 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-e2d83a64-8a68-44ba-a297-1bbbf37a6866 tempest-GroupSnapshotsTest-1016258839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:59:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-e2d83a64-8a68-44ba-a297-1bbbf37a6866 tempest-GroupSnapshotsTest-1016258839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:59:36 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-e2d83a64-8a68-44ba-a297-1bbbf37a6866 tempest-GroupSnapshotsTest-1016258839 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:59:36 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-e2d83a64-8a68-44ba-a297-1bbbf37a6866 tempest-GroupSnapshotsTest-1016258839 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 16:59:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e2d83a64-8a68-44ba-a297-1bbbf37a6866 tempest-GroupSnapshotsTest-1016258839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4df3c89-9740-43d2-8b29-74f412d3524b 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:36 devstack sudo[100950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4df3c89-9740-43d2-8b29-74f412d3524b 1073741824 Jul 30 16:59:36 devstack sudo[100950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:36 devstack sudo[100950]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e2d83a64-8a68-44ba-a297-1bbbf37a6866 tempest-GroupSnapshotsTest-1016258839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4df3c89-9740-43d2-8b29-74f412d3524b 1073741824" returned: 0 in 0.593s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e2d83a64-8a68-44ba-a297-1bbbf37a6866 tempest-GroupSnapshotsTest-1016258839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4df3c89-9740-43d2-8b29-74f412d3524b {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:36 devstack sudo[100956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4df3c89-9740-43d2-8b29-74f412d3524b Jul 30 16:59:36 devstack sudo[100956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:37 devstack sudo[100956]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:37 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e2d83a64-8a68-44ba-a297-1bbbf37a6866 tempest-GroupSnapshotsTest-1016258839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4df3c89-9740-43d2-8b29-74f412d3524b" returned: 0 in 0.468s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:37 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-e2d83a64-8a68-44ba-a297-1bbbf37a6866 tempest-GroupSnapshotsTest-1016258839 None] <== create_volume: return (1128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:59:37 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-e2d83a64-8a68-44ba-a297-1bbbf37a6866 tempest-GroupSnapshotsTest-1016258839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:59:37 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e2d83a64-8a68-44ba-a297-1bbbf37a6866 tempest-GroupSnapshotsTest-1016258839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45a7de07-3618-49c9-984d-778cc80bcca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4df3c89-9740-43d2-8b29-74f412d3524b', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:37 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e2d83a64-8a68-44ba-a297-1bbbf37a6866 tempest-GroupSnapshotsTest-1016258839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33b5b681-d52d-4d6a-a590-217b0dd64ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:37 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-e2d83a64-8a68-44ba-a297-1bbbf37a6866 tempest-GroupSnapshotsTest-1016258839 None] Volume volume-d4df3c89-9740-43d2-8b29-74f412d3524b (d4df3c89-9740-43d2-8b29-74f412d3524b): created successfully Jul 30 16:59:37 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e2d83a64-8a68-44ba-a297-1bbbf37a6866 tempest-GroupSnapshotsTest-1016258839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33b5b681-d52d-4d6a-a590-217b0dd64ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:37 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e2d83a64-8a68-44ba-a297-1bbbf37a6866 tempest-GroupSnapshotsTest-1016258839 None] Flow 'volume_create_manager' (fa710e41-5655-464b-8954-43dcc301e9f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:59:37 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-e2d83a64-8a68-44ba-a297-1bbbf37a6866 tempest-GroupSnapshotsTest-1016258839 None] Created volume successfully. Jul 30 16:59:38 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-40700b43-c959-454a-988b-1a70321a44b1 tempest-VolumesActionsTest-1414446346 None] Acquiring lock "cinder-3c1f1086-1cea-4539-b6ee-f2e715ba6810" by "attach_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:59:38 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-40700b43-c959-454a-988b-1a70321a44b1 tempest-VolumesActionsTest-1414446346 None] Lock "cinder-3c1f1086-1cea-4539-b6ee-f2e715ba6810" acquired by "attach_volume" :: waited 0.029s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:59:38 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-40700b43-c959-454a-988b-1a70321a44b1 tempest-VolumesActionsTest-1414446346 None] Attaching volume 3c1f1086-1cea-4539-b6ee-f2e715ba6810 to instance 504dd1c3-8198-4fdb-90cf-9ba99833ffc9 at mountpoint /dev/vdb on host None. Jul 30 16:59:38 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-40700b43-c959-454a-988b-1a70321a44b1 tempest-VolumesActionsTest-1414446346 None] Attach volume completed successfully. Jul 30 16:59:38 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-40700b43-c959-454a-988b-1a70321a44b1 tempest-VolumesActionsTest-1414446346 None] Lock "cinder-3c1f1086-1cea-4539-b6ee-f2e715ba6810" released by "attach_volume" :: held 0.126s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:59:38 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-9277a67a-719f-4657-a847-71d6ba08f63c tempest-VolumesActionsTest-1414446346 None] Acquiring lock "cinder-3c1f1086-1cea-4539-b6ee-f2e715ba6810-detach_volume" by "detach_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:59:38 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-9277a67a-719f-4657-a847-71d6ba08f63c tempest-VolumesActionsTest-1414446346 None] Lock "cinder-3c1f1086-1cea-4539-b6ee-f2e715ba6810-detach_volume" acquired by "detach_volume" :: waited 0.033s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:59:38 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-9277a67a-719f-4657-a847-71d6ba08f63c tempest-VolumesActionsTest-1414446346 None] Detaching volume 3c1f1086-1cea-4539-b6ee-f2e715ba6810 from instance 504dd1c3-8198-4fdb-90cf-9ba99833ffc9. Jul 30 16:59:38 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-9277a67a-719f-4657-a847-71d6ba08f63c tempest-VolumesActionsTest-1414446346 None] Detach volume completed successfully. Jul 30 16:59:38 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-9277a67a-719f-4657-a847-71d6ba08f63c tempest-VolumesActionsTest-1414446346 None] Lock "cinder-3c1f1086-1cea-4539-b6ee-f2e715ba6810-detach_volume" released by "detach_volume" :: held 0.123s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:59:38 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-74224e6e-f902-442d-a00f-e80a7bf4d011 tempest-GroupSnapshotsTest-1016258839 None] GroupSnapshot 00b22ba3-5b30-42e1-bd6a-0db5c5fa2bed: creating. Jul 30 16:59:38 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-74224e6e-f902-442d-a00f-e80a7bf4d011 tempest-GroupSnapshotsTest-1016258839 None] Group snapshot 00b22ba3-5b30-42e1-bd6a-0db5c5fa2bed: creating. {{(pid=88568) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 30 16:59:38 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-74224e6e-f902-442d-a00f-e80a7bf4d011 tempest-GroupSnapshotsTest-1016258839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:59:38 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-74224e6e-f902-442d-a00f-e80a7bf4d011 tempest-GroupSnapshotsTest-1016258839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:59:39 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-74224e6e-f902-442d-a00f-e80a7bf4d011 tempest-GroupSnapshotsTest-1016258839 None] Creating offline snapshot 80b3d91c-52e0-434e-a23a-d476875188bb of volume d4df3c89-9740-43d2-8b29-74f412d3524b {{(pid=88568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:59:39 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b3c768-7178-4e0b-bafd-d025b41c916b]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:59:39 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-74224e6e-f902-442d-a00f-e80a7bf4d011 tempest-GroupSnapshotsTest-1016258839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4df3c89-9740-43d2-8b29-74f412d3524b {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:39 devstack sudo[100961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4df3c89-9740-43d2-8b29-74f412d3524b Jul 30 16:59:39 devstack sudo[100961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:39 devstack sudo[100961]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:39 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-74224e6e-f902-442d-a00f-e80a7bf4d011 tempest-GroupSnapshotsTest-1016258839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4df3c89-9740-43d2-8b29-74f412d3524b" returned: 0 in 0.517s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:39 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-74224e6e-f902-442d-a00f-e80a7bf4d011 tempest-GroupSnapshotsTest-1016258839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4df3c89-9740-43d2-8b29-74f412d3524b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4df3c89-9740-43d2-8b29-74f412d3524b.80b3d91c-52e0-434e-a23a-d476875188bb 1G {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:39 devstack sudo[100974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4df3c89-9740-43d2-8b29-74f412d3524b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4df3c89-9740-43d2-8b29-74f412d3524b.80b3d91c-52e0-434e-a23a-d476875188bb 1G Jul 30 16:59:39 devstack sudo[100974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:40 devstack sudo[100974]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:40 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-74224e6e-f902-442d-a00f-e80a7bf4d011 tempest-GroupSnapshotsTest-1016258839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4df3c89-9740-43d2-8b29-74f412d3524b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4df3c89-9740-43d2-8b29-74f412d3524b.80b3d91c-52e0-434e-a23a-d476875188bb 1G" returned: 0 in 0.614s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:40 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-74224e6e-f902-442d-a00f-e80a7bf4d011 tempest-GroupSnapshotsTest-1016258839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4df3c89-9740-43d2-8b29-74f412d3524b -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4df3c89-9740-43d2-8b29-74f412d3524b.80b3d91c-52e0-434e-a23a-d476875188bb {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:40 devstack sudo[100995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4df3c89-9740-43d2-8b29-74f412d3524b -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4df3c89-9740-43d2-8b29-74f412d3524b.80b3d91c-52e0-434e-a23a-d476875188bb Jul 30 16:59:40 devstack sudo[100995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:40 devstack sudo[100995]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:40 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-74224e6e-f902-442d-a00f-e80a7bf4d011 tempest-GroupSnapshotsTest-1016258839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4df3c89-9740-43d2-8b29-74f412d3524b -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4df3c89-9740-43d2-8b29-74f412d3524b.80b3d91c-52e0-434e-a23a-d476875188bb" returned: 0 in 0.411s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:40 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-74224e6e-f902-442d-a00f-e80a7bf4d011 tempest-GroupSnapshotsTest-1016258839 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4df3c89-9740-43d2-8b29-74f412d3524b.80b3d91c-52e0-434e-a23a-d476875188bb is being set with open permissions: ugo+rw: NotImplementedError Jul 30 16:59:40 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-74224e6e-f902-442d-a00f-e80a7bf4d011 tempest-GroupSnapshotsTest-1016258839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4df3c89-9740-43d2-8b29-74f412d3524b.80b3d91c-52e0-434e-a23a-d476875188bb {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:40 devstack sudo[101002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4df3c89-9740-43d2-8b29-74f412d3524b.80b3d91c-52e0-434e-a23a-d476875188bb Jul 30 16:59:40 devstack sudo[101002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:41 devstack sudo[101002]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:41 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-74224e6e-f902-442d-a00f-e80a7bf4d011 tempest-GroupSnapshotsTest-1016258839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4df3c89-9740-43d2-8b29-74f412d3524b.80b3d91c-52e0-434e-a23a-d476875188bb" returned: 0 in 0.422s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:41 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-74224e6e-f902-442d-a00f-e80a7bf4d011 tempest-GroupSnapshotsTest-1016258839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4df3c89-9740-43d2-8b29-74f412d3524b.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:41 devstack sudo[101006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4df3c89-9740-43d2-8b29-74f412d3524b.info Jul 30 16:59:41 devstack sudo[101006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:41 devstack sudo[101006]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:41 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-74224e6e-f902-442d-a00f-e80a7bf4d011 tempest-GroupSnapshotsTest-1016258839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4df3c89-9740-43d2-8b29-74f412d3524b.info" returned: 0 in 0.311s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:41 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-74224e6e-f902-442d-a00f-e80a7bf4d011 tempest-GroupSnapshotsTest-1016258839 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4df3c89-9740-43d2-8b29-74f412d3524b.info is being set with open permissions: ugo+rw: NotImplementedError Jul 30 16:59:41 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-74224e6e-f902-442d-a00f-e80a7bf4d011 tempest-GroupSnapshotsTest-1016258839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4df3c89-9740-43d2-8b29-74f412d3524b.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:41 devstack sudo[101009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4df3c89-9740-43d2-8b29-74f412d3524b.info Jul 30 16:59:41 devstack sudo[101009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:41 devstack sudo[101009]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:41 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-74224e6e-f902-442d-a00f-e80a7bf4d011 tempest-GroupSnapshotsTest-1016258839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4df3c89-9740-43d2-8b29-74f412d3524b.info" returned: 0 in 0.356s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:41 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-74224e6e-f902-442d-a00f-e80a7bf4d011 tempest-GroupSnapshotsTest-1016258839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.899s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:59:41 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-74224e6e-f902-442d-a00f-e80a7bf4d011 tempest-GroupSnapshotsTest-1016258839 None] group_snapshot 00b22ba3-5b30-42e1-bd6a-0db5c5fa2bed: created successfully Jul 30 16:59:43 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a821b20a-8748-459e-9ca5-bd0f4d5bc3a9 tempest-GroupSnapshotsTest-1016258839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:59:43 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a821b20a-8748-459e-9ca5-bd0f4d5bc3a9 tempest-GroupSnapshotsTest-1016258839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:59:43 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-a821b20a-8748-459e-9ca5-bd0f4d5bc3a9 tempest-GroupSnapshotsTest-1016258839 None] Acquiring lock "cinder-quobyte-80b3d91c-52e0-434e-a23a-d476875188bb-d53d8501-8e78-4667-ab72-21fc2cdbd42d" by "_create_volume_from_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:59:43 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-a821b20a-8748-459e-9ca5-bd0f4d5bc3a9 tempest-GroupSnapshotsTest-1016258839 None] Lock "cinder-quobyte-80b3d91c-52e0-434e-a23a-d476875188bb-d53d8501-8e78-4667-ab72-21fc2cdbd42d" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:59:43 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-a821b20a-8748-459e-9ca5-bd0f4d5bc3a9 tempest-GroupSnapshotsTest-1016258839 None] Creating volume d53d8501-8e78-4667-ab72-21fc2cdbd42d from snapshot 80b3d91c-52e0-434e-a23a-d476875188bb {{(pid=88568) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 30 16:59:43 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a821b20a-8748-459e-9ca5-bd0f4d5bc3a9 tempest-GroupSnapshotsTest-1016258839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:59:43 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a821b20a-8748-459e-9ca5-bd0f4d5bc3a9 tempest-GroupSnapshotsTest-1016258839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:59:43 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-a821b20a-8748-459e-9ca5-bd0f4d5bc3a9 tempest-GroupSnapshotsTest-1016258839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:59:43 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-a821b20a-8748-459e-9ca5-bd0f4d5bc3a9 tempest-GroupSnapshotsTest-1016258839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:59:43 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a821b20a-8748-459e-9ca5-bd0f4d5bc3a9 tempest-GroupSnapshotsTest-1016258839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:59:43 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-a821b20a-8748-459e-9ca5-bd0f4d5bc3a9 tempest-GroupSnapshotsTest-1016258839 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:59:43 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-a821b20a-8748-459e-9ca5-bd0f4d5bc3a9 tempest-GroupSnapshotsTest-1016258839 None] Acquiring lock "cinder-quobyte-d53d8501-8e78-4667-ab72-21fc2cdbd42d" by "_copy_volume_from_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:59:43 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-a821b20a-8748-459e-9ca5-bd0f4d5bc3a9 tempest-GroupSnapshotsTest-1016258839 None] Lock "cinder-quobyte-d53d8501-8e78-4667-ab72-21fc2cdbd42d" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:59:43 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-a821b20a-8748-459e-9ca5-bd0f4d5bc3a9 tempest-GroupSnapshotsTest-1016258839 None] snapshot: 80b3d91c-52e0-434e-a23a-d476875188bb, volume: d53d8501-8e78-4667-ab72-21fc2cdbd42d, {{(pid=88568) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 30 16:59:43 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a821b20a-8748-459e-9ca5-bd0f4d5bc3a9 tempest-GroupSnapshotsTest-1016258839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:59:43 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a821b20a-8748-459e-9ca5-bd0f4d5bc3a9 tempest-GroupSnapshotsTest-1016258839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:59:43 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-a821b20a-8748-459e-9ca5-bd0f4d5bc3a9 tempest-GroupSnapshotsTest-1016258839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:59:43 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-a821b20a-8748-459e-9ca5-bd0f4d5bc3a9 tempest-GroupSnapshotsTest-1016258839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:59:43 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a821b20a-8748-459e-9ca5-bd0f4d5bc3a9 tempest-GroupSnapshotsTest-1016258839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:59:43 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[e810f139-a09b-408c-a230-d3352e0c468a]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:59:43 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a821b20a-8748-459e-9ca5-bd0f4d5bc3a9 tempest-GroupSnapshotsTest-1016258839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4df3c89-9740-43d2-8b29-74f412d3524b.80b3d91c-52e0-434e-a23a-d476875188bb {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:43 devstack sudo[101013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4df3c89-9740-43d2-8b29-74f412d3524b.80b3d91c-52e0-434e-a23a-d476875188bb Jul 30 16:59:43 devstack sudo[101013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:43 devstack sudo[101013]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:43 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a821b20a-8748-459e-9ca5-bd0f4d5bc3a9 tempest-GroupSnapshotsTest-1016258839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4df3c89-9740-43d2-8b29-74f412d3524b.80b3d91c-52e0-434e-a23a-d476875188bb" returned: 0 in 0.499s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:43 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-a821b20a-8748-459e-9ca5-bd0f4d5bc3a9 tempest-GroupSnapshotsTest-1016258839 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4df3c89-9740-43d2-8b29-74f412d3524b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:59:43 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[31105016-c568-4f5b-aaa4-05f3f4b4468d]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:59:43 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a821b20a-8748-459e-9ca5-bd0f4d5bc3a9 tempest-GroupSnapshotsTest-1016258839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4df3c89-9740-43d2-8b29-74f412d3524b {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:43 devstack sudo[101018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4df3c89-9740-43d2-8b29-74f412d3524b Jul 30 16:59:43 devstack sudo[101018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:44 devstack sudo[101018]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:44 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a821b20a-8748-459e-9ca5-bd0f4d5bc3a9 tempest-GroupSnapshotsTest-1016258839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4df3c89-9740-43d2-8b29-74f412d3524b" returned: 0 in 0.413s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:44 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-a821b20a-8748-459e-9ca5-bd0f4d5bc3a9 tempest-GroupSnapshotsTest-1016258839 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4df3c89-9740-43d2-8b29-74f412d3524b {{(pid=88568) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 30 16:59:44 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-a821b20a-8748-459e-9ca5-bd0f4d5bc3a9 tempest-GroupSnapshotsTest-1016258839 None] Creating direct copy from snapshot {{(pid=88568) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 30 16:59:44 devstack cinder-volume[88568]: DEBUG cinder.utils [None req-a821b20a-8748-459e-9ca5-bd0f4d5bc3a9 tempest-GroupSnapshotsTest-1016258839 None] Path /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d53d8501-8e78-4667-ab72-21fc2cdbd42d not found in is_blk_device check {{(pid=88568) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 30 16:59:44 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a821b20a-8748-459e-9ca5-bd0f4d5bc3a9 tempest-GroupSnapshotsTest-1016258839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4df3c89-9740-43d2-8b29-74f412d3524b /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d53d8501-8e78-4667-ab72-21fc2cdbd42d {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:44 devstack sudo[101023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4df3c89-9740-43d2-8b29-74f412d3524b /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d53d8501-8e78-4667-ab72-21fc2cdbd42d Jul 30 16:59:44 devstack sudo[101023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:44 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-8cc461fb-e983-44e0-97d6-89dbcad061a1 tempest-VolumesActionsTest-1414446346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:59:49 devstack sudo[101023]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:49 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a821b20a-8748-459e-9ca5-bd0f4d5bc3a9 tempest-GroupSnapshotsTest-1016258839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4df3c89-9740-43d2-8b29-74f412d3524b /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d53d8501-8e78-4667-ab72-21fc2cdbd42d" returned: 0 in 5.327s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:49 devstack cinder-volume[88568]: DEBUG cinder.image.image_utils [None req-a821b20a-8748-459e-9ca5-bd0f4d5bc3a9 tempest-GroupSnapshotsTest-1016258839 None] Image conversion details: src /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4df3c89-9740-43d2-8b29-74f412d3524b, size 1024.00 MB, duration 5.33 sec, destination /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d53d8501-8e78-4667-ab72-21fc2cdbd42d {{(pid=88568) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 16:59:49 devstack cinder-volume[88568]: INFO cinder.image.image_utils [None req-a821b20a-8748-459e-9ca5-bd0f4d5bc3a9 tempest-GroupSnapshotsTest-1016258839 None] Converted 1024.00 MB image at 192.18 MB/s Jul 30 16:59:49 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-a821b20a-8748-459e-9ca5-bd0f4d5bc3a9 tempest-GroupSnapshotsTest-1016258839 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d53d8501-8e78-4667-ab72-21fc2cdbd42d is being set with open permissions: ugo+rw: NotImplementedError Jul 30 16:59:49 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a821b20a-8748-459e-9ca5-bd0f4d5bc3a9 tempest-GroupSnapshotsTest-1016258839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d53d8501-8e78-4667-ab72-21fc2cdbd42d {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:49 devstack sudo[101043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d53d8501-8e78-4667-ab72-21fc2cdbd42d Jul 30 16:59:49 devstack sudo[101043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:49 devstack sudo[101043]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:49 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a821b20a-8748-459e-9ca5-bd0f4d5bc3a9 tempest-GroupSnapshotsTest-1016258839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d53d8501-8e78-4667-ab72-21fc2cdbd42d" returned: 0 in 0.255s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:49 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-a821b20a-8748-459e-9ca5-bd0f4d5bc3a9 tempest-GroupSnapshotsTest-1016258839 None] Lock "cinder-quobyte-d53d8501-8e78-4667-ab72-21fc2cdbd42d" released by "_copy_volume_from_snapshot" :: held 6.617s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:59:49 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-a821b20a-8748-459e-9ca5-bd0f4d5bc3a9 tempest-GroupSnapshotsTest-1016258839 None] Lock "cinder-quobyte-80b3d91c-52e0-434e-a23a-d476875188bb-d53d8501-8e78-4667-ab72-21fc2cdbd42d" released by "_create_volume_from_snapshot" :: held 6.710s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:59:49 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a821b20a-8748-459e-9ca5-bd0f4d5bc3a9 tempest-GroupSnapshotsTest-1016258839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.736s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:59:49 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-8cc461fb-e983-44e0-97d6-89dbcad061a1 tempest-VolumesActionsTest-1414446346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 5.593s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:59:49 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ab67e4-26db-4d68-a4f7-92c39b8457ce]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:59:49 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8cc461fb-e983-44e0-97d6-89dbcad061a1 tempest-VolumesActionsTest-1414446346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-3c1f1086-1cea-4539-b6ee-f2e715ba6810 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:49 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-a821b20a-8748-459e-9ca5-bd0f4d5bc3a9 tempest-GroupSnapshotsTest-1016258839 None] Create group from source-snapshot-00b22ba3-5b30-42e1-bd6a-0db5c5fa2bed completed successfully. Jul 30 16:59:49 devstack sudo[101046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-3c1f1086-1cea-4539-b6ee-f2e715ba6810 Jul 30 16:59:49 devstack sudo[101046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:50 devstack sudo[101046]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8cc461fb-e983-44e0-97d6-89dbcad061a1 tempest-VolumesActionsTest-1414446346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-3c1f1086-1cea-4539-b6ee-f2e715ba6810" returned: 0 in 0.438s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:50 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa5e433-2144-4304-bf85-32a88c0e3675]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:59:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8cc461fb-e983-44e0-97d6-89dbcad061a1 tempest-VolumesActionsTest-1414446346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-3c1f1086-1cea-4539-b6ee-f2e715ba6810 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:50 devstack sudo[101052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-3c1f1086-1cea-4539-b6ee-f2e715ba6810 Jul 30 16:59:50 devstack sudo[101052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:50 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-acc5db39-086b-4756-b86d-88f9fad1325c tempest-GroupSnapshotsTest-1016258839 None] Acquiring lock "cinder-quobyte-d53d8501-8e78-4667-ab72-21fc2cdbd42d" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:59:50 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-acc5db39-086b-4756-b86d-88f9fad1325c tempest-GroupSnapshotsTest-1016258839 None] Lock "cinder-quobyte-d53d8501-8e78-4667-ab72-21fc2cdbd42d" acquired by "delete_volume" :: waited 0.030s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:59:50 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f39c6a6-8375-465a-ac2e-71a32b21c20c]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:59:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-acc5db39-086b-4756-b86d-88f9fad1325c tempest-GroupSnapshotsTest-1016258839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d53d8501-8e78-4667-ab72-21fc2cdbd42d {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:50 devstack sudo[101052]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8cc461fb-e983-44e0-97d6-89dbcad061a1 tempest-VolumesActionsTest-1414446346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-3c1f1086-1cea-4539-b6ee-f2e715ba6810" returned: 0 in 0.480s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8cc461fb-e983-44e0-97d6-89dbcad061a1 tempest-VolumesActionsTest-1414446346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-3c1f1086-1cea-4539-b6ee-f2e715ba6810 /opt/stack/data/cinder/conversion/3c1f1086-1cea-4539-b6ee-f2e715ba6810.temp_image.13aa8ee7-03ec-4627-9e9b-a233e357947cgd1pr63j.img {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:50 devstack sudo[101059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-3c1f1086-1cea-4539-b6ee-f2e715ba6810 /opt/stack/data/cinder/conversion/3c1f1086-1cea-4539-b6ee-f2e715ba6810.temp_image.13aa8ee7-03ec-4627-9e9b-a233e357947cgd1pr63j.img Jul 30 16:59:50 devstack sudo[101059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:50 devstack sudo[101058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d53d8501-8e78-4667-ab72-21fc2cdbd42d Jul 30 16:59:50 devstack sudo[101058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:51 devstack sudo[101058]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-acc5db39-086b-4756-b86d-88f9fad1325c tempest-GroupSnapshotsTest-1016258839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d53d8501-8e78-4667-ab72-21fc2cdbd42d" returned: 0 in 0.545s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-acc5db39-086b-4756-b86d-88f9fad1325c tempest-GroupSnapshotsTest-1016258839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d53d8501-8e78-4667-ab72-21fc2cdbd42d {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:51 devstack sudo[101075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d53d8501-8e78-4667-ab72-21fc2cdbd42d Jul 30 16:59:51 devstack sudo[101075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:52 devstack sudo[101075]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-acc5db39-086b-4756-b86d-88f9fad1325c tempest-GroupSnapshotsTest-1016258839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d53d8501-8e78-4667-ab72-21fc2cdbd42d" returned: 0 in 0.913s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:52 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-acc5db39-086b-4756-b86d-88f9fad1325c tempest-GroupSnapshotsTest-1016258839 None] Lock "cinder-quobyte-d53d8501-8e78-4667-ab72-21fc2cdbd42d" released by "delete_volume" :: held 1.557s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:59:52 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-acc5db39-086b-4756-b86d-88f9fad1325c tempest-GroupSnapshotsTest-1016258839 None] Created reservations ['b43f92f9-a195-4bff-a123-eb3c78957aab'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:59:52 devstack cinder-volume[88568]: DEBUG oslo_service.periodic_task [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:59:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:59:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:59:52 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:59:52 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:59:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:59:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:52 devstack sudo[101078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:59:52 devstack sudo[101078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:52 devstack cinder-volume[88568]: WARNING cinder.quota [None req-acc5db39-086b-4756-b86d-88f9fad1325c tempest-GroupSnapshotsTest-1016258839 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-830877511 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-830877511, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:59:52 devstack cinder-volume[88568]: WARNING cinder.quota [None req-acc5db39-086b-4756-b86d-88f9fad1325c tempest-GroupSnapshotsTest-1016258839 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-830877511 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-830877511, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:59:52 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-acc5db39-086b-4756-b86d-88f9fad1325c tempest-GroupSnapshotsTest-1016258839 None] Created reservations ['c061c00a-2fb3-4b45-98df-1b6c6ed4de75', 'd8c16030-d772-4cb5-9dcf-36d3581e37b4', 'be7288b4-58c3-4cb7-a692-3b6d599cac68', 'a213822e-dc5e-4e12-814b-9ea31641888f'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:59:53 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-acc5db39-086b-4756-b86d-88f9fad1325c tempest-GroupSnapshotsTest-1016258839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:59:53 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-acc5db39-086b-4756-b86d-88f9fad1325c tempest-GroupSnapshotsTest-1016258839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:59:53 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-acc5db39-086b-4756-b86d-88f9fad1325c tempest-GroupSnapshotsTest-1016258839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:59:53 devstack sudo[101078]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:53 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-acc5db39-086b-4756-b86d-88f9fad1325c tempest-GroupSnapshotsTest-1016258839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:59:53 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-acc5db39-086b-4756-b86d-88f9fad1325c tempest-GroupSnapshotsTest-1016258839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:59:53 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-acc5db39-086b-4756-b86d-88f9fad1325c tempest-GroupSnapshotsTest-1016258839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:53 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.634s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:53 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:59:53 devstack cinder-volume[88568]: DEBUG oslo_service.periodic_task [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Running periodic task VolumeManager._thread_info {{(pid=88568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:59:53 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] thread count: 28 {{(pid=88568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:59:53 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] thread info: [<_MainThread(MainThread, started 127406866608256)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:59:53 devstack sudo[101081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:59:53 devstack sudo[101081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:53 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-30a24ab5-7de9-4d2f-a92c-ddd8f38466eb tempest-GroupSnapshotsTest-1016258839 None] group_snapshot 00b22ba3-5b30-42e1-bd6a-0db5c5fa2bed: deleting Jul 30 16:59:53 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-30a24ab5-7de9-4d2f-a92c-ddd8f38466eb tempest-GroupSnapshotsTest-1016258839 None] group_snapshot 00b22ba3-5b30-42e1-bd6a-0db5c5fa2bed: deleting {{(pid=88568) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 30 16:59:53 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-30a24ab5-7de9-4d2f-a92c-ddd8f38466eb tempest-GroupSnapshotsTest-1016258839 None] Acquiring lock "cinder-quobyte-d4df3c89-9740-43d2-8b29-74f412d3524b" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:59:53 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-30a24ab5-7de9-4d2f-a92c-ddd8f38466eb tempest-GroupSnapshotsTest-1016258839 None] Lock "cinder-quobyte-d4df3c89-9740-43d2-8b29-74f412d3524b" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:59:53 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-30a24ab5-7de9-4d2f-a92c-ddd8f38466eb tempest-GroupSnapshotsTest-1016258839 None] Acquiring lock "cinder-quobyte-80b3d91c-52e0-434e-a23a-d476875188bb" by "_delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:59:53 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-30a24ab5-7de9-4d2f-a92c-ddd8f38466eb tempest-GroupSnapshotsTest-1016258839 None] Lock "cinder-quobyte-80b3d91c-52e0-434e-a23a-d476875188bb" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:59:53 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-30a24ab5-7de9-4d2f-a92c-ddd8f38466eb tempest-GroupSnapshotsTest-1016258839 None] Deleting offline snapshot 80b3d91c-52e0-434e-a23a-d476875188bb of volume d4df3c89-9740-43d2-8b29-74f412d3524b {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:59:54 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-30a24ab5-7de9-4d2f-a92c-ddd8f38466eb tempest-GroupSnapshotsTest-1016258839 None] snapshot_file for this snap is: volume-d4df3c89-9740-43d2-8b29-74f412d3524b.80b3d91c-52e0-434e-a23a-d476875188bb {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:59:54 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa69bc55-1da5-4718-95b3-3e37b61475d7]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:59:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-30a24ab5-7de9-4d2f-a92c-ddd8f38466eb tempest-GroupSnapshotsTest-1016258839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4df3c89-9740-43d2-8b29-74f412d3524b.80b3d91c-52e0-434e-a23a-d476875188bb {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:54 devstack sudo[101081]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-acc5db39-086b-4756-b86d-88f9fad1325c tempest-GroupSnapshotsTest-1016258839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.980s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:54 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-acc5db39-086b-4756-b86d-88f9fad1325c tempest-GroupSnapshotsTest-1016258839 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:59:54 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-acc5db39-086b-4756-b86d-88f9fad1325c tempest-GroupSnapshotsTest-1016258839 None] Delete group completed successfully. Jul 30 16:59:54 devstack sudo[101084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4df3c89-9740-43d2-8b29-74f412d3524b.80b3d91c-52e0-434e-a23a-d476875188bb Jul 30 16:59:54 devstack sudo[101084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:55 devstack sudo[101084]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-30a24ab5-7de9-4d2f-a92c-ddd8f38466eb tempest-GroupSnapshotsTest-1016258839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4df3c89-9740-43d2-8b29-74f412d3524b.80b3d91c-52e0-434e-a23a-d476875188bb" returned: 0 in 0.969s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:55 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-30a24ab5-7de9-4d2f-a92c-ddd8f38466eb tempest-GroupSnapshotsTest-1016258839 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4df3c89-9740-43d2-8b29-74f412d3524b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:59:55 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[c07a16a1-a706-46b8-af87-6db90cc8ba13]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:59:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-30a24ab5-7de9-4d2f-a92c-ddd8f38466eb tempest-GroupSnapshotsTest-1016258839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4df3c89-9740-43d2-8b29-74f412d3524b {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:55 devstack sudo[101091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4df3c89-9740-43d2-8b29-74f412d3524b Jul 30 16:59:55 devstack sudo[101091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:56 devstack sudo[101091]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-30a24ab5-7de9-4d2f-a92c-ddd8f38466eb tempest-GroupSnapshotsTest-1016258839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4df3c89-9740-43d2-8b29-74f412d3524b" returned: 0 in 1.298s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-30a24ab5-7de9-4d2f-a92c-ddd8f38466eb tempest-GroupSnapshotsTest-1016258839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4df3c89-9740-43d2-8b29-74f412d3524b.80b3d91c-52e0-434e-a23a-d476875188bb {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:56 devstack sudo[101097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4df3c89-9740-43d2-8b29-74f412d3524b.80b3d91c-52e0-434e-a23a-d476875188bb Jul 30 16:59:56 devstack sudo[101097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:56 devstack sudo[101059]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8cc461fb-e983-44e0-97d6-89dbcad061a1 tempest-VolumesActionsTest-1414446346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-3c1f1086-1cea-4539-b6ee-f2e715ba6810 /opt/stack/data/cinder/conversion/3c1f1086-1cea-4539-b6ee-f2e715ba6810.temp_image.13aa8ee7-03ec-4627-9e9b-a233e357947cgd1pr63j.img" returned: 0 in 5.802s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:56 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[09be269e-81cb-43a6-8727-8391273356ab]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:59:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8cc461fb-e983-44e0-97d6-89dbcad061a1 tempest-VolumesActionsTest-1414446346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-3c1f1086-1cea-4539-b6ee-f2e715ba6810 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:56 devstack sudo[101100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-3c1f1086-1cea-4539-b6ee-f2e715ba6810 Jul 30 16:59:56 devstack sudo[101100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:56 devstack sudo[101097]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-30a24ab5-7de9-4d2f-a92c-ddd8f38466eb tempest-GroupSnapshotsTest-1016258839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4df3c89-9740-43d2-8b29-74f412d3524b.80b3d91c-52e0-434e-a23a-d476875188bb" returned: 0 in 0.415s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-30a24ab5-7de9-4d2f-a92c-ddd8f38466eb tempest-GroupSnapshotsTest-1016258839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4df3c89-9740-43d2-8b29-74f412d3524b.80b3d91c-52e0-434e-a23a-d476875188bb {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:56 devstack sudo[101105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4df3c89-9740-43d2-8b29-74f412d3524b.80b3d91c-52e0-434e-a23a-d476875188bb Jul 30 16:59:56 devstack sudo[101105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:57 devstack sudo[101105]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-30a24ab5-7de9-4d2f-a92c-ddd8f38466eb tempest-GroupSnapshotsTest-1016258839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4df3c89-9740-43d2-8b29-74f412d3524b.80b3d91c-52e0-434e-a23a-d476875188bb" returned: 0 in 0.327s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:57 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-30a24ab5-7de9-4d2f-a92c-ddd8f38466eb tempest-GroupSnapshotsTest-1016258839 None] Lock "cinder-quobyte-80b3d91c-52e0-434e-a23a-d476875188bb" released by "_delete_snapshot" :: held 3.247s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:59:57 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-30a24ab5-7de9-4d2f-a92c-ddd8f38466eb tempest-GroupSnapshotsTest-1016258839 None] Lock "cinder-quobyte-d4df3c89-9740-43d2-8b29-74f412d3524b" released by "delete_snapshot" :: held 3.289s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:59:57 devstack sudo[101100]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8cc461fb-e983-44e0-97d6-89dbcad061a1 tempest-VolumesActionsTest-1414446346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-3c1f1086-1cea-4539-b6ee-f2e715ba6810" returned: 0 in 0.638s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:57 devstack cinder-volume[88568]: DEBUG cinder.image.image_utils [None req-8cc461fb-e983-44e0-97d6-89dbcad061a1 tempest-VolumesActionsTest-1414446346 None] Image conversion details: src /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-3c1f1086-1cea-4539-b6ee-f2e715ba6810, size 1024.00 MB, duration 5.80 sec, destination /opt/stack/data/cinder/conversion/3c1f1086-1cea-4539-b6ee-f2e715ba6810.temp_image.13aa8ee7-03ec-4627-9e9b-a233e357947cgd1pr63j.img {{(pid=88568) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 16:59:57 devstack cinder-volume[88568]: INFO cinder.image.image_utils [None req-8cc461fb-e983-44e0-97d6-89dbcad061a1 tempest-VolumesActionsTest-1414446346 None] Converted 1024.00 MB image at 176.45 MB/s Jul 30 16:59:57 devstack cinder-volume[88568]: DEBUG cinder.image.image_utils [None req-8cc461fb-e983-44e0-97d6-89dbcad061a1 tempest-VolumesActionsTest-1414446346 None] 13aa8ee7-03ec-4627-9e9b-a233e357947c was raw, no need to convert to raw {{(pid=88568) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 30 16:59:57 devstack cinder-volume[88568]: WARNING cinder.quota [None req-30a24ab5-7de9-4d2f-a92c-ddd8f38466eb tempest-GroupSnapshotsTest-1016258839 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-830877511 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-830877511, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:59:57 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-30a24ab5-7de9-4d2f-a92c-ddd8f38466eb tempest-GroupSnapshotsTest-1016258839 None] Created reservations ['05a0d001-92c2-462f-8d01-148cbab4e893', '8dfbc40e-1896-4805-adcf-236aae90a0a2', 'ae220ebd-7fe3-4397-a4ef-8413739f0005', '29d91f66-3f39-48bd-87b6-3b282062ed3a'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:59:57 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-30a24ab5-7de9-4d2f-a92c-ddd8f38466eb tempest-GroupSnapshotsTest-1016258839 None] group_snapshot 00b22ba3-5b30-42e1-bd6a-0db5c5fa2bed: deleted successfully Jul 30 16:59:58 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-2e6081df-f2f8-4771-997b-5f85fafd8a1a tempest-GroupSnapshotsTest-1016258839 None] Acquiring lock "cinder-quobyte-d4df3c89-9740-43d2-8b29-74f412d3524b" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:59:58 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-2e6081df-f2f8-4771-997b-5f85fafd8a1a tempest-GroupSnapshotsTest-1016258839 None] Lock "cinder-quobyte-d4df3c89-9740-43d2-8b29-74f412d3524b" acquired by "delete_volume" :: waited 0.018s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:59:58 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc769f1-ee0f-4986-80a8-f85430108a01]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:59:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2e6081df-f2f8-4771-997b-5f85fafd8a1a tempest-GroupSnapshotsTest-1016258839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4df3c89-9740-43d2-8b29-74f412d3524b {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:58 devstack sudo[101114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4df3c89-9740-43d2-8b29-74f412d3524b Jul 30 16:59:58 devstack sudo[101114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:58 devstack sudo[101114]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2e6081df-f2f8-4771-997b-5f85fafd8a1a tempest-GroupSnapshotsTest-1016258839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4df3c89-9740-43d2-8b29-74f412d3524b" returned: 0 in 0.471s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2e6081df-f2f8-4771-997b-5f85fafd8a1a tempest-GroupSnapshotsTest-1016258839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4df3c89-9740-43d2-8b29-74f412d3524b {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:58 devstack sudo[101120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4df3c89-9740-43d2-8b29-74f412d3524b Jul 30 16:59:58 devstack sudo[101120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:58 devstack sudo[101120]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2e6081df-f2f8-4771-997b-5f85fafd8a1a tempest-GroupSnapshotsTest-1016258839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4df3c89-9740-43d2-8b29-74f412d3524b" returned: 0 in 0.330s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:58 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-2e6081df-f2f8-4771-997b-5f85fafd8a1a tempest-GroupSnapshotsTest-1016258839 None] Lock "cinder-quobyte-d4df3c89-9740-43d2-8b29-74f412d3524b" released by "delete_volume" :: held 0.888s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:59:59 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-2e6081df-f2f8-4771-997b-5f85fafd8a1a tempest-GroupSnapshotsTest-1016258839 None] Created reservations ['13651032-36c1-4bb2-a3ea-6347f64ba235'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:59:59 devstack cinder-volume[88568]: WARNING cinder.db.api [None req-2e6081df-f2f8-4771-997b-5f85fafd8a1a tempest-GroupSnapshotsTest-1016258839 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-830877511'] Jul 30 16:59:59 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-2e6081df-f2f8-4771-997b-5f85fafd8a1a tempest-GroupSnapshotsTest-1016258839 None] Created reservations ['58ffaca5-c110-4064-a939-4d08e5091201', '37e4b5c1-90ce-489f-9626-e2dcf0a62b50', '240ed723-259b-4023-8910-af74f0b379d4', 'c2c3e0c6-9ca2-473a-ba76-708de5774656'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:59:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-2e6081df-f2f8-4771-997b-5f85fafd8a1a tempest-GroupSnapshotsTest-1016258839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:59:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-2e6081df-f2f8-4771-997b-5f85fafd8a1a tempest-GroupSnapshotsTest-1016258839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:59:59 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-2e6081df-f2f8-4771-997b-5f85fafd8a1a tempest-GroupSnapshotsTest-1016258839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:59:59 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-2e6081df-f2f8-4771-997b-5f85fafd8a1a tempest-GroupSnapshotsTest-1016258839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:59:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-2e6081df-f2f8-4771-997b-5f85fafd8a1a tempest-GroupSnapshotsTest-1016258839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:59:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2e6081df-f2f8-4771-997b-5f85fafd8a1a tempest-GroupSnapshotsTest-1016258839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:59 devstack sudo[101123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 16:59:59 devstack sudo[101123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:59 devstack sudo[101123]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2e6081df-f2f8-4771-997b-5f85fafd8a1a tempest-GroupSnapshotsTest-1016258839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.403s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:59 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-2e6081df-f2f8-4771-997b-5f85fafd8a1a tempest-GroupSnapshotsTest-1016258839 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:59:59 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-2e6081df-f2f8-4771-997b-5f85fafd8a1a tempest-GroupSnapshotsTest-1016258839 None] Delete group completed successfully. Jul 30 17:00:00 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-fea6cac7-9341-47fc-8f54-2ff0695042e7 tempest-GroupSnapshotsTest-1016258839 None] Group tempest-GroupSnapshotsTest-Group-1807505985: creating Jul 30 17:00:00 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-fea6cac7-9341-47fc-8f54-2ff0695042e7 tempest-GroupSnapshotsTest-1016258839 None] Group tempest-GroupSnapshotsTest-Group-1807505985: created successfully Jul 30 17:00:00 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-fea6cac7-9341-47fc-8f54-2ff0695042e7 tempest-GroupSnapshotsTest-1016258839 None] Create group completed successfully. Jul 30 17:00:02 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb9fc1de-f821-4f4e-9ffa-0876e54f3d2c tempest-GroupSnapshotsTest-1016258839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:00:02 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fb9fc1de-f821-4f4e-9ffa-0876e54f3d2c tempest-GroupSnapshotsTest-1016258839 None] Flow 'volume_create_manager' (601cd995-fdd8-43d3-801a-3c9e0dbccf15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:00:02 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fb9fc1de-f821-4f4e-9ffa-0876e54f3d2c tempest-GroupSnapshotsTest-1016258839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5586bf2b-0b1d-4836-b356-1a2184ecf09d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:00:02 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fb9fc1de-f821-4f4e-9ffa-0876e54f3d2c tempest-GroupSnapshotsTest-1016258839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5586bf2b-0b1d-4836-b356-1a2184ecf09d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:00:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1624826931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ca29016d-4fff-4112-a31c-abc668a6f983,host='devstack@QuobyteHD#QuobyteHD',id=51f31674-8c9c-4271-bede-e8823d6f5815,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b492a05000f4134822a5d9ffd72aa2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:00:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:00:02Z,use_quota=True,user_id='6c9b5dc45fb14a9c8a7df96de3b9b516',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f1a0c4c-73dc-4eb2-b014-bc302ecec52c),volume_type_id=3f1a0c4c-73dc-4eb2-b014-bc302ecec52c)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:00:02 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fb9fc1de-f821-4f4e-9ffa-0876e54f3d2c tempest-GroupSnapshotsTest-1016258839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d374ee52-ee25-480f-9676-216bea1758cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:00:02 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fb9fc1de-f821-4f4e-9ffa-0876e54f3d2c tempest-GroupSnapshotsTest-1016258839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d374ee52-ee25-480f-9676-216bea1758cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:00:02 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fb9fc1de-f821-4f4e-9ffa-0876e54f3d2c tempest-GroupSnapshotsTest-1016258839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37355d9c-96d6-4f7b-8732-f18395bb0332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:00:02 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fb9fc1de-f821-4f4e-9ffa-0876e54f3d2c tempest-GroupSnapshotsTest-1016258839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37355d9c-96d6-4f7b-8732-f18395bb0332) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51f31674-8c9c-4271-bede-e8823d6f5815', 'volume_name': 'volume-51f31674-8c9c-4271-bede-e8823d6f5815', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:00:02 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fb9fc1de-f821-4f4e-9ffa-0876e54f3d2c tempest-GroupSnapshotsTest-1016258839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29add38b-01fd-463b-af3d-8b5728865ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:00:02 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fb9fc1de-f821-4f4e-9ffa-0876e54f3d2c tempest-GroupSnapshotsTest-1016258839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29add38b-01fd-463b-af3d-8b5728865ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:00:02 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fb9fc1de-f821-4f4e-9ffa-0876e54f3d2c tempest-GroupSnapshotsTest-1016258839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe8024ff-f962-4446-b8cc-17495eb696ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:00:02 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-fb9fc1de-f821-4f4e-9ffa-0876e54f3d2c tempest-GroupSnapshotsTest-1016258839 None] Volume 51f31674-8c9c-4271-bede-e8823d6f5815: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51f31674-8c9c-4271-bede-e8823d6f5815', 'volume_size': 1} Jul 30 17:00:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-fb9fc1de-f821-4f4e-9ffa-0876e54f3d2c tempest-GroupSnapshotsTest-1016258839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:00:04 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-12611071-301f-4da0-b577-97bccd389c7e tempest-TestImageHashVerification-1093437859 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:00:04 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-12611071-301f-4da0-b577-97bccd389c7e tempest-TestImageHashVerification-1093437859 None] Flow 'volume_create_manager' (bda701a5-80c4-4cbb-81b8-2494d389651b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:00:04 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-12611071-301f-4da0-b577-97bccd389c7e tempest-TestImageHashVerification-1093437859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aab60584-1324-42e2-963c-a4d6429bf2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:00:04 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-12611071-301f-4da0-b577-97bccd389c7e tempest-TestImageHashVerification-1093437859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aab60584-1324-42e2-963c-a4d6429bf2e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:00:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-2120681825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73386d64-93de-48f9-9e58-fa440da67b49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce128d4e038a445f838789924fb1f414',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:00:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:00:05Z,use_quota=True,user_id='086a4146e89144b996a3f18a26642480',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:00:04 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-12611071-301f-4da0-b577-97bccd389c7e tempest-TestImageHashVerification-1093437859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b404363-ea61-4dee-8291-a3a07fd3404d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:00:04 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-12611071-301f-4da0-b577-97bccd389c7e tempest-TestImageHashVerification-1093437859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b404363-ea61-4dee-8291-a3a07fd3404d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:00:04 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-12611071-301f-4da0-b577-97bccd389c7e tempest-TestImageHashVerification-1093437859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58b9802f-ba8d-4b1f-951b-663d8a76e443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:00:04 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-12611071-301f-4da0-b577-97bccd389c7e tempest-TestImageHashVerification-1093437859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58b9802f-ba8d-4b1f-951b-663d8a76e443) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73386d64-93de-48f9-9e58-fa440da67b49', 'volume_name': 'volume-73386d64-93de-48f9-9e58-fa440da67b49', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:00:04 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-12611071-301f-4da0-b577-97bccd389c7e tempest-TestImageHashVerification-1093437859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d18bbb48-123b-4b0b-830a-aba2091d59d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:00:04 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-12611071-301f-4da0-b577-97bccd389c7e tempest-TestImageHashVerification-1093437859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d18bbb48-123b-4b0b-830a-aba2091d59d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:00:04 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-12611071-301f-4da0-b577-97bccd389c7e tempest-TestImageHashVerification-1093437859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b3286cb-8c3e-4695-ba8d-99254771bf1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:00:04 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-12611071-301f-4da0-b577-97bccd389c7e tempest-TestImageHashVerification-1093437859 None] Volume 73386d64-93de-48f9-9e58-fa440da67b49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73386d64-93de-48f9-9e58-fa440da67b49', 'volume_size': 1} Jul 30 17:00:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-12611071-301f-4da0-b577-97bccd389c7e tempest-TestImageHashVerification-1093437859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:00:14 devstack cinder-volume[88568]: DEBUG dbcounter [-] [88568] Writing DB stats cinder:SELECT=52,cinder:INSERT=10,cinder:UPDATE=51 {{(pid=88568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 17:00:14 devstack cinder-volume[88568]: DEBUG dbcounter [-] [88568] Writing DB stats cinder:UPDATE=46,cinder:SELECT=57,cinder:INSERT=13,cinder:DELETE=2 {{(pid=88568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 17:00:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-8cc461fb-e983-44e0-97d6-89dbcad061a1 tempest-VolumesActionsTest-1414446346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 28.084s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:00:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8cc461fb-e983-44e0-97d6-89dbcad061a1 tempest-VolumesActionsTest-1414446346 None] Uploaded volume to glance image-id: 13aa8ee7-03ec-4627-9e9b-a233e357947c. {{(pid=88568) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 30 17:00:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-fb9fc1de-f821-4f4e-9ffa-0876e54f3d2c tempest-GroupSnapshotsTest-1016258839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.622s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:00:17 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-fb9fc1de-f821-4f4e-9ffa-0876e54f3d2c tempest-GroupSnapshotsTest-1016258839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ca29016d-4fff-4112-a31c-abc668a6f983,created_at=2026-07-30T15:00:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1624826931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ca29016d-4fff-4112-a31c-abc668a6f983,host='devstack@QuobyteHD#QuobyteHD',id=51f31674-8c9c-4271-bede-e8823d6f5815,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b492a05000f4134822a5d9ffd72aa2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:00:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:00:02Z,use_quota=True,user_id='6c9b5dc45fb14a9c8a7df96de3b9b516',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f1a0c4c-73dc-4eb2-b014-bc302ecec52c),volume_type_id=3f1a0c4c-73dc-4eb2-b014-bc302ecec52c)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:00:17 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-fb9fc1de-f821-4f4e-9ffa-0876e54f3d2c tempest-GroupSnapshotsTest-1016258839 None] Creating volume 51f31674-8c9c-4271-bede-e8823d6f5815 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:00:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-fb9fc1de-f821-4f4e-9ffa-0876e54f3d2c tempest-GroupSnapshotsTest-1016258839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:00:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-fb9fc1de-f821-4f4e-9ffa-0876e54f3d2c tempest-GroupSnapshotsTest-1016258839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:00:17 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-fb9fc1de-f821-4f4e-9ffa-0876e54f3d2c tempest-GroupSnapshotsTest-1016258839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:00:17 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-fb9fc1de-f821-4f4e-9ffa-0876e54f3d2c tempest-GroupSnapshotsTest-1016258839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:00:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-fb9fc1de-f821-4f4e-9ffa-0876e54f3d2c tempest-GroupSnapshotsTest-1016258839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:00:17 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-fb9fc1de-f821-4f4e-9ffa-0876e54f3d2c tempest-GroupSnapshotsTest-1016258839 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:00:17 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-fb9fc1de-f821-4f4e-9ffa-0876e54f3d2c tempest-GroupSnapshotsTest-1016258839 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:00:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fb9fc1de-f821-4f4e-9ffa-0876e54f3d2c tempest-GroupSnapshotsTest-1016258839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-51f31674-8c9c-4271-bede-e8823d6f5815 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:17 devstack sudo[101135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-51f31674-8c9c-4271-bede-e8823d6f5815 1073741824 Jul 30 17:00:17 devstack sudo[101135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:17 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-8cc461fb-e983-44e0-97d6-89dbcad061a1 tempest-VolumesActionsTest-1414446346 None] Copy volume to image completed successfully. Jul 30 17:00:18 devstack sudo[101135]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fb9fc1de-f821-4f4e-9ffa-0876e54f3d2c tempest-GroupSnapshotsTest-1016258839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-51f31674-8c9c-4271-bede-e8823d6f5815 1073741824" returned: 0 in 0.522s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fb9fc1de-f821-4f4e-9ffa-0876e54f3d2c tempest-GroupSnapshotsTest-1016258839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-51f31674-8c9c-4271-bede-e8823d6f5815 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:18 devstack sudo[101142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-51f31674-8c9c-4271-bede-e8823d6f5815 Jul 30 17:00:18 devstack sudo[101142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:18 devstack sudo[101142]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fb9fc1de-f821-4f4e-9ffa-0876e54f3d2c tempest-GroupSnapshotsTest-1016258839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-51f31674-8c9c-4271-bede-e8823d6f5815" returned: 0 in 0.258s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:18 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-fb9fc1de-f821-4f4e-9ffa-0876e54f3d2c tempest-GroupSnapshotsTest-1016258839 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:00:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-fb9fc1de-f821-4f4e-9ffa-0876e54f3d2c tempest-GroupSnapshotsTest-1016258839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:00:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-12611071-301f-4da0-b577-97bccd389c7e tempest-TestImageHashVerification-1093437859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.037s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:00:18 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-12611071-301f-4da0-b577-97bccd389c7e tempest-TestImageHashVerification-1093437859 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:00:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-2120681825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73386d64-93de-48f9-9e58-fa440da67b49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce128d4e038a445f838789924fb1f414',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:00:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:00:05Z,use_quota=True,user_id='086a4146e89144b996a3f18a26642480',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:00:18 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-12611071-301f-4da0-b577-97bccd389c7e tempest-TestImageHashVerification-1093437859 None] Creating volume 73386d64-93de-48f9-9e58-fa440da67b49 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:00:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-12611071-301f-4da0-b577-97bccd389c7e tempest-TestImageHashVerification-1093437859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:00:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-12611071-301f-4da0-b577-97bccd389c7e tempest-TestImageHashVerification-1093437859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:00:18 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-12611071-301f-4da0-b577-97bccd389c7e tempest-TestImageHashVerification-1093437859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:00:18 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-12611071-301f-4da0-b577-97bccd389c7e tempest-TestImageHashVerification-1093437859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:00:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-12611071-301f-4da0-b577-97bccd389c7e tempest-TestImageHashVerification-1093437859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:00:18 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-12611071-301f-4da0-b577-97bccd389c7e tempest-TestImageHashVerification-1093437859 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:00:18 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-12611071-301f-4da0-b577-97bccd389c7e tempest-TestImageHashVerification-1093437859 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:00:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-12611071-301f-4da0-b577-97bccd389c7e tempest-TestImageHashVerification-1093437859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-73386d64-93de-48f9-9e58-fa440da67b49 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:18 devstack sudo[101145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-73386d64-93de-48f9-9e58-fa440da67b49 1073741824 Jul 30 17:00:18 devstack sudo[101145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:18 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fb9fc1de-f821-4f4e-9ffa-0876e54f3d2c tempest-GroupSnapshotsTest-1016258839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe8024ff-f962-4446-b8cc-17495eb696ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51f31674-8c9c-4271-bede-e8823d6f5815', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:00:18 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fb9fc1de-f821-4f4e-9ffa-0876e54f3d2c tempest-GroupSnapshotsTest-1016258839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acfaa33e-aaeb-4f3a-9984-8ba87e42cf78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:00:18 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-fb9fc1de-f821-4f4e-9ffa-0876e54f3d2c tempest-GroupSnapshotsTest-1016258839 None] Volume volume-51f31674-8c9c-4271-bede-e8823d6f5815 (51f31674-8c9c-4271-bede-e8823d6f5815): created successfully Jul 30 17:00:18 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fb9fc1de-f821-4f4e-9ffa-0876e54f3d2c tempest-GroupSnapshotsTest-1016258839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acfaa33e-aaeb-4f3a-9984-8ba87e42cf78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:00:18 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fb9fc1de-f821-4f4e-9ffa-0876e54f3d2c tempest-GroupSnapshotsTest-1016258839 None] Flow 'volume_create_manager' (601cd995-fdd8-43d3-801a-3c9e0dbccf15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:00:18 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-fb9fc1de-f821-4f4e-9ffa-0876e54f3d2c tempest-GroupSnapshotsTest-1016258839 None] Created volume successfully. Jul 30 17:00:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-bb69de66-5518-4151-946e-52e1a3fa0713 tempest-VolumesActionsTest-1414446346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:00:19 devstack sudo[101145]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:19 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-12611071-301f-4da0-b577-97bccd389c7e tempest-TestImageHashVerification-1093437859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-73386d64-93de-48f9-9e58-fa440da67b49 1073741824" returned: 0 in 0.432s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:19 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-12611071-301f-4da0-b577-97bccd389c7e tempest-TestImageHashVerification-1093437859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-73386d64-93de-48f9-9e58-fa440da67b49 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:19 devstack sudo[101150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-73386d64-93de-48f9-9e58-fa440da67b49 Jul 30 17:00:19 devstack sudo[101150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:19 devstack sudo[101150]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:19 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-12611071-301f-4da0-b577-97bccd389c7e tempest-TestImageHashVerification-1093437859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-73386d64-93de-48f9-9e58-fa440da67b49" returned: 0 in 0.243s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:19 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-12611071-301f-4da0-b577-97bccd389c7e tempest-TestImageHashVerification-1093437859 None] <== create_volume: return (710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:00:19 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-12611071-301f-4da0-b577-97bccd389c7e tempest-TestImageHashVerification-1093437859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.713s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:00:19 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-bb69de66-5518-4151-946e-52e1a3fa0713 tempest-VolumesActionsTest-1414446346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.590s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:00:19 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-12611071-301f-4da0-b577-97bccd389c7e tempest-TestImageHashVerification-1093437859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b3286cb-8c3e-4695-ba8d-99254771bf1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73386d64-93de-48f9-9e58-fa440da67b49', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:00:19 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-12611071-301f-4da0-b577-97bccd389c7e tempest-TestImageHashVerification-1093437859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07a3cc96-8a51-4b90-be2f-125c32b26eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:00:19 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6730b1-fd3c-4f57-ac90-fc4f3d020d16]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:00:19 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-bb69de66-5518-4151-946e-52e1a3fa0713 tempest-VolumesActionsTest-1414446346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-3c1f1086-1cea-4539-b6ee-f2e715ba6810 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:19 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-12611071-301f-4da0-b577-97bccd389c7e tempest-TestImageHashVerification-1093437859 None] Volume volume-73386d64-93de-48f9-9e58-fa440da67b49 (73386d64-93de-48f9-9e58-fa440da67b49): created successfully Jul 30 17:00:19 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-12611071-301f-4da0-b577-97bccd389c7e tempest-TestImageHashVerification-1093437859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07a3cc96-8a51-4b90-be2f-125c32b26eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:00:19 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-12611071-301f-4da0-b577-97bccd389c7e tempest-TestImageHashVerification-1093437859 None] Flow 'volume_create_manager' (bda701a5-80c4-4cbb-81b8-2494d389651b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:00:19 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-12611071-301f-4da0-b577-97bccd389c7e tempest-TestImageHashVerification-1093437859 None] Created volume successfully. Jul 30 17:00:19 devstack sudo[101153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-3c1f1086-1cea-4539-b6ee-f2e715ba6810 Jul 30 17:00:19 devstack sudo[101153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:19 devstack sudo[101153]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:19 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-bb69de66-5518-4151-946e-52e1a3fa0713 tempest-VolumesActionsTest-1414446346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-3c1f1086-1cea-4539-b6ee-f2e715ba6810" returned: 0 in 0.375s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:19 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b2e0e2-4f4b-4a1b-aae1-b0453e492dba]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:00:19 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-bb69de66-5518-4151-946e-52e1a3fa0713 tempest-VolumesActionsTest-1414446346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-3c1f1086-1cea-4539-b6ee-f2e715ba6810 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:19 devstack sudo[101158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-3c1f1086-1cea-4539-b6ee-f2e715ba6810 Jul 30 17:00:19 devstack sudo[101158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:20 devstack sudo[101158]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-bb69de66-5518-4151-946e-52e1a3fa0713 tempest-VolumesActionsTest-1414446346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-3c1f1086-1cea-4539-b6ee-f2e715ba6810" returned: 0 in 0.440s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-bb69de66-5518-4151-946e-52e1a3fa0713 tempest-VolumesActionsTest-1414446346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-3c1f1086-1cea-4539-b6ee-f2e715ba6810 /opt/stack/data/cinder/conversion/3c1f1086-1cea-4539-b6ee-f2e715ba6810.temp_image.b3e72226-e004-4d85-91e9-869ba8cc8577_ffay914.img {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:20 devstack sudo[101163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-3c1f1086-1cea-4539-b6ee-f2e715ba6810 /opt/stack/data/cinder/conversion/3c1f1086-1cea-4539-b6ee-f2e715ba6810.temp_image.b3e72226-e004-4d85-91e9-869ba8cc8577_ffay914.img Jul 30 17:00:20 devstack sudo[101163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:20 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-e05b134c-2bb7-4faa-b969-ec94f444dd0c tempest-GroupSnapshotsTest-1016258839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:00:20 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e05b134c-2bb7-4faa-b969-ec94f444dd0c tempest-GroupSnapshotsTest-1016258839 None] Flow 'volume_create_manager' (f192fbe4-73f7-4c95-9e07-aa7586b80d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:00:20 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e05b134c-2bb7-4faa-b969-ec94f444dd0c tempest-GroupSnapshotsTest-1016258839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62c66f48-a33c-4477-ad7a-a4f3248964fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:00:20 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e05b134c-2bb7-4faa-b969-ec94f444dd0c tempest-GroupSnapshotsTest-1016258839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62c66f48-a33c-4477-ad7a-a4f3248964fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:00:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-229752299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ca29016d-4fff-4112-a31c-abc668a6f983,host='devstack@QuobyteHD#QuobyteHD',id=bab28edd-db76-441a-bc77-0fe42807b075,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b492a05000f4134822a5d9ffd72aa2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:00:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:00:20Z,use_quota=True,user_id='6c9b5dc45fb14a9c8a7df96de3b9b516',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f1a0c4c-73dc-4eb2-b014-bc302ecec52c),volume_type_id=3f1a0c4c-73dc-4eb2-b014-bc302ecec52c)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:00:20 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e05b134c-2bb7-4faa-b969-ec94f444dd0c tempest-GroupSnapshotsTest-1016258839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5099f17-ce73-4341-9522-1a01d06242dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:00:20 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e05b134c-2bb7-4faa-b969-ec94f444dd0c tempest-GroupSnapshotsTest-1016258839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5099f17-ce73-4341-9522-1a01d06242dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:00:20 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e05b134c-2bb7-4faa-b969-ec94f444dd0c tempest-GroupSnapshotsTest-1016258839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb348dd4-7e4c-4616-85c2-53261c17f36a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:00:20 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e05b134c-2bb7-4faa-b969-ec94f444dd0c tempest-GroupSnapshotsTest-1016258839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb348dd4-7e4c-4616-85c2-53261c17f36a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bab28edd-db76-441a-bc77-0fe42807b075', 'volume_name': 'volume-bab28edd-db76-441a-bc77-0fe42807b075', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:00:20 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e05b134c-2bb7-4faa-b969-ec94f444dd0c tempest-GroupSnapshotsTest-1016258839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f433d4b-9cd6-4776-8189-5183b26ea4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:00:20 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e05b134c-2bb7-4faa-b969-ec94f444dd0c tempest-GroupSnapshotsTest-1016258839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f433d4b-9cd6-4776-8189-5183b26ea4b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:00:20 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e05b134c-2bb7-4faa-b969-ec94f444dd0c tempest-GroupSnapshotsTest-1016258839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16294aa1-777c-4a4f-8379-5d3a91df1f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:00:20 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-e05b134c-2bb7-4faa-b969-ec94f444dd0c tempest-GroupSnapshotsTest-1016258839 None] Volume bab28edd-db76-441a-bc77-0fe42807b075: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bab28edd-db76-441a-bc77-0fe42807b075', 'volume_size': 1} Jul 30 17:00:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-e05b134c-2bb7-4faa-b969-ec94f444dd0c tempest-GroupSnapshotsTest-1016258839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:00:22 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-91de0875-ce9b-44d5-8f4b-fa54e168578e tempest-TestImageHashVerification-1093437859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:00:24 devstack sudo[101163]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-bb69de66-5518-4151-946e-52e1a3fa0713 tempest-VolumesActionsTest-1414446346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-3c1f1086-1cea-4539-b6ee-f2e715ba6810 /opt/stack/data/cinder/conversion/3c1f1086-1cea-4539-b6ee-f2e715ba6810.temp_image.b3e72226-e004-4d85-91e9-869ba8cc8577_ffay914.img" returned: 0 in 4.281s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:24 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab7b280f-5cf5-4df3-b17a-56553751b4ce]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:00:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-bb69de66-5518-4151-946e-52e1a3fa0713 tempest-VolumesActionsTest-1414446346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-3c1f1086-1cea-4539-b6ee-f2e715ba6810 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:24 devstack sudo[101176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-3c1f1086-1cea-4539-b6ee-f2e715ba6810 Jul 30 17:00:24 devstack sudo[101176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:25 devstack sudo[101176]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:25 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-bb69de66-5518-4151-946e-52e1a3fa0713 tempest-VolumesActionsTest-1414446346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-3c1f1086-1cea-4539-b6ee-f2e715ba6810" returned: 0 in 0.516s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:25 devstack cinder-volume[88568]: DEBUG cinder.image.image_utils [None req-bb69de66-5518-4151-946e-52e1a3fa0713 tempest-VolumesActionsTest-1414446346 None] Image conversion details: src /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-3c1f1086-1cea-4539-b6ee-f2e715ba6810, size 1024.00 MB, duration 4.28 sec, destination /opt/stack/data/cinder/conversion/3c1f1086-1cea-4539-b6ee-f2e715ba6810.temp_image.b3e72226-e004-4d85-91e9-869ba8cc8577_ffay914.img {{(pid=88568) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 17:00:25 devstack cinder-volume[88568]: INFO cinder.image.image_utils [None req-bb69de66-5518-4151-946e-52e1a3fa0713 tempest-VolumesActionsTest-1414446346 None] Converted 1024.00 MB image at 239.12 MB/s Jul 30 17:00:25 devstack cinder-volume[88568]: DEBUG cinder.image.image_utils [None req-bb69de66-5518-4151-946e-52e1a3fa0713 tempest-VolumesActionsTest-1414446346 None] b3e72226-e004-4d85-91e9-869ba8cc8577 was raw, converting to qcow2 {{(pid=88568) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 30 17:00:25 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a62832-7224-4a81-8a78-c69b6ebd4b34]: (4, 'raw') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:00:25 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-bb69de66-5518-4151-946e-52e1a3fa0713 tempest-VolumesActionsTest-1414446346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/3c1f1086-1cea-4539-b6ee-f2e715ba6810.temp_image.b3e72226-e004-4d85-91e9-869ba8cc8577_ffay914.img {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:25 devstack sudo[101182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/3c1f1086-1cea-4539-b6ee-f2e715ba6810.temp_image.b3e72226-e004-4d85-91e9-869ba8cc8577_ffay914.img Jul 30 17:00:25 devstack sudo[101182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:25 devstack sudo[101182]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:25 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-bb69de66-5518-4151-946e-52e1a3fa0713 tempest-VolumesActionsTest-1414446346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/3c1f1086-1cea-4539-b6ee-f2e715ba6810.temp_image.b3e72226-e004-4d85-91e9-869ba8cc8577_ffay914.img" returned: 0 in 0.329s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:25 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-bb69de66-5518-4151-946e-52e1a3fa0713 tempest-VolumesActionsTest-1414446346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/3c1f1086-1cea-4539-b6ee-f2e715ba6810.temp_image.b3e72226-e004-4d85-91e9-869ba8cc8577_ffay914.img {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:25 devstack sudo[101186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/3c1f1086-1cea-4539-b6ee-f2e715ba6810.temp_image.b3e72226-e004-4d85-91e9-869ba8cc8577_ffay914.img Jul 30 17:00:25 devstack sudo[101186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:25 devstack sudo[101186]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:25 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-bb69de66-5518-4151-946e-52e1a3fa0713 tempest-VolumesActionsTest-1414446346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/3c1f1086-1cea-4539-b6ee-f2e715ba6810.temp_image.b3e72226-e004-4d85-91e9-869ba8cc8577_ffay914.img" returned: 1 in 0.317s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:25 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-bb69de66-5518-4151-946e-52e1a3fa0713 tempest-VolumesActionsTest-1414446346 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/3c1f1086-1cea-4539-b6ee-f2e715ba6810.temp_image.b3e72226-e004-4d85-91e9-869ba8cc8577_ffay914.img' failed. Not Retrying. {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 17:00:25 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-bb69de66-5518-4151-946e-52e1a3fa0713 tempest-VolumesActionsTest-1414446346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/3c1f1086-1cea-4539-b6ee-f2e715ba6810.temp_image.b3e72226-e004-4d85-91e9-869ba8cc8577_ffay914.img /opt/stack/data/cinder/conversion/vol_upload_huuj236p {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:25 devstack sudo[101191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/3c1f1086-1cea-4539-b6ee-f2e715ba6810.temp_image.b3e72226-e004-4d85-91e9-869ba8cc8577_ffay914.img /opt/stack/data/cinder/conversion/vol_upload_huuj236p Jul 30 17:00:25 devstack sudo[101191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:26 devstack sudo[101191]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-bb69de66-5518-4151-946e-52e1a3fa0713 tempest-VolumesActionsTest-1414446346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/3c1f1086-1cea-4539-b6ee-f2e715ba6810.temp_image.b3e72226-e004-4d85-91e9-869ba8cc8577_ffay914.img /opt/stack/data/cinder/conversion/vol_upload_huuj236p" returned: 0 in 0.253s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:26 devstack cinder-volume[88568]: DEBUG cinder.image.image_utils [None req-bb69de66-5518-4151-946e-52e1a3fa0713 tempest-VolumesActionsTest-1414446346 None] Image conversion details: src /opt/stack/data/cinder/conversion/3c1f1086-1cea-4539-b6ee-f2e715ba6810.temp_image.b3e72226-e004-4d85-91e9-869ba8cc8577_ffay914.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_huuj236p {{(pid=88568) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 17:00:26 devstack cinder-volume[88568]: INFO cinder.image.image_utils [None req-bb69de66-5518-4151-946e-52e1a3fa0713 tempest-VolumesActionsTest-1414446346 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 30 17:00:26 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f51eddf-01f6-4219-b642-4b0e77cf2910]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:00:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-bb69de66-5518-4151-946e-52e1a3fa0713 tempest-VolumesActionsTest-1414446346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_huuj236p {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:26 devstack sudo[101196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_huuj236p Jul 30 17:00:26 devstack sudo[101196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:26 devstack sudo[101196]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-bb69de66-5518-4151-946e-52e1a3fa0713 tempest-VolumesActionsTest-1414446346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_huuj236p" returned: 0 in 0.349s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:27 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-bb69de66-5518-4151-946e-52e1a3fa0713 tempest-VolumesActionsTest-1414446346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 8.185s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:00:27 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-bb69de66-5518-4151-946e-52e1a3fa0713 tempest-VolumesActionsTest-1414446346 None] Uploaded volume to glance image-id: b3e72226-e004-4d85-91e9-869ba8cc8577. {{(pid=88568) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 30 17:00:27 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-e05b134c-2bb7-4faa-b969-ec94f444dd0c tempest-GroupSnapshotsTest-1016258839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.202s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:00:27 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-e05b134c-2bb7-4faa-b969-ec94f444dd0c tempest-GroupSnapshotsTest-1016258839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ca29016d-4fff-4112-a31c-abc668a6f983,created_at=2026-07-30T15:00:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-229752299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ca29016d-4fff-4112-a31c-abc668a6f983,host='devstack@QuobyteHD#QuobyteHD',id=bab28edd-db76-441a-bc77-0fe42807b075,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b492a05000f4134822a5d9ffd72aa2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:00:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:00:20Z,use_quota=True,user_id='6c9b5dc45fb14a9c8a7df96de3b9b516',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f1a0c4c-73dc-4eb2-b014-bc302ecec52c),volume_type_id=3f1a0c4c-73dc-4eb2-b014-bc302ecec52c)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:00:27 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-e05b134c-2bb7-4faa-b969-ec94f444dd0c tempest-GroupSnapshotsTest-1016258839 None] Creating volume bab28edd-db76-441a-bc77-0fe42807b075 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:00:27 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-e05b134c-2bb7-4faa-b969-ec94f444dd0c tempest-GroupSnapshotsTest-1016258839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:00:27 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-e05b134c-2bb7-4faa-b969-ec94f444dd0c tempest-GroupSnapshotsTest-1016258839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:00:27 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-e05b134c-2bb7-4faa-b969-ec94f444dd0c tempest-GroupSnapshotsTest-1016258839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:00:27 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-e05b134c-2bb7-4faa-b969-ec94f444dd0c tempest-GroupSnapshotsTest-1016258839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:00:27 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-e05b134c-2bb7-4faa-b969-ec94f444dd0c tempest-GroupSnapshotsTest-1016258839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:00:27 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-e05b134c-2bb7-4faa-b969-ec94f444dd0c tempest-GroupSnapshotsTest-1016258839 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:00:27 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-e05b134c-2bb7-4faa-b969-ec94f444dd0c tempest-GroupSnapshotsTest-1016258839 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:00:27 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e05b134c-2bb7-4faa-b969-ec94f444dd0c tempest-GroupSnapshotsTest-1016258839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bab28edd-db76-441a-bc77-0fe42807b075 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:27 devstack sudo[101201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bab28edd-db76-441a-bc77-0fe42807b075 1073741824 Jul 30 17:00:27 devstack sudo[101201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:27 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-bb69de66-5518-4151-946e-52e1a3fa0713 tempest-VolumesActionsTest-1414446346 None] Copy volume to image completed successfully. Jul 30 17:00:28 devstack sudo[101201]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e05b134c-2bb7-4faa-b969-ec94f444dd0c tempest-GroupSnapshotsTest-1016258839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bab28edd-db76-441a-bc77-0fe42807b075 1073741824" returned: 0 in 0.438s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e05b134c-2bb7-4faa-b969-ec94f444dd0c tempest-GroupSnapshotsTest-1016258839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bab28edd-db76-441a-bc77-0fe42807b075 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:28 devstack sudo[101206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bab28edd-db76-441a-bc77-0fe42807b075 Jul 30 17:00:28 devstack sudo[101206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:28 devstack sudo[101206]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e05b134c-2bb7-4faa-b969-ec94f444dd0c tempest-GroupSnapshotsTest-1016258839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bab28edd-db76-441a-bc77-0fe42807b075" returned: 0 in 0.257s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:28 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-e05b134c-2bb7-4faa-b969-ec94f444dd0c tempest-GroupSnapshotsTest-1016258839 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:00:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-e05b134c-2bb7-4faa-b969-ec94f444dd0c tempest-GroupSnapshotsTest-1016258839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:00:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-91de0875-ce9b-44d5-8f4b-fa54e168578e tempest-TestImageHashVerification-1093437859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 5.746s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:00:28 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e05b134c-2bb7-4faa-b969-ec94f444dd0c tempest-GroupSnapshotsTest-1016258839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16294aa1-777c-4a4f-8379-5d3a91df1f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bab28edd-db76-441a-bc77-0fe42807b075', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:00:28 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e05b134c-2bb7-4faa-b969-ec94f444dd0c tempest-GroupSnapshotsTest-1016258839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (384387d8-e9d5-4976-bc6e-c1cb015280a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:00:28 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e1db516-74ba-46c4-9bba-1e906255b47a]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:00:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-91de0875-ce9b-44d5-8f4b-fa54e168578e tempest-TestImageHashVerification-1093437859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-73386d64-93de-48f9-9e58-fa440da67b49 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:28 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-e05b134c-2bb7-4faa-b969-ec94f444dd0c tempest-GroupSnapshotsTest-1016258839 None] Volume volume-bab28edd-db76-441a-bc77-0fe42807b075 (bab28edd-db76-441a-bc77-0fe42807b075): created successfully Jul 30 17:00:28 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e05b134c-2bb7-4faa-b969-ec94f444dd0c tempest-GroupSnapshotsTest-1016258839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (384387d8-e9d5-4976-bc6e-c1cb015280a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:00:28 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e05b134c-2bb7-4faa-b969-ec94f444dd0c tempest-GroupSnapshotsTest-1016258839 None] Flow 'volume_create_manager' (f192fbe4-73f7-4c95-9e07-aa7586b80d8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:00:28 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-e05b134c-2bb7-4faa-b969-ec94f444dd0c tempest-GroupSnapshotsTest-1016258839 None] Created volume successfully. Jul 30 17:00:28 devstack sudo[101209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-73386d64-93de-48f9-9e58-fa440da67b49 Jul 30 17:00:28 devstack sudo[101209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:28 devstack sudo[101209]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-91de0875-ce9b-44d5-8f4b-fa54e168578e tempest-TestImageHashVerification-1093437859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-73386d64-93de-48f9-9e58-fa440da67b49" returned: 0 in 0.400s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:28 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e5c9ae-7544-4f6f-bb85-4ada3e5a8db7]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:00:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-91de0875-ce9b-44d5-8f4b-fa54e168578e tempest-TestImageHashVerification-1093437859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-73386d64-93de-48f9-9e58-fa440da67b49 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:28 devstack sudo[101214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-73386d64-93de-48f9-9e58-fa440da67b49 Jul 30 17:00:28 devstack sudo[101214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:29 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-cb45995b-5faf-46a6-a9c3-2797975c861f tempest-VolumesActionsTest-1414446346 None] Acquiring lock "cinder-3c1f1086-1cea-4539-b6ee-f2e715ba6810-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:00:29 devstack sudo[101214]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-91de0875-ce9b-44d5-8f4b-fa54e168578e tempest-TestImageHashVerification-1093437859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-73386d64-93de-48f9-9e58-fa440da67b49" returned: 0 in 0.400s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-91de0875-ce9b-44d5-8f4b-fa54e168578e tempest-TestImageHashVerification-1093437859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-73386d64-93de-48f9-9e58-fa440da67b49 /opt/stack/data/cinder/conversion/73386d64-93de-48f9-9e58-fa440da67b49.temp_image.ca3d1073-8094-46e1-b73f-e82da2dac54dm58p3qp7.img {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:29 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-cb45995b-5faf-46a6-a9c3-2797975c861f tempest-VolumesActionsTest-1414446346 None] Lock "cinder-3c1f1086-1cea-4539-b6ee-f2e715ba6810-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:00:29 devstack sudo[101219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-73386d64-93de-48f9-9e58-fa440da67b49 /opt/stack/data/cinder/conversion/73386d64-93de-48f9-9e58-fa440da67b49.temp_image.ca3d1073-8094-46e1-b73f-e82da2dac54dm58p3qp7.img Jul 30 17:00:29 devstack sudo[101219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:29 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-cb45995b-5faf-46a6-a9c3-2797975c861f tempest-VolumesActionsTest-1414446346 None] Acquiring lock "cinder-quobyte-3c1f1086-1cea-4539-b6ee-f2e715ba6810" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:00:29 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-cb45995b-5faf-46a6-a9c3-2797975c861f tempest-VolumesActionsTest-1414446346 None] Lock "cinder-quobyte-3c1f1086-1cea-4539-b6ee-f2e715ba6810" acquired by "delete_volume" :: waited 0.018s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:00:29 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c9b71a-398b-4b54-bbd4-1ea3ceed392d]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:00:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-cb45995b-5faf-46a6-a9c3-2797975c861f tempest-VolumesActionsTest-1414446346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-3c1f1086-1cea-4539-b6ee-f2e715ba6810 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:29 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-ec47639b-cf3e-40da-a759-1dc2e61dbf75 tempest-GroupSnapshotsTest-1016258839 None] Update group completed successfully. Jul 30 17:00:29 devstack sudo[101221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-3c1f1086-1cea-4539-b6ee-f2e715ba6810 Jul 30 17:00:29 devstack sudo[101221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:29 devstack sudo[101221]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-cb45995b-5faf-46a6-a9c3-2797975c861f tempest-VolumesActionsTest-1414446346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-3c1f1086-1cea-4539-b6ee-f2e715ba6810" returned: 0 in 0.489s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-cb45995b-5faf-46a6-a9c3-2797975c861f tempest-VolumesActionsTest-1414446346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-3c1f1086-1cea-4539-b6ee-f2e715ba6810 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:29 devstack sudo[101237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-3c1f1086-1cea-4539-b6ee-f2e715ba6810 Jul 30 17:00:29 devstack sudo[101237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:30 devstack sudo[101237]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:30 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-cb45995b-5faf-46a6-a9c3-2797975c861f tempest-VolumesActionsTest-1414446346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-3c1f1086-1cea-4539-b6ee-f2e715ba6810" returned: 0 in 1.022s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:30 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-cb45995b-5faf-46a6-a9c3-2797975c861f tempest-VolumesActionsTest-1414446346 None] Lock "cinder-quobyte-3c1f1086-1cea-4539-b6ee-f2e715ba6810" released by "delete_volume" :: held 1.596s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:00:30 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-c584f25b-e235-4e20-a2da-843ececaad41 tempest-GroupSnapshotsTest-1016258839 None] Update group completed successfully. Jul 30 17:00:31 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-cb45995b-5faf-46a6-a9c3-2797975c861f tempest-VolumesActionsTest-1414446346 None] Created reservations ['af9918ab-063b-4410-a1b3-dcacafd6ce3a', '55be2021-882c-4f27-8532-dee294e8dade', '3b732b81-6885-44f6-8244-6863f2ccbfe0', '54434f9f-0e72-481f-8a75-afa27541a6f2'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:00:31 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-cb45995b-5faf-46a6-a9c3-2797975c861f tempest-VolumesActionsTest-1414446346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:00:31 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-cb45995b-5faf-46a6-a9c3-2797975c861f tempest-VolumesActionsTest-1414446346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:00:31 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-cb45995b-5faf-46a6-a9c3-2797975c861f tempest-VolumesActionsTest-1414446346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:00:31 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-cb45995b-5faf-46a6-a9c3-2797975c861f tempest-VolumesActionsTest-1414446346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:00:31 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-cb45995b-5faf-46a6-a9c3-2797975c861f tempest-VolumesActionsTest-1414446346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:00:31 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-cb45995b-5faf-46a6-a9c3-2797975c861f tempest-VolumesActionsTest-1414446346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:31 devstack sudo[101240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:00:31 devstack sudo[101240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:31 devstack sudo[101240]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:31 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-cb45995b-5faf-46a6-a9c3-2797975c861f tempest-VolumesActionsTest-1414446346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.580s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:31 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-cb45995b-5faf-46a6-a9c3-2797975c861f tempest-VolumesActionsTest-1414446346 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:00:31 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-cb45995b-5faf-46a6-a9c3-2797975c861f tempest-VolumesActionsTest-1414446346 None] Deleted volume successfully. Jul 30 17:00:31 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-cb45995b-5faf-46a6-a9c3-2797975c861f tempest-VolumesActionsTest-1414446346 None] Lock "cinder-3c1f1086-1cea-4539-b6ee-f2e715ba6810-delete_volume" released by "delete_volume" :: held 2.715s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:00:32 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-ff1d8db7-4fb1-49dc-8897-5a1484bb791a tempest-GroupSnapshotsTest-1016258839 None] Update group completed successfully. Jul 30 17:00:33 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-30759588-995e-4c6e-8c39-e9f34223de92 tempest-GroupSnapshotsTest-1016258839 None] Update group completed successfully. Jul 30 17:00:34 devstack sudo[101219]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:34 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-91de0875-ce9b-44d5-8f4b-fa54e168578e tempest-TestImageHashVerification-1093437859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-73386d64-93de-48f9-9e58-fa440da67b49 /opt/stack/data/cinder/conversion/73386d64-93de-48f9-9e58-fa440da67b49.temp_image.ca3d1073-8094-46e1-b73f-e82da2dac54dm58p3qp7.img" returned: 0 in 4.915s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:34 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd15aa9-dc88-4a10-a7e1-76e33f38afe2]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:00:34 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-91de0875-ce9b-44d5-8f4b-fa54e168578e tempest-TestImageHashVerification-1093437859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-73386d64-93de-48f9-9e58-fa440da67b49 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:34 devstack sudo[101244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-73386d64-93de-48f9-9e58-fa440da67b49 Jul 30 17:00:34 devstack sudo[101244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:34 devstack sudo[101244]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:34 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-91de0875-ce9b-44d5-8f4b-fa54e168578e tempest-TestImageHashVerification-1093437859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-73386d64-93de-48f9-9e58-fa440da67b49" returned: 0 in 0.578s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:34 devstack cinder-volume[88568]: DEBUG cinder.image.image_utils [None req-91de0875-ce9b-44d5-8f4b-fa54e168578e tempest-TestImageHashVerification-1093437859 None] Image conversion details: src /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-73386d64-93de-48f9-9e58-fa440da67b49, size 1024.00 MB, duration 4.92 sec, destination /opt/stack/data/cinder/conversion/73386d64-93de-48f9-9e58-fa440da67b49.temp_image.ca3d1073-8094-46e1-b73f-e82da2dac54dm58p3qp7.img {{(pid=88568) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 17:00:34 devstack cinder-volume[88568]: INFO cinder.image.image_utils [None req-91de0875-ce9b-44d5-8f4b-fa54e168578e tempest-TestImageHashVerification-1093437859 None] Converted 1024.00 MB image at 208.26 MB/s Jul 30 17:00:34 devstack cinder-volume[88568]: DEBUG cinder.image.image_utils [None req-91de0875-ce9b-44d5-8f4b-fa54e168578e tempest-TestImageHashVerification-1093437859 None] ca3d1073-8094-46e1-b73f-e82da2dac54d was raw, no need to convert to raw {{(pid=88568) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 30 17:00:35 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-099ea4ec-a726-4cfa-b35c-1e7167503d00 tempest-GroupSnapshotsTest-1016258839 None] GroupSnapshot 017743d9-d235-43fd-a2d1-d2c928510785: creating. Jul 30 17:00:35 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-099ea4ec-a726-4cfa-b35c-1e7167503d00 tempest-GroupSnapshotsTest-1016258839 None] Group snapshot 017743d9-d235-43fd-a2d1-d2c928510785: creating. {{(pid=88568) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 30 17:00:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-099ea4ec-a726-4cfa-b35c-1e7167503d00 tempest-GroupSnapshotsTest-1016258839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:00:39 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd5d90a5-81b9-468c-8603-b24538674fa4 tempest-VolumesCloneTest-1451008520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:00:39 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fd5d90a5-81b9-468c-8603-b24538674fa4 tempest-VolumesCloneTest-1451008520 None] Flow 'volume_create_manager' (6b115503-865e-481e-b156-9b3a3a6a209e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:00:39 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fd5d90a5-81b9-468c-8603-b24538674fa4 tempest-VolumesCloneTest-1451008520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8c68198-432f-4f62-9d50-583af1217783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:00:39 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fd5d90a5-81b9-468c-8603-b24538674fa4 tempest-VolumesCloneTest-1451008520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8c68198-432f-4f62-9d50-583af1217783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:00:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1214065873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d48f85dda3204a94b44cda3ebc5d7320',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:00:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:00:40Z,use_quota=True,user_id='922a0c06305145ba86ea83f31f085b1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:00:39 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fd5d90a5-81b9-468c-8603-b24538674fa4 tempest-VolumesCloneTest-1451008520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (541ffa06-7637-4b6f-8c9c-c8bb5cb48401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:00:39 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fd5d90a5-81b9-468c-8603-b24538674fa4 tempest-VolumesCloneTest-1451008520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (541ffa06-7637-4b6f-8c9c-c8bb5cb48401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:00:39 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fd5d90a5-81b9-468c-8603-b24538674fa4 tempest-VolumesCloneTest-1451008520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d68aa1c-c31a-457e-8c35-3acba86044fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:00:39 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fd5d90a5-81b9-468c-8603-b24538674fa4 tempest-VolumesCloneTest-1451008520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d68aa1c-c31a-457e-8c35-3acba86044fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b', 'volume_name': 'volume-f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:00:39 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fd5d90a5-81b9-468c-8603-b24538674fa4 tempest-VolumesCloneTest-1451008520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54230552-ab51-4958-a045-1632fe9eac2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:00:39 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fd5d90a5-81b9-468c-8603-b24538674fa4 tempest-VolumesCloneTest-1451008520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54230552-ab51-4958-a045-1632fe9eac2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:00:39 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fd5d90a5-81b9-468c-8603-b24538674fa4 tempest-VolumesCloneTest-1451008520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a45c825-5e8a-434d-bac3-5c8d18c2911d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:00:39 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-fd5d90a5-81b9-468c-8603-b24538674fa4 tempest-VolumesCloneTest-1451008520 None] Volume f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b', 'volume_size': 1} Jul 30 17:00:39 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-fd5d90a5-81b9-468c-8603-b24538674fa4 tempest-VolumesCloneTest-1451008520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:00:49 devstack cinder-volume[88568]: DEBUG dbcounter [-] [88568] Writing DB stats cinder:SELECT=27,cinder:UPDATE=18,cinder:INSERT=4 {{(pid=88568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 17:00:49 devstack cinder-volume[88568]: DEBUG dbcounter [-] [88568] Writing DB stats cinder:UPDATE=25,cinder:DELETE=4,cinder:INSERT=3,cinder:SELECT=20 {{(pid=88568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 17:00:52 devstack cinder-volume[88568]: DEBUG oslo_service.periodic_task [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 17:00:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:00:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:00:52 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:00:52 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:00:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:00:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:52 devstack sudo[101295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:00:52 devstack sudo[101295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:52 devstack sudo[101295]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.289s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:52 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:00:52 devstack cinder-volume[88568]: DEBUG oslo_service.periodic_task [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Running periodic task VolumeManager._thread_info {{(pid=88568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 17:00:52 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] thread count: 28 {{(pid=88568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 17:00:52 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] thread info: [<_MainThread(MainThread, started 127406866608256)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 17:00:53 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-91de0875-ce9b-44d5-8f4b-fa54e168578e tempest-TestImageHashVerification-1093437859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 25.301s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:00:53 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-91de0875-ce9b-44d5-8f4b-fa54e168578e tempest-TestImageHashVerification-1093437859 None] Uploaded volume to glance image-id: ca3d1073-8094-46e1-b73f-e82da2dac54d. {{(pid=88568) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 30 17:00:53 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-099ea4ec-a726-4cfa-b35c-1e7167503d00 tempest-GroupSnapshotsTest-1016258839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 18.541s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:00:53 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-099ea4ec-a726-4cfa-b35c-1e7167503d00 tempest-GroupSnapshotsTest-1016258839 None] Creating offline snapshot 522a5eb3-1a56-4743-b440-f34761630b6e of volume bab28edd-db76-441a-bc77-0fe42807b075 {{(pid=88568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:00:53 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-91de0875-ce9b-44d5-8f4b-fa54e168578e tempest-TestImageHashVerification-1093437859 None] Copy volume to image completed successfully. Jul 30 17:00:53 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d0a136-2af6-43fd-bfbb-856040b730a9]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:00:53 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-099ea4ec-a726-4cfa-b35c-1e7167503d00 tempest-GroupSnapshotsTest-1016258839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bab28edd-db76-441a-bc77-0fe42807b075 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:53 devstack sudo[101298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bab28edd-db76-441a-bc77-0fe42807b075 Jul 30 17:00:53 devstack sudo[101298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:54 devstack sudo[101298]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-099ea4ec-a726-4cfa-b35c-1e7167503d00 tempest-GroupSnapshotsTest-1016258839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bab28edd-db76-441a-bc77-0fe42807b075" returned: 0 in 0.405s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-099ea4ec-a726-4cfa-b35c-1e7167503d00 tempest-GroupSnapshotsTest-1016258839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bab28edd-db76-441a-bc77-0fe42807b075,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bab28edd-db76-441a-bc77-0fe42807b075.522a5eb3-1a56-4743-b440-f34761630b6e 1G {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:54 devstack sudo[101303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bab28edd-db76-441a-bc77-0fe42807b075,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bab28edd-db76-441a-bc77-0fe42807b075.522a5eb3-1a56-4743-b440-f34761630b6e 1G Jul 30 17:00:54 devstack sudo[101303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:54 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-dc40731d-62bd-489b-8ef5-4559ad3660da tempest-TestImageHashVerification-1093437859 None] Acquiring lock "cinder-73386d64-93de-48f9-9e58-fa440da67b49-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:00:54 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-dc40731d-62bd-489b-8ef5-4559ad3660da tempest-TestImageHashVerification-1093437859 None] Lock "cinder-73386d64-93de-48f9-9e58-fa440da67b49-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:00:54 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-dc40731d-62bd-489b-8ef5-4559ad3660da tempest-TestImageHashVerification-1093437859 None] Acquiring lock "cinder-quobyte-73386d64-93de-48f9-9e58-fa440da67b49" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:00:54 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-dc40731d-62bd-489b-8ef5-4559ad3660da tempest-TestImageHashVerification-1093437859 None] Lock "cinder-quobyte-73386d64-93de-48f9-9e58-fa440da67b49" acquired by "delete_volume" :: waited 0.020s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:00:54 devstack sudo[101303]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-099ea4ec-a726-4cfa-b35c-1e7167503d00 tempest-GroupSnapshotsTest-1016258839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bab28edd-db76-441a-bc77-0fe42807b075,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bab28edd-db76-441a-bc77-0fe42807b075.522a5eb3-1a56-4743-b440-f34761630b6e 1G" returned: 0 in 0.465s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-099ea4ec-a726-4cfa-b35c-1e7167503d00 tempest-GroupSnapshotsTest-1016258839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bab28edd-db76-441a-bc77-0fe42807b075 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bab28edd-db76-441a-bc77-0fe42807b075.522a5eb3-1a56-4743-b440-f34761630b6e {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:54 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4fc1a71-76a5-463a-a1b4-76abf71fe306]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:00:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-dc40731d-62bd-489b-8ef5-4559ad3660da tempest-TestImageHashVerification-1093437859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-73386d64-93de-48f9-9e58-fa440da67b49 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:54 devstack sudo[101308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bab28edd-db76-441a-bc77-0fe42807b075 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bab28edd-db76-441a-bc77-0fe42807b075.522a5eb3-1a56-4743-b440-f34761630b6e Jul 30 17:00:54 devstack sudo[101308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:54 devstack sudo[101309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-73386d64-93de-48f9-9e58-fa440da67b49 Jul 30 17:00:54 devstack sudo[101309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:54 devstack sudo[101308]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-099ea4ec-a726-4cfa-b35c-1e7167503d00 tempest-GroupSnapshotsTest-1016258839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bab28edd-db76-441a-bc77-0fe42807b075 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bab28edd-db76-441a-bc77-0fe42807b075.522a5eb3-1a56-4743-b440-f34761630b6e" returned: 0 in 0.331s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:54 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-099ea4ec-a726-4cfa-b35c-1e7167503d00 tempest-GroupSnapshotsTest-1016258839 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bab28edd-db76-441a-bc77-0fe42807b075.522a5eb3-1a56-4743-b440-f34761630b6e is being set with open permissions: ugo+rw: NotImplementedError Jul 30 17:00:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-099ea4ec-a726-4cfa-b35c-1e7167503d00 tempest-GroupSnapshotsTest-1016258839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bab28edd-db76-441a-bc77-0fe42807b075.522a5eb3-1a56-4743-b440-f34761630b6e {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:54 devstack sudo[101318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bab28edd-db76-441a-bc77-0fe42807b075.522a5eb3-1a56-4743-b440-f34761630b6e Jul 30 17:00:54 devstack sudo[101318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:55 devstack sudo[101309]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-dc40731d-62bd-489b-8ef5-4559ad3660da tempest-TestImageHashVerification-1093437859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-73386d64-93de-48f9-9e58-fa440da67b49" returned: 0 in 0.399s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-dc40731d-62bd-489b-8ef5-4559ad3660da tempest-TestImageHashVerification-1093437859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-73386d64-93de-48f9-9e58-fa440da67b49 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:55 devstack sudo[101321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-73386d64-93de-48f9-9e58-fa440da67b49 Jul 30 17:00:55 devstack sudo[101321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:55 devstack sudo[101318]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-099ea4ec-a726-4cfa-b35c-1e7167503d00 tempest-GroupSnapshotsTest-1016258839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bab28edd-db76-441a-bc77-0fe42807b075.522a5eb3-1a56-4743-b440-f34761630b6e" returned: 0 in 0.272s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-099ea4ec-a726-4cfa-b35c-1e7167503d00 tempest-GroupSnapshotsTest-1016258839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bab28edd-db76-441a-bc77-0fe42807b075.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:55 devstack sudo[101325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bab28edd-db76-441a-bc77-0fe42807b075.info Jul 30 17:00:55 devstack sudo[101325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:55 devstack sudo[101321]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-dc40731d-62bd-489b-8ef5-4559ad3660da tempest-TestImageHashVerification-1093437859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-73386d64-93de-48f9-9e58-fa440da67b49" returned: 0 in 0.250s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:55 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-dc40731d-62bd-489b-8ef5-4559ad3660da tempest-TestImageHashVerification-1093437859 None] Lock "cinder-quobyte-73386d64-93de-48f9-9e58-fa440da67b49" released by "delete_volume" :: held 0.698s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:00:55 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-dc40731d-62bd-489b-8ef5-4559ad3660da tempest-TestImageHashVerification-1093437859 None] Created reservations ['52a0ea88-2d77-4421-8a98-7590a5f44269', '9f2701c0-65a5-46b9-a00a-93f4f92862b9', 'e7622934-621f-4169-b46c-a07e82e9636d', 'c9873974-cb6c-4c57-82f3-6e6034513151'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:00:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-dc40731d-62bd-489b-8ef5-4559ad3660da tempest-TestImageHashVerification-1093437859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:00:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-dc40731d-62bd-489b-8ef5-4559ad3660da tempest-TestImageHashVerification-1093437859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:00:55 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-dc40731d-62bd-489b-8ef5-4559ad3660da tempest-TestImageHashVerification-1093437859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:00:55 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-dc40731d-62bd-489b-8ef5-4559ad3660da tempest-TestImageHashVerification-1093437859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:00:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-dc40731d-62bd-489b-8ef5-4559ad3660da tempest-TestImageHashVerification-1093437859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:00:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-dc40731d-62bd-489b-8ef5-4559ad3660da tempest-TestImageHashVerification-1093437859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:55 devstack sudo[101327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:00:55 devstack sudo[101327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:55 devstack sudo[101325]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-099ea4ec-a726-4cfa-b35c-1e7167503d00 tempest-GroupSnapshotsTest-1016258839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bab28edd-db76-441a-bc77-0fe42807b075.info" returned: 0 in 0.256s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:55 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-099ea4ec-a726-4cfa-b35c-1e7167503d00 tempest-GroupSnapshotsTest-1016258839 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bab28edd-db76-441a-bc77-0fe42807b075.info is being set with open permissions: ugo+rw: NotImplementedError Jul 30 17:00:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-099ea4ec-a726-4cfa-b35c-1e7167503d00 tempest-GroupSnapshotsTest-1016258839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bab28edd-db76-441a-bc77-0fe42807b075.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:55 devstack sudo[101330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bab28edd-db76-441a-bc77-0fe42807b075.info Jul 30 17:00:55 devstack sudo[101330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:55 devstack sudo[101327]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-dc40731d-62bd-489b-8ef5-4559ad3660da tempest-TestImageHashVerification-1093437859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.264s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:55 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-dc40731d-62bd-489b-8ef5-4559ad3660da tempest-TestImageHashVerification-1093437859 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:00:55 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-dc40731d-62bd-489b-8ef5-4559ad3660da tempest-TestImageHashVerification-1093437859 None] Deleted volume successfully. Jul 30 17:00:55 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-dc40731d-62bd-489b-8ef5-4559ad3660da tempest-TestImageHashVerification-1093437859 None] Lock "cinder-73386d64-93de-48f9-9e58-fa440da67b49-delete_volume" released by "delete_volume" :: held 1.198s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:00:55 devstack sudo[101330]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-099ea4ec-a726-4cfa-b35c-1e7167503d00 tempest-GroupSnapshotsTest-1016258839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bab28edd-db76-441a-bc77-0fe42807b075.info" returned: 0 in 0.280s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-099ea4ec-a726-4cfa-b35c-1e7167503d00 tempest-GroupSnapshotsTest-1016258839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.103s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:00:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-099ea4ec-a726-4cfa-b35c-1e7167503d00 tempest-GroupSnapshotsTest-1016258839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:00:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-099ea4ec-a726-4cfa-b35c-1e7167503d00 tempest-GroupSnapshotsTest-1016258839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:00:55 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-099ea4ec-a726-4cfa-b35c-1e7167503d00 tempest-GroupSnapshotsTest-1016258839 None] Creating offline snapshot e8e01dbb-55ba-4f5d-8699-8b2ecd6e1e4f of volume 51f31674-8c9c-4271-bede-e8823d6f5815 {{(pid=88568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:00:55 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[657784cd-a49e-42f3-85d5-f4abe211f4fd]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:00:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-099ea4ec-a726-4cfa-b35c-1e7167503d00 tempest-GroupSnapshotsTest-1016258839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-51f31674-8c9c-4271-bede-e8823d6f5815 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:55 devstack sudo[101334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-51f31674-8c9c-4271-bede-e8823d6f5815 Jul 30 17:00:55 devstack sudo[101334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:56 devstack sudo[101334]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-099ea4ec-a726-4cfa-b35c-1e7167503d00 tempest-GroupSnapshotsTest-1016258839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-51f31674-8c9c-4271-bede-e8823d6f5815" returned: 0 in 0.370s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-099ea4ec-a726-4cfa-b35c-1e7167503d00 tempest-GroupSnapshotsTest-1016258839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-51f31674-8c9c-4271-bede-e8823d6f5815,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-51f31674-8c9c-4271-bede-e8823d6f5815.e8e01dbb-55ba-4f5d-8699-8b2ecd6e1e4f 1G {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:56 devstack sudo[101339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-51f31674-8c9c-4271-bede-e8823d6f5815,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-51f31674-8c9c-4271-bede-e8823d6f5815.e8e01dbb-55ba-4f5d-8699-8b2ecd6e1e4f 1G Jul 30 17:00:56 devstack sudo[101339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:56 devstack sudo[101339]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-099ea4ec-a726-4cfa-b35c-1e7167503d00 tempest-GroupSnapshotsTest-1016258839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-51f31674-8c9c-4271-bede-e8823d6f5815,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-51f31674-8c9c-4271-bede-e8823d6f5815.e8e01dbb-55ba-4f5d-8699-8b2ecd6e1e4f 1G" returned: 0 in 0.466s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-099ea4ec-a726-4cfa-b35c-1e7167503d00 tempest-GroupSnapshotsTest-1016258839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51f31674-8c9c-4271-bede-e8823d6f5815 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-51f31674-8c9c-4271-bede-e8823d6f5815.e8e01dbb-55ba-4f5d-8699-8b2ecd6e1e4f {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:56 devstack sudo[101345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51f31674-8c9c-4271-bede-e8823d6f5815 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-51f31674-8c9c-4271-bede-e8823d6f5815.e8e01dbb-55ba-4f5d-8699-8b2ecd6e1e4f Jul 30 17:00:56 devstack sudo[101345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:56 devstack sudo[101345]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-099ea4ec-a726-4cfa-b35c-1e7167503d00 tempest-GroupSnapshotsTest-1016258839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51f31674-8c9c-4271-bede-e8823d6f5815 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-51f31674-8c9c-4271-bede-e8823d6f5815.e8e01dbb-55ba-4f5d-8699-8b2ecd6e1e4f" returned: 0 in 0.302s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:56 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-099ea4ec-a726-4cfa-b35c-1e7167503d00 tempest-GroupSnapshotsTest-1016258839 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-51f31674-8c9c-4271-bede-e8823d6f5815.e8e01dbb-55ba-4f5d-8699-8b2ecd6e1e4f is being set with open permissions: ugo+rw: NotImplementedError Jul 30 17:00:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-099ea4ec-a726-4cfa-b35c-1e7167503d00 tempest-GroupSnapshotsTest-1016258839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-51f31674-8c9c-4271-bede-e8823d6f5815.e8e01dbb-55ba-4f5d-8699-8b2ecd6e1e4f {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:57 devstack sudo[101350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-51f31674-8c9c-4271-bede-e8823d6f5815.e8e01dbb-55ba-4f5d-8699-8b2ecd6e1e4f Jul 30 17:00:57 devstack sudo[101350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:57 devstack sudo[101350]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-099ea4ec-a726-4cfa-b35c-1e7167503d00 tempest-GroupSnapshotsTest-1016258839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-51f31674-8c9c-4271-bede-e8823d6f5815.e8e01dbb-55ba-4f5d-8699-8b2ecd6e1e4f" returned: 0 in 0.282s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-099ea4ec-a726-4cfa-b35c-1e7167503d00 tempest-GroupSnapshotsTest-1016258839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-51f31674-8c9c-4271-bede-e8823d6f5815.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:57 devstack sudo[101354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-51f31674-8c9c-4271-bede-e8823d6f5815.info Jul 30 17:00:57 devstack sudo[101354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:57 devstack sudo[101354]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-099ea4ec-a726-4cfa-b35c-1e7167503d00 tempest-GroupSnapshotsTest-1016258839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-51f31674-8c9c-4271-bede-e8823d6f5815.info" returned: 0 in 0.297s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:57 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-099ea4ec-a726-4cfa-b35c-1e7167503d00 tempest-GroupSnapshotsTest-1016258839 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-51f31674-8c9c-4271-bede-e8823d6f5815.info is being set with open permissions: ugo+rw: NotImplementedError Jul 30 17:00:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-099ea4ec-a726-4cfa-b35c-1e7167503d00 tempest-GroupSnapshotsTest-1016258839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-51f31674-8c9c-4271-bede-e8823d6f5815.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:57 devstack sudo[101357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-51f31674-8c9c-4271-bede-e8823d6f5815.info Jul 30 17:00:57 devstack sudo[101357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:57 devstack sudo[101357]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-099ea4ec-a726-4cfa-b35c-1e7167503d00 tempest-GroupSnapshotsTest-1016258839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-51f31674-8c9c-4271-bede-e8823d6f5815.info" returned: 0 in 0.250s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-099ea4ec-a726-4cfa-b35c-1e7167503d00 tempest-GroupSnapshotsTest-1016258839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.062s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:00:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-fd5d90a5-81b9-468c-8603-b24538674fa4 tempest-VolumesCloneTest-1451008520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.209s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:00:57 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-fd5d90a5-81b9-468c-8603-b24538674fa4 tempest-VolumesCloneTest-1451008520 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:00:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1214065873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d48f85dda3204a94b44cda3ebc5d7320',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:00:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:00:40Z,use_quota=True,user_id='922a0c06305145ba86ea83f31f085b1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:00:57 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-fd5d90a5-81b9-468c-8603-b24538674fa4 tempest-VolumesCloneTest-1451008520 None] Creating volume f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:00:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-fd5d90a5-81b9-468c-8603-b24538674fa4 tempest-VolumesCloneTest-1451008520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:00:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-fd5d90a5-81b9-468c-8603-b24538674fa4 tempest-VolumesCloneTest-1451008520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:00:57 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-fd5d90a5-81b9-468c-8603-b24538674fa4 tempest-VolumesCloneTest-1451008520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:00:57 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-fd5d90a5-81b9-468c-8603-b24538674fa4 tempest-VolumesCloneTest-1451008520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:00:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-fd5d90a5-81b9-468c-8603-b24538674fa4 tempest-VolumesCloneTest-1451008520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:00:57 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-fd5d90a5-81b9-468c-8603-b24538674fa4 tempest-VolumesCloneTest-1451008520 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:00:57 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-fd5d90a5-81b9-468c-8603-b24538674fa4 tempest-VolumesCloneTest-1451008520 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:00:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fd5d90a5-81b9-468c-8603-b24538674fa4 tempest-VolumesCloneTest-1451008520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:57 devstack sudo[101360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b 1073741824 Jul 30 17:00:57 devstack sudo[101360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:58 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-099ea4ec-a726-4cfa-b35c-1e7167503d00 tempest-GroupSnapshotsTest-1016258839 None] group_snapshot 017743d9-d235-43fd-a2d1-d2c928510785: created successfully Jul 30 17:00:58 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-125546d4-7df3-4160-a25e-7ae3166f075b tempest-GroupSnapshotsTest-1016258839 None] group_snapshot 017743d9-d235-43fd-a2d1-d2c928510785: deleting Jul 30 17:00:58 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-125546d4-7df3-4160-a25e-7ae3166f075b tempest-GroupSnapshotsTest-1016258839 None] group_snapshot 017743d9-d235-43fd-a2d1-d2c928510785: deleting {{(pid=88568) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 30 17:00:58 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-125546d4-7df3-4160-a25e-7ae3166f075b tempest-GroupSnapshotsTest-1016258839 None] Acquiring lock "cinder-quobyte-bab28edd-db76-441a-bc77-0fe42807b075" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:00:58 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-125546d4-7df3-4160-a25e-7ae3166f075b tempest-GroupSnapshotsTest-1016258839 None] Lock "cinder-quobyte-bab28edd-db76-441a-bc77-0fe42807b075" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:00:58 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-125546d4-7df3-4160-a25e-7ae3166f075b tempest-GroupSnapshotsTest-1016258839 None] Acquiring lock "cinder-quobyte-522a5eb3-1a56-4743-b440-f34761630b6e" by "_delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:00:58 devstack sudo[101360]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:58 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-125546d4-7df3-4160-a25e-7ae3166f075b tempest-GroupSnapshotsTest-1016258839 None] Lock "cinder-quobyte-522a5eb3-1a56-4743-b440-f34761630b6e" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:00:58 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-125546d4-7df3-4160-a25e-7ae3166f075b tempest-GroupSnapshotsTest-1016258839 None] Deleting offline snapshot 522a5eb3-1a56-4743-b440-f34761630b6e of volume bab28edd-db76-441a-bc77-0fe42807b075 {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:00:58 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-125546d4-7df3-4160-a25e-7ae3166f075b tempest-GroupSnapshotsTest-1016258839 None] snapshot_file for this snap is: volume-bab28edd-db76-441a-bc77-0fe42807b075.522a5eb3-1a56-4743-b440-f34761630b6e {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:00:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fd5d90a5-81b9-468c-8603-b24538674fa4 tempest-VolumesCloneTest-1451008520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b 1073741824" returned: 0 in 0.740s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:58 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed0b52a7-26dd-40b6-bd48-616764f8711e]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:00:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-125546d4-7df3-4160-a25e-7ae3166f075b tempest-GroupSnapshotsTest-1016258839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bab28edd-db76-441a-bc77-0fe42807b075.522a5eb3-1a56-4743-b440-f34761630b6e {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fd5d90a5-81b9-468c-8603-b24538674fa4 tempest-VolumesCloneTest-1451008520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:58 devstack sudo[101368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b Jul 30 17:00:58 devstack sudo[101368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:58 devstack sudo[101367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bab28edd-db76-441a-bc77-0fe42807b075.522a5eb3-1a56-4743-b440-f34761630b6e Jul 30 17:00:58 devstack sudo[101367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:59 devstack sudo[101368]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fd5d90a5-81b9-468c-8603-b24538674fa4 tempest-VolumesCloneTest-1451008520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b" returned: 0 in 0.301s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:59 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-fd5d90a5-81b9-468c-8603-b24538674fa4 tempest-VolumesCloneTest-1451008520 None] <== create_volume: return (1174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:00:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-fd5d90a5-81b9-468c-8603-b24538674fa4 tempest-VolumesCloneTest-1451008520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.178s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:00:59 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fd5d90a5-81b9-468c-8603-b24538674fa4 tempest-VolumesCloneTest-1451008520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a45c825-5e8a-434d-bac3-5c8d18c2911d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:00:59 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fd5d90a5-81b9-468c-8603-b24538674fa4 tempest-VolumesCloneTest-1451008520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (936586d0-846e-4037-8f91-10524de5d860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:00:59 devstack sudo[101367]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:59 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-fd5d90a5-81b9-468c-8603-b24538674fa4 tempest-VolumesCloneTest-1451008520 None] Volume volume-f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b (f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b): created successfully Jul 30 17:00:59 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fd5d90a5-81b9-468c-8603-b24538674fa4 tempest-VolumesCloneTest-1451008520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (936586d0-846e-4037-8f91-10524de5d860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:00:59 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fd5d90a5-81b9-468c-8603-b24538674fa4 tempest-VolumesCloneTest-1451008520 None] Flow 'volume_create_manager' (6b115503-865e-481e-b156-9b3a3a6a209e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:00:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-125546d4-7df3-4160-a25e-7ae3166f075b tempest-GroupSnapshotsTest-1016258839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bab28edd-db76-441a-bc77-0fe42807b075.522a5eb3-1a56-4743-b440-f34761630b6e" returned: 0 in 0.449s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:59 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-125546d4-7df3-4160-a25e-7ae3166f075b tempest-GroupSnapshotsTest-1016258839 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bab28edd-db76-441a-bc77-0fe42807b075(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:00:59 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-fd5d90a5-81b9-468c-8603-b24538674fa4 tempest-VolumesCloneTest-1451008520 None] Created volume successfully. Jul 30 17:00:59 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6ab881-55e8-4816-a572-5ee972dc83b3]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:00:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-125546d4-7df3-4160-a25e-7ae3166f075b tempest-GroupSnapshotsTest-1016258839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bab28edd-db76-441a-bc77-0fe42807b075 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:59 devstack sudo[101376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bab28edd-db76-441a-bc77-0fe42807b075 Jul 30 17:00:59 devstack sudo[101376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:59 devstack sudo[101376]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-125546d4-7df3-4160-a25e-7ae3166f075b tempest-GroupSnapshotsTest-1016258839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bab28edd-db76-441a-bc77-0fe42807b075" returned: 0 in 0.393s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-125546d4-7df3-4160-a25e-7ae3166f075b tempest-GroupSnapshotsTest-1016258839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bab28edd-db76-441a-bc77-0fe42807b075.522a5eb3-1a56-4743-b440-f34761630b6e {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:59 devstack sudo[101382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bab28edd-db76-441a-bc77-0fe42807b075.522a5eb3-1a56-4743-b440-f34761630b6e Jul 30 17:00:59 devstack sudo[101382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:59 devstack sudo[101382]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-125546d4-7df3-4160-a25e-7ae3166f075b tempest-GroupSnapshotsTest-1016258839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bab28edd-db76-441a-bc77-0fe42807b075.522a5eb3-1a56-4743-b440-f34761630b6e" returned: 0 in 0.416s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-125546d4-7df3-4160-a25e-7ae3166f075b tempest-GroupSnapshotsTest-1016258839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bab28edd-db76-441a-bc77-0fe42807b075.522a5eb3-1a56-4743-b440-f34761630b6e {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:59 devstack sudo[101387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bab28edd-db76-441a-bc77-0fe42807b075.522a5eb3-1a56-4743-b440-f34761630b6e Jul 30 17:00:59 devstack sudo[101387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:00 devstack sudo[101387]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:00 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-125546d4-7df3-4160-a25e-7ae3166f075b tempest-GroupSnapshotsTest-1016258839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bab28edd-db76-441a-bc77-0fe42807b075.522a5eb3-1a56-4743-b440-f34761630b6e" returned: 0 in 0.297s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:00 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-125546d4-7df3-4160-a25e-7ae3166f075b tempest-GroupSnapshotsTest-1016258839 None] Lock "cinder-quobyte-522a5eb3-1a56-4743-b440-f34761630b6e" released by "_delete_snapshot" :: held 1.754s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:01:00 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-125546d4-7df3-4160-a25e-7ae3166f075b tempest-GroupSnapshotsTest-1016258839 None] Lock "cinder-quobyte-bab28edd-db76-441a-bc77-0fe42807b075" released by "delete_snapshot" :: held 1.812s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:01:00 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-125546d4-7df3-4160-a25e-7ae3166f075b tempest-GroupSnapshotsTest-1016258839 None] Acquiring lock "cinder-quobyte-51f31674-8c9c-4271-bede-e8823d6f5815" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:01:00 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-125546d4-7df3-4160-a25e-7ae3166f075b tempest-GroupSnapshotsTest-1016258839 None] Lock "cinder-quobyte-51f31674-8c9c-4271-bede-e8823d6f5815" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:01:00 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-125546d4-7df3-4160-a25e-7ae3166f075b tempest-GroupSnapshotsTest-1016258839 None] Acquiring lock "cinder-quobyte-e8e01dbb-55ba-4f5d-8699-8b2ecd6e1e4f" by "_delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:01:00 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-125546d4-7df3-4160-a25e-7ae3166f075b tempest-GroupSnapshotsTest-1016258839 None] Lock "cinder-quobyte-e8e01dbb-55ba-4f5d-8699-8b2ecd6e1e4f" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:01:00 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-125546d4-7df3-4160-a25e-7ae3166f075b tempest-GroupSnapshotsTest-1016258839 None] Deleting offline snapshot e8e01dbb-55ba-4f5d-8699-8b2ecd6e1e4f of volume 51f31674-8c9c-4271-bede-e8823d6f5815 {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:01:00 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-125546d4-7df3-4160-a25e-7ae3166f075b tempest-GroupSnapshotsTest-1016258839 None] snapshot_file for this snap is: volume-51f31674-8c9c-4271-bede-e8823d6f5815.e8e01dbb-55ba-4f5d-8699-8b2ecd6e1e4f {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:01:00 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e61036-8f22-4827-ae79-edff0b129421]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:01:00 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-125546d4-7df3-4160-a25e-7ae3166f075b tempest-GroupSnapshotsTest-1016258839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-51f31674-8c9c-4271-bede-e8823d6f5815.e8e01dbb-55ba-4f5d-8699-8b2ecd6e1e4f {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:00 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-8aacfd63-9005-44b5-8798-a6fc2e3dfaaa tempest-VolumesCloneTest-1451008520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:01:00 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8aacfd63-9005-44b5-8798-a6fc2e3dfaaa tempest-VolumesCloneTest-1451008520 None] Flow 'volume_create_manager' (81603064-3278-4b9f-aa1d-94d2cfcf6e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:01:00 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8aacfd63-9005-44b5-8798-a6fc2e3dfaaa tempest-VolumesCloneTest-1451008520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2de61b2e-4183-46e1-acff-19977e473f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:00 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8aacfd63-9005-44b5-8798-a6fc2e3dfaaa tempest-VolumesCloneTest-1451008520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2de61b2e-4183-46e1-acff-19977e473f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:01:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-856875116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bc71622-1681-4b59-b547-8f06de2f89df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d48f85dda3204a94b44cda3ebc5d7320',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:01:00Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b,status='creating',terminated_at=None,updated_at=2026-07-30T15:01:00Z,use_quota=True,user_id='922a0c06305145ba86ea83f31f085b1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:00 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8aacfd63-9005-44b5-8798-a6fc2e3dfaaa tempest-VolumesCloneTest-1451008520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2c1f58b-5c48-4d70-80b1-0a9ab32c0ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:00 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8aacfd63-9005-44b5-8798-a6fc2e3dfaaa tempest-VolumesCloneTest-1451008520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2c1f58b-5c48-4d70-80b1-0a9ab32c0ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:00 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8aacfd63-9005-44b5-8798-a6fc2e3dfaaa tempest-VolumesCloneTest-1451008520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c2b2de0-e7e6-4c51-b7cc-d9b40dd20056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:00 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8aacfd63-9005-44b5-8798-a6fc2e3dfaaa tempest-VolumesCloneTest-1451008520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c2b2de0-e7e6-4c51-b7cc-d9b40dd20056) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '1bc71622-1681-4b59-b547-8f06de2f89df', 'volume_name': 'volume-1bc71622-1681-4b59-b547-8f06de2f89df', 'volume_size': 2, 'source_volid': 'f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b', 'source_volstatus': 'available'}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:00 devstack sudo[101390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-51f31674-8c9c-4271-bede-e8823d6f5815.e8e01dbb-55ba-4f5d-8699-8b2ecd6e1e4f Jul 30 17:01:00 devstack sudo[101390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:00 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8aacfd63-9005-44b5-8798-a6fc2e3dfaaa tempest-VolumesCloneTest-1451008520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b36492a5-abc5-4ab7-ab22-ff3ee6ecff3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:00 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8aacfd63-9005-44b5-8798-a6fc2e3dfaaa tempest-VolumesCloneTest-1451008520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b36492a5-abc5-4ab7-ab22-ff3ee6ecff3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:00 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8aacfd63-9005-44b5-8798-a6fc2e3dfaaa tempest-VolumesCloneTest-1451008520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ac8b7c0-8048-493c-979b-ad4a4f893b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:00 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-8aacfd63-9005-44b5-8798-a6fc2e3dfaaa tempest-VolumesCloneTest-1451008520 None] Volume 1bc71622-1681-4b59-b547-8f06de2f89df: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-1bc71622-1681-4b59-b547-8f06de2f89df', 'volume_size': 2, 'source_volid': 'f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b', 'source_volstatus': 'available'} Jul 30 17:01:00 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-8aacfd63-9005-44b5-8798-a6fc2e3dfaaa tempest-VolumesCloneTest-1451008520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:01:00 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-8aacfd63-9005-44b5-8798-a6fc2e3dfaaa tempest-VolumesCloneTest-1451008520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:01:00 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-8aacfd63-9005-44b5-8798-a6fc2e3dfaaa tempest-VolumesCloneTest-1451008520 None] Cloning volume f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b to volume 1bc71622-1681-4b59-b547-8f06de2f89df Jul 30 17:01:00 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-8aacfd63-9005-44b5-8798-a6fc2e3dfaaa tempest-VolumesCloneTest-1451008520 None] Creating offline snapshot 1fbf6405-d388-41b3-a310-63fe9c242529 of volume f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b {{(pid=88568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:01:00 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb6f6b46-309c-4183-85be-fb5c4439c9c9]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:01:00 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8aacfd63-9005-44b5-8798-a6fc2e3dfaaa tempest-VolumesCloneTest-1451008520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:00 devstack sudo[101392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b Jul 30 17:01:00 devstack sudo[101392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:00 devstack sudo[101390]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:00 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-125546d4-7df3-4160-a25e-7ae3166f075b tempest-GroupSnapshotsTest-1016258839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-51f31674-8c9c-4271-bede-e8823d6f5815.e8e01dbb-55ba-4f5d-8699-8b2ecd6e1e4f" returned: 0 in 0.479s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:00 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-125546d4-7df3-4160-a25e-7ae3166f075b tempest-GroupSnapshotsTest-1016258839 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51f31674-8c9c-4271-bede-e8823d6f5815(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:01:00 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b8d602-1ed7-47a9-ad5e-97d6480c7810]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:01:00 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-125546d4-7df3-4160-a25e-7ae3166f075b tempest-GroupSnapshotsTest-1016258839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-51f31674-8c9c-4271-bede-e8823d6f5815 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:01 devstack sudo[101397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-51f31674-8c9c-4271-bede-e8823d6f5815 Jul 30 17:01:01 devstack sudo[101397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:01 devstack sudo[101392]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8aacfd63-9005-44b5-8798-a6fc2e3dfaaa tempest-VolumesCloneTest-1451008520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b" returned: 0 in 0.423s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8aacfd63-9005-44b5-8798-a6fc2e3dfaaa tempest-VolumesCloneTest-1451008520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b.1fbf6405-d388-41b3-a310-63fe9c242529 1G {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:01 devstack sudo[101402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b.1fbf6405-d388-41b3-a310-63fe9c242529 1G Jul 30 17:01:01 devstack sudo[101402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:01 devstack sudo[101397]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-125546d4-7df3-4160-a25e-7ae3166f075b tempest-GroupSnapshotsTest-1016258839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-51f31674-8c9c-4271-bede-e8823d6f5815" returned: 0 in 0.388s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-125546d4-7df3-4160-a25e-7ae3166f075b tempest-GroupSnapshotsTest-1016258839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-51f31674-8c9c-4271-bede-e8823d6f5815.e8e01dbb-55ba-4f5d-8699-8b2ecd6e1e4f {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:01 devstack sudo[101408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-51f31674-8c9c-4271-bede-e8823d6f5815.e8e01dbb-55ba-4f5d-8699-8b2ecd6e1e4f Jul 30 17:01:01 devstack sudo[101408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:01 devstack sudo[101402]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8aacfd63-9005-44b5-8798-a6fc2e3dfaaa tempest-VolumesCloneTest-1451008520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b.1fbf6405-d388-41b3-a310-63fe9c242529 1G" returned: 0 in 0.570s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8aacfd63-9005-44b5-8798-a6fc2e3dfaaa tempest-VolumesCloneTest-1451008520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b.1fbf6405-d388-41b3-a310-63fe9c242529 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:01 devstack sudo[101417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b.1fbf6405-d388-41b3-a310-63fe9c242529 Jul 30 17:01:01 devstack sudo[101417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:01 devstack sudo[101408]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-125546d4-7df3-4160-a25e-7ae3166f075b tempest-GroupSnapshotsTest-1016258839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-51f31674-8c9c-4271-bede-e8823d6f5815.e8e01dbb-55ba-4f5d-8699-8b2ecd6e1e4f" returned: 0 in 0.475s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-125546d4-7df3-4160-a25e-7ae3166f075b tempest-GroupSnapshotsTest-1016258839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-51f31674-8c9c-4271-bede-e8823d6f5815.e8e01dbb-55ba-4f5d-8699-8b2ecd6e1e4f {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:01 devstack sudo[101419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-51f31674-8c9c-4271-bede-e8823d6f5815.e8e01dbb-55ba-4f5d-8699-8b2ecd6e1e4f Jul 30 17:01:01 devstack sudo[101419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:02 devstack sudo[101417]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8aacfd63-9005-44b5-8798-a6fc2e3dfaaa tempest-VolumesCloneTest-1451008520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b.1fbf6405-d388-41b3-a310-63fe9c242529" returned: 0 in 0.343s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:02 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-8aacfd63-9005-44b5-8798-a6fc2e3dfaaa tempest-VolumesCloneTest-1451008520 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b.1fbf6405-d388-41b3-a310-63fe9c242529 is being set with open permissions: ugo+rw Jul 30 17:01:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8aacfd63-9005-44b5-8798-a6fc2e3dfaaa tempest-VolumesCloneTest-1451008520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b.1fbf6405-d388-41b3-a310-63fe9c242529 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:02 devstack sudo[101425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b.1fbf6405-d388-41b3-a310-63fe9c242529 Jul 30 17:01:02 devstack sudo[101425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:02 devstack sudo[101419]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-125546d4-7df3-4160-a25e-7ae3166f075b tempest-GroupSnapshotsTest-1016258839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-51f31674-8c9c-4271-bede-e8823d6f5815.e8e01dbb-55ba-4f5d-8699-8b2ecd6e1e4f" returned: 0 in 0.307s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:02 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-125546d4-7df3-4160-a25e-7ae3166f075b tempest-GroupSnapshotsTest-1016258839 None] Lock "cinder-quobyte-e8e01dbb-55ba-4f5d-8699-8b2ecd6e1e4f" released by "_delete_snapshot" :: held 1.778s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:01:02 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-125546d4-7df3-4160-a25e-7ae3166f075b tempest-GroupSnapshotsTest-1016258839 None] Lock "cinder-quobyte-51f31674-8c9c-4271-bede-e8823d6f5815" released by "delete_snapshot" :: held 1.810s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:01:02 devstack cinder-volume[88568]: WARNING cinder.quota [None req-125546d4-7df3-4160-a25e-7ae3166f075b tempest-GroupSnapshotsTest-1016258839 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2050492512 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2050492512, it is now deprecated. Please use the default quota class for default quota. Jul 30 17:01:02 devstack cinder-volume[88568]: WARNING cinder.quota [None req-125546d4-7df3-4160-a25e-7ae3166f075b tempest-GroupSnapshotsTest-1016258839 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2050492512 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2050492512, it is now deprecated. Please use the default quota class for default quota. Jul 30 17:01:02 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-125546d4-7df3-4160-a25e-7ae3166f075b tempest-GroupSnapshotsTest-1016258839 None] Created reservations ['f4191378-aae5-4c73-94d9-4ad7bea9bb9d', '2d3ddc2f-ea75-4947-b609-59b50f392601', '47818d41-91a9-4bef-9676-110a7573ed67', 'e0afe7c6-5318-44bb-b8be-ea6c6b09c9c4'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:01:02 devstack sudo[101425]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8aacfd63-9005-44b5-8798-a6fc2e3dfaaa tempest-VolumesCloneTest-1451008520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b.1fbf6405-d388-41b3-a310-63fe9c242529" returned: 0 in 0.262s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8aacfd63-9005-44b5-8798-a6fc2e3dfaaa tempest-VolumesCloneTest-1451008520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:02 devstack sudo[101429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b.info Jul 30 17:01:02 devstack sudo[101429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:02 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-125546d4-7df3-4160-a25e-7ae3166f075b tempest-GroupSnapshotsTest-1016258839 None] Created reservations ['32998c9b-647c-4fd3-80fd-1c85fba0fbe3', '21833857-b280-47f6-8bb6-f483db56a684', '4e2c52c8-e5ff-4f5b-b74e-3e971c0a4312', '0715986b-5c1f-430d-a65b-cc966f98832f'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:01:02 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-125546d4-7df3-4160-a25e-7ae3166f075b tempest-GroupSnapshotsTest-1016258839 None] group_snapshot 017743d9-d235-43fd-a2d1-d2c928510785: deleted successfully Jul 30 17:01:02 devstack sudo[101429]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8aacfd63-9005-44b5-8798-a6fc2e3dfaaa tempest-VolumesCloneTest-1451008520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b.info" returned: 0 in 0.295s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:02 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-8aacfd63-9005-44b5-8798-a6fc2e3dfaaa tempest-VolumesCloneTest-1451008520 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b.info is being set with open permissions: ugo+rw Jul 30 17:01:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8aacfd63-9005-44b5-8798-a6fc2e3dfaaa tempest-VolumesCloneTest-1451008520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:02 devstack sudo[101432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b.info Jul 30 17:01:02 devstack sudo[101432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:02 devstack sudo[101432]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8aacfd63-9005-44b5-8798-a6fc2e3dfaaa tempest-VolumesCloneTest-1451008520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b.info" returned: 0 in 0.325s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:02 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-8aacfd63-9005-44b5-8798-a6fc2e3dfaaa tempest-VolumesCloneTest-1451008520 None] Acquiring lock "cinder-quobyte-1bc71622-1681-4b59-b547-8f06de2f89df" by "_copy_volume_from_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:01:02 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-8aacfd63-9005-44b5-8798-a6fc2e3dfaaa tempest-VolumesCloneTest-1451008520 None] Lock "cinder-quobyte-1bc71622-1681-4b59-b547-8f06de2f89df" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:01:02 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-8aacfd63-9005-44b5-8798-a6fc2e3dfaaa tempest-VolumesCloneTest-1451008520 None] snapshot: 1fbf6405-d388-41b3-a310-63fe9c242529, volume: 1bc71622-1681-4b59-b547-8f06de2f89df, {{(pid=88568) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 30 17:01:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-8aacfd63-9005-44b5-8798-a6fc2e3dfaaa tempest-VolumesCloneTest-1451008520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:01:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-8aacfd63-9005-44b5-8798-a6fc2e3dfaaa tempest-VolumesCloneTest-1451008520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:01:02 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-8aacfd63-9005-44b5-8798-a6fc2e3dfaaa tempest-VolumesCloneTest-1451008520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:01:03 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-8aacfd63-9005-44b5-8798-a6fc2e3dfaaa tempest-VolumesCloneTest-1451008520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:01:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-8aacfd63-9005-44b5-8798-a6fc2e3dfaaa tempest-VolumesCloneTest-1451008520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:01:03 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[e85f8a83-61a1-42b1-8606-d4221e8678c6]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:01:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8aacfd63-9005-44b5-8798-a6fc2e3dfaaa tempest-VolumesCloneTest-1451008520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b.1fbf6405-d388-41b3-a310-63fe9c242529 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:03 devstack sudo[101435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b.1fbf6405-d388-41b3-a310-63fe9c242529 Jul 30 17:01:03 devstack sudo[101435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:03 devstack sudo[101435]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8aacfd63-9005-44b5-8798-a6fc2e3dfaaa tempest-VolumesCloneTest-1451008520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b.1fbf6405-d388-41b3-a310-63fe9c242529" returned: 0 in 0.422s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:03 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-8aacfd63-9005-44b5-8798-a6fc2e3dfaaa tempest-VolumesCloneTest-1451008520 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:01:03 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a648848-09ec-44d7-b83d-33fe5cf555b5]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:01:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8aacfd63-9005-44b5-8798-a6fc2e3dfaaa tempest-VolumesCloneTest-1451008520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:03 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-0097bdb6-a8ac-4b4e-9e25-54d17702033c tempest-GroupSnapshotsTest-1016258839 None] Acquiring lock "cinder-quobyte-51f31674-8c9c-4271-bede-e8823d6f5815" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:01:03 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-0097bdb6-a8ac-4b4e-9e25-54d17702033c tempest-GroupSnapshotsTest-1016258839 None] Lock "cinder-quobyte-51f31674-8c9c-4271-bede-e8823d6f5815" acquired by "delete_volume" :: waited 0.025s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:01:03 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b3ba71-2ff1-41a5-b864-f93e438608aa]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:01:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0097bdb6-a8ac-4b4e-9e25-54d17702033c tempest-GroupSnapshotsTest-1016258839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-51f31674-8c9c-4271-bede-e8823d6f5815 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:03 devstack sudo[101440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b Jul 30 17:01:03 devstack sudo[101440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:03 devstack sudo[101441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-51f31674-8c9c-4271-bede-e8823d6f5815 Jul 30 17:01:03 devstack sudo[101441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:04 devstack sudo[101440]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8aacfd63-9005-44b5-8798-a6fc2e3dfaaa tempest-VolumesCloneTest-1451008520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b" returned: 0 in 0.536s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:04 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-8aacfd63-9005-44b5-8798-a6fc2e3dfaaa tempest-VolumesCloneTest-1451008520 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b {{(pid=88568) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 30 17:01:04 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-8aacfd63-9005-44b5-8798-a6fc2e3dfaaa tempest-VolumesCloneTest-1451008520 None] Creating direct copy from snapshot {{(pid=88568) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 30 17:01:04 devstack cinder-volume[88568]: DEBUG cinder.utils [None req-8aacfd63-9005-44b5-8798-a6fc2e3dfaaa tempest-VolumesCloneTest-1451008520 None] Path /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-1bc71622-1681-4b59-b547-8f06de2f89df not found in is_blk_device check {{(pid=88568) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 30 17:01:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8aacfd63-9005-44b5-8798-a6fc2e3dfaaa tempest-VolumesCloneTest-1451008520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-1bc71622-1681-4b59-b547-8f06de2f89df {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:04 devstack sudo[101451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-1bc71622-1681-4b59-b547-8f06de2f89df Jul 30 17:01:04 devstack sudo[101451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:04 devstack sudo[101441]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0097bdb6-a8ac-4b4e-9e25-54d17702033c tempest-GroupSnapshotsTest-1016258839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-51f31674-8c9c-4271-bede-e8823d6f5815" returned: 0 in 0.481s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0097bdb6-a8ac-4b4e-9e25-54d17702033c tempest-GroupSnapshotsTest-1016258839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-51f31674-8c9c-4271-bede-e8823d6f5815 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:04 devstack sudo[101453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-51f31674-8c9c-4271-bede-e8823d6f5815 Jul 30 17:01:04 devstack sudo[101453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:04 devstack sudo[101453]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0097bdb6-a8ac-4b4e-9e25-54d17702033c tempest-GroupSnapshotsTest-1016258839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-51f31674-8c9c-4271-bede-e8823d6f5815" returned: 0 in 0.315s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:04 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-0097bdb6-a8ac-4b4e-9e25-54d17702033c tempest-GroupSnapshotsTest-1016258839 None] Lock "cinder-quobyte-51f31674-8c9c-4271-bede-e8823d6f5815" released by "delete_volume" :: held 0.917s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:01:04 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-0097bdb6-a8ac-4b4e-9e25-54d17702033c tempest-GroupSnapshotsTest-1016258839 None] Acquiring lock "cinder-quobyte-bab28edd-db76-441a-bc77-0fe42807b075" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:01:04 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-0097bdb6-a8ac-4b4e-9e25-54d17702033c tempest-GroupSnapshotsTest-1016258839 None] Lock "cinder-quobyte-bab28edd-db76-441a-bc77-0fe42807b075" acquired by "delete_volume" :: waited 0.024s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:01:04 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[f988586a-23f4-4932-8f4a-27dc6d28e07a]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:01:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0097bdb6-a8ac-4b4e-9e25-54d17702033c tempest-GroupSnapshotsTest-1016258839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bab28edd-db76-441a-bc77-0fe42807b075 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:04 devstack sudo[101460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bab28edd-db76-441a-bc77-0fe42807b075 Jul 30 17:01:04 devstack sudo[101460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:05 devstack sudo[101460]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:05 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0097bdb6-a8ac-4b4e-9e25-54d17702033c tempest-GroupSnapshotsTest-1016258839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bab28edd-db76-441a-bc77-0fe42807b075" returned: 0 in 0.756s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:05 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0097bdb6-a8ac-4b4e-9e25-54d17702033c tempest-GroupSnapshotsTest-1016258839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bab28edd-db76-441a-bc77-0fe42807b075 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:05 devstack sudo[101474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bab28edd-db76-441a-bc77-0fe42807b075 Jul 30 17:01:05 devstack sudo[101474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:05 devstack sudo[101474]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:05 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0097bdb6-a8ac-4b4e-9e25-54d17702033c tempest-GroupSnapshotsTest-1016258839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bab28edd-db76-441a-bc77-0fe42807b075" returned: 0 in 0.700s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:06 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-0097bdb6-a8ac-4b4e-9e25-54d17702033c tempest-GroupSnapshotsTest-1016258839 None] Lock "cinder-quobyte-bab28edd-db76-441a-bc77-0fe42807b075" released by "delete_volume" :: held 1.559s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:01:06 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-0097bdb6-a8ac-4b4e-9e25-54d17702033c tempest-GroupSnapshotsTest-1016258839 None] Created reservations ['648dfd1d-9f41-4556-bee9-a7dcd2025b94'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:01:06 devstack cinder-volume[88568]: WARNING cinder.quota [None req-0097bdb6-a8ac-4b4e-9e25-54d17702033c tempest-GroupSnapshotsTest-1016258839 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2050492512 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2050492512, it is now deprecated. Please use the default quota class for default quota. Jul 30 17:01:06 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-0097bdb6-a8ac-4b4e-9e25-54d17702033c tempest-GroupSnapshotsTest-1016258839 None] Created reservations ['e9f1e649-6bdd-4c45-aed2-878b2544d3ff', '94ededa8-a7bc-41a0-8477-18c2dcb6bb5d', '3fa1fcc2-7a24-41d1-acd7-378fb5d92d7d', 'bb2c9ab2-4b84-4ff3-98dd-3b9a660193e5'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:01:06 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-0097bdb6-a8ac-4b4e-9e25-54d17702033c tempest-GroupSnapshotsTest-1016258839 None] Created reservations ['bd0af6ab-0456-49c3-a1b7-5ab45768fc42', '2f25b7b8-ca67-4503-9bd4-a2ed08a2d2ce', '3dd13a77-73db-4797-8e8c-5b461e410635', '2e78605b-c73d-4ba2-8eef-d71abc4ad751'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:01:07 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-0097bdb6-a8ac-4b4e-9e25-54d17702033c tempest-GroupSnapshotsTest-1016258839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:01:07 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-0097bdb6-a8ac-4b4e-9e25-54d17702033c tempest-GroupSnapshotsTest-1016258839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:01:07 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-0097bdb6-a8ac-4b4e-9e25-54d17702033c tempest-GroupSnapshotsTest-1016258839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:01:07 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-0097bdb6-a8ac-4b4e-9e25-54d17702033c tempest-GroupSnapshotsTest-1016258839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:01:07 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-0097bdb6-a8ac-4b4e-9e25-54d17702033c tempest-GroupSnapshotsTest-1016258839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:01:07 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0097bdb6-a8ac-4b4e-9e25-54d17702033c tempest-GroupSnapshotsTest-1016258839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:07 devstack sudo[101477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:01:07 devstack sudo[101477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:08 devstack sudo[101477]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:08 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0097bdb6-a8ac-4b4e-9e25-54d17702033c tempest-GroupSnapshotsTest-1016258839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.885s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:08 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-0097bdb6-a8ac-4b4e-9e25-54d17702033c tempest-GroupSnapshotsTest-1016258839 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:01:08 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-0097bdb6-a8ac-4b4e-9e25-54d17702033c tempest-GroupSnapshotsTest-1016258839 None] Delete group completed successfully. Jul 30 17:01:09 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-b52e5ab3-75b2-4c19-98ae-05a9b111461a tempest-GroupSnapshotsTest-1016258839 None] Group tempest-GroupSnapshotsTest-Group-1099858977: creating Jul 30 17:01:09 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-b52e5ab3-75b2-4c19-98ae-05a9b111461a tempest-GroupSnapshotsTest-1016258839 None] Group tempest-GroupSnapshotsTest-Group-1099858977: created successfully Jul 30 17:01:09 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-b52e5ab3-75b2-4c19-98ae-05a9b111461a tempest-GroupSnapshotsTest-1016258839 None] Create group completed successfully. Jul 30 17:01:09 devstack sudo[101451]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:09 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8aacfd63-9005-44b5-8798-a6fc2e3dfaaa tempest-VolumesCloneTest-1451008520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-1bc71622-1681-4b59-b547-8f06de2f89df" returned: 0 in 5.756s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:09 devstack cinder-volume[88568]: DEBUG cinder.image.image_utils [None req-8aacfd63-9005-44b5-8798-a6fc2e3dfaaa tempest-VolumesCloneTest-1451008520 None] Image conversion details: src /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b, size 1024.00 MB, duration 5.76 sec, destination /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-1bc71622-1681-4b59-b547-8f06de2f89df {{(pid=88568) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 17:01:09 devstack cinder-volume[88568]: INFO cinder.image.image_utils [None req-8aacfd63-9005-44b5-8798-a6fc2e3dfaaa tempest-VolumesCloneTest-1451008520 None] Converted 1024.00 MB image at 177.88 MB/s Jul 30 17:01:09 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-8aacfd63-9005-44b5-8798-a6fc2e3dfaaa tempest-VolumesCloneTest-1451008520 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-1bc71622-1681-4b59-b547-8f06de2f89df is being set with open permissions: ugo+rw Jul 30 17:01:09 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8aacfd63-9005-44b5-8798-a6fc2e3dfaaa tempest-VolumesCloneTest-1451008520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-1bc71622-1681-4b59-b547-8f06de2f89df {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:09 devstack sudo[101480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-1bc71622-1681-4b59-b547-8f06de2f89df Jul 30 17:01:09 devstack sudo[101480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:10 devstack sudo[101480]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:10 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8aacfd63-9005-44b5-8798-a6fc2e3dfaaa tempest-VolumesCloneTest-1451008520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-1bc71622-1681-4b59-b547-8f06de2f89df" returned: 0 in 0.253s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:10 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-8aacfd63-9005-44b5-8798-a6fc2e3dfaaa tempest-VolumesCloneTest-1451008520 None] Lock "cinder-quobyte-1bc71622-1681-4b59-b547-8f06de2f89df" released by "_copy_volume_from_snapshot" :: held 7.070s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:01:10 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-8aacfd63-9005-44b5-8798-a6fc2e3dfaaa tempest-VolumesCloneTest-1451008520 None] Acquiring lock "cinder-quobyte-1fbf6405-d388-41b3-a310-63fe9c242529" by "_delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:01:10 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-8aacfd63-9005-44b5-8798-a6fc2e3dfaaa tempest-VolumesCloneTest-1451008520 None] Lock "cinder-quobyte-1fbf6405-d388-41b3-a310-63fe9c242529" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:01:10 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-8aacfd63-9005-44b5-8798-a6fc2e3dfaaa tempest-VolumesCloneTest-1451008520 None] Deleting offline snapshot 1fbf6405-d388-41b3-a310-63fe9c242529 of volume f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:01:10 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-8aacfd63-9005-44b5-8798-a6fc2e3dfaaa tempest-VolumesCloneTest-1451008520 None] snapshot_file for this snap is: volume-f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b.1fbf6405-d388-41b3-a310-63fe9c242529 {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:01:10 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bcef24f-9d35-4998-b5e1-2acd41d5427e]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:01:10 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8aacfd63-9005-44b5-8798-a6fc2e3dfaaa tempest-VolumesCloneTest-1451008520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b.1fbf6405-d388-41b3-a310-63fe9c242529 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:10 devstack sudo[101484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b.1fbf6405-d388-41b3-a310-63fe9c242529 Jul 30 17:01:10 devstack sudo[101484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:10 devstack sudo[101484]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:10 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8aacfd63-9005-44b5-8798-a6fc2e3dfaaa tempest-VolumesCloneTest-1451008520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b.1fbf6405-d388-41b3-a310-63fe9c242529" returned: 0 in 0.379s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:10 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-8aacfd63-9005-44b5-8798-a6fc2e3dfaaa tempest-VolumesCloneTest-1451008520 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:01:10 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[5043e7d0-4009-4540-b568-7127f55aa8d5]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:01:10 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8aacfd63-9005-44b5-8798-a6fc2e3dfaaa tempest-VolumesCloneTest-1451008520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:10 devstack sudo[101489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b Jul 30 17:01:10 devstack sudo[101489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:10 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-449ae58b-2660-420d-9cef-75eb3a80f546 tempest-CreateVolumesFromSnapshotTest-266944850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:01:10 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-449ae58b-2660-420d-9cef-75eb3a80f546 tempest-CreateVolumesFromSnapshotTest-266944850 None] Flow 'volume_create_manager' (627ad045-a52e-4ea3-9de8-d1105618480d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:01:10 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-449ae58b-2660-420d-9cef-75eb3a80f546 tempest-CreateVolumesFromSnapshotTest-266944850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d84eb156-66e0-403d-9ae8-c3c0f879ef54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:10 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-449ae58b-2660-420d-9cef-75eb3a80f546 tempest-CreateVolumesFromSnapshotTest-266944850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d84eb156-66e0-403d-9ae8-c3c0f879ef54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:01:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-573644520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0183b9e2-1d57-4ab3-9667-5770999ba441,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eea1270cda6460aba4b40f636e4e171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:01:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:01:11Z,use_quota=True,user_id='3442fa64ab634822907c5e08e96701ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:10 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-449ae58b-2660-420d-9cef-75eb3a80f546 tempest-CreateVolumesFromSnapshotTest-266944850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21dfd2e1-90f1-4d43-be9f-2c0abe1a9ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:10 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-449ae58b-2660-420d-9cef-75eb3a80f546 tempest-CreateVolumesFromSnapshotTest-266944850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21dfd2e1-90f1-4d43-be9f-2c0abe1a9ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:10 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-449ae58b-2660-420d-9cef-75eb3a80f546 tempest-CreateVolumesFromSnapshotTest-266944850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c474f322-12be-48ad-b00e-6bea71303377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:10 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-449ae58b-2660-420d-9cef-75eb3a80f546 tempest-CreateVolumesFromSnapshotTest-266944850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c474f322-12be-48ad-b00e-6bea71303377) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0183b9e2-1d57-4ab3-9667-5770999ba441', 'volume_name': 'volume-0183b9e2-1d57-4ab3-9667-5770999ba441', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:10 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-449ae58b-2660-420d-9cef-75eb3a80f546 tempest-CreateVolumesFromSnapshotTest-266944850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19db623c-8404-4466-848c-23a01d2fa9cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:10 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-449ae58b-2660-420d-9cef-75eb3a80f546 tempest-CreateVolumesFromSnapshotTest-266944850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19db623c-8404-4466-848c-23a01d2fa9cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:10 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-449ae58b-2660-420d-9cef-75eb3a80f546 tempest-CreateVolumesFromSnapshotTest-266944850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (757a6f10-4eaa-4d6e-a388-81c415da2a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:10 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-449ae58b-2660-420d-9cef-75eb3a80f546 tempest-CreateVolumesFromSnapshotTest-266944850 None] Volume 0183b9e2-1d57-4ab3-9667-5770999ba441: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0183b9e2-1d57-4ab3-9667-5770999ba441', 'volume_size': 1} Jul 30 17:01:10 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-449ae58b-2660-420d-9cef-75eb3a80f546 tempest-CreateVolumesFromSnapshotTest-266944850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:01:11 devstack sudo[101489]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8aacfd63-9005-44b5-8798-a6fc2e3dfaaa tempest-VolumesCloneTest-1451008520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b" returned: 0 in 0.632s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8aacfd63-9005-44b5-8798-a6fc2e3dfaaa tempest-VolumesCloneTest-1451008520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b.1fbf6405-d388-41b3-a310-63fe9c242529 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:11 devstack sudo[101494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b.1fbf6405-d388-41b3-a310-63fe9c242529 Jul 30 17:01:11 devstack sudo[101494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:11 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-664c6b05-7b7d-41d7-8a97-d16418f4f596 tempest-GroupSnapshotsTest-1016258839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:01:11 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-664c6b05-7b7d-41d7-8a97-d16418f4f596 tempest-GroupSnapshotsTest-1016258839 None] Flow 'volume_create_manager' (afc92266-1b08-4811-9742-5aad97695d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:01:11 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-664c6b05-7b7d-41d7-8a97-d16418f4f596 tempest-GroupSnapshotsTest-1016258839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (738819a7-4e12-4369-9d01-6e0b6f79599c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:11 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-664c6b05-7b7d-41d7-8a97-d16418f4f596 tempest-GroupSnapshotsTest-1016258839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (738819a7-4e12-4369-9d01-6e0b6f79599c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:01:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1502652786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7f1e756f-63b4-4c0b-bc75-8e476cc6fd4c,host='devstack@QuobyteHD#QuobyteHD',id=c81b8bc5-de70-4083-949e-cde9740a06bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b492a05000f4134822a5d9ffd72aa2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:01:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:01:11Z,use_quota=True,user_id='6c9b5dc45fb14a9c8a7df96de3b9b516',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(137b6b46-cd67-49b2-8e3e-249cdc15f55b),volume_type_id=137b6b46-cd67-49b2-8e3e-249cdc15f55b)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:11 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-664c6b05-7b7d-41d7-8a97-d16418f4f596 tempest-GroupSnapshotsTest-1016258839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b1db629-d640-4a79-9e0c-d1e4b5eed42e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:11 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-664c6b05-7b7d-41d7-8a97-d16418f4f596 tempest-GroupSnapshotsTest-1016258839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b1db629-d640-4a79-9e0c-d1e4b5eed42e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:11 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-664c6b05-7b7d-41d7-8a97-d16418f4f596 tempest-GroupSnapshotsTest-1016258839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25cd138f-6648-4eb5-ba87-5f9b4ae1c242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:11 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-664c6b05-7b7d-41d7-8a97-d16418f4f596 tempest-GroupSnapshotsTest-1016258839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25cd138f-6648-4eb5-ba87-5f9b4ae1c242) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c81b8bc5-de70-4083-949e-cde9740a06bb', 'volume_name': 'volume-c81b8bc5-de70-4083-949e-cde9740a06bb', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:11 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-664c6b05-7b7d-41d7-8a97-d16418f4f596 tempest-GroupSnapshotsTest-1016258839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a25514cd-27aa-4aac-8905-1c51864d853a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:11 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-664c6b05-7b7d-41d7-8a97-d16418f4f596 tempest-GroupSnapshotsTest-1016258839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a25514cd-27aa-4aac-8905-1c51864d853a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:11 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-664c6b05-7b7d-41d7-8a97-d16418f4f596 tempest-GroupSnapshotsTest-1016258839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bb7e4b1-3081-4f56-8559-3e49b4fcbe1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:11 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-664c6b05-7b7d-41d7-8a97-d16418f4f596 tempest-GroupSnapshotsTest-1016258839 None] Volume c81b8bc5-de70-4083-949e-cde9740a06bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c81b8bc5-de70-4083-949e-cde9740a06bb', 'volume_size': 1} Jul 30 17:01:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-664c6b05-7b7d-41d7-8a97-d16418f4f596 tempest-GroupSnapshotsTest-1016258839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:01:11 devstack sudo[101494]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8aacfd63-9005-44b5-8798-a6fc2e3dfaaa tempest-VolumesCloneTest-1451008520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b.1fbf6405-d388-41b3-a310-63fe9c242529" returned: 0 in 0.366s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8aacfd63-9005-44b5-8798-a6fc2e3dfaaa tempest-VolumesCloneTest-1451008520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b.1fbf6405-d388-41b3-a310-63fe9c242529 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:11 devstack sudo[101499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b.1fbf6405-d388-41b3-a310-63fe9c242529 Jul 30 17:01:11 devstack sudo[101499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:11 devstack sudo[101499]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8aacfd63-9005-44b5-8798-a6fc2e3dfaaa tempest-VolumesCloneTest-1451008520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b.1fbf6405-d388-41b3-a310-63fe9c242529" returned: 0 in 0.251s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:11 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-8aacfd63-9005-44b5-8798-a6fc2e3dfaaa tempest-VolumesCloneTest-1451008520 None] Lock "cinder-quobyte-1fbf6405-d388-41b3-a310-63fe9c242529" released by "_delete_snapshot" :: held 1.726s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:01:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-8aacfd63-9005-44b5-8798-a6fc2e3dfaaa tempest-VolumesCloneTest-1451008520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.238s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:01:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-449ae58b-2660-420d-9cef-75eb3a80f546 tempest-CreateVolumesFromSnapshotTest-266944850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.923s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:01:11 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-449ae58b-2660-420d-9cef-75eb3a80f546 tempest-CreateVolumesFromSnapshotTest-266944850 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:01:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-573644520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0183b9e2-1d57-4ab3-9667-5770999ba441,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eea1270cda6460aba4b40f636e4e171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:01:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:01:11Z,use_quota=True,user_id='3442fa64ab634822907c5e08e96701ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:01:11 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-449ae58b-2660-420d-9cef-75eb3a80f546 tempest-CreateVolumesFromSnapshotTest-266944850 None] Creating volume 0183b9e2-1d57-4ab3-9667-5770999ba441 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:01:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-449ae58b-2660-420d-9cef-75eb3a80f546 tempest-CreateVolumesFromSnapshotTest-266944850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:01:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-449ae58b-2660-420d-9cef-75eb3a80f546 tempest-CreateVolumesFromSnapshotTest-266944850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:01:11 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-449ae58b-2660-420d-9cef-75eb3a80f546 tempest-CreateVolumesFromSnapshotTest-266944850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:01:11 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-449ae58b-2660-420d-9cef-75eb3a80f546 tempest-CreateVolumesFromSnapshotTest-266944850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:01:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-449ae58b-2660-420d-9cef-75eb3a80f546 tempest-CreateVolumesFromSnapshotTest-266944850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:01:11 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-449ae58b-2660-420d-9cef-75eb3a80f546 tempest-CreateVolumesFromSnapshotTest-266944850 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:01:11 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-449ae58b-2660-420d-9cef-75eb3a80f546 tempest-CreateVolumesFromSnapshotTest-266944850 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:01:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-449ae58b-2660-420d-9cef-75eb3a80f546 tempest-CreateVolumesFromSnapshotTest-266944850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0183b9e2-1d57-4ab3-9667-5770999ba441 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:11 devstack sudo[101502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0183b9e2-1d57-4ab3-9667-5770999ba441 1073741824 Jul 30 17:01:11 devstack sudo[101502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:11 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8aacfd63-9005-44b5-8798-a6fc2e3dfaaa tempest-VolumesCloneTest-1451008520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ac8b7c0-8048-493c-979b-ad4a4f893b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bc71622-1681-4b59-b547-8f06de2f89df', 'volume_size': 2, 'source_volid': 'f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b', 'source_volstatus': 'available'}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:11 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8aacfd63-9005-44b5-8798-a6fc2e3dfaaa tempest-VolumesCloneTest-1451008520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0afa1dc-40f7-46fe-98a1-09eb4517a1a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:11 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-8aacfd63-9005-44b5-8798-a6fc2e3dfaaa tempest-VolumesCloneTest-1451008520 None] Volume volume-1bc71622-1681-4b59-b547-8f06de2f89df (1bc71622-1681-4b59-b547-8f06de2f89df): created successfully Jul 30 17:01:11 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8aacfd63-9005-44b5-8798-a6fc2e3dfaaa tempest-VolumesCloneTest-1451008520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0afa1dc-40f7-46fe-98a1-09eb4517a1a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:11 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8aacfd63-9005-44b5-8798-a6fc2e3dfaaa tempest-VolumesCloneTest-1451008520 None] Flow 'volume_create_manager' (81603064-3278-4b9f-aa1d-94d2cfcf6e77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:01:11 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-8aacfd63-9005-44b5-8798-a6fc2e3dfaaa tempest-VolumesCloneTest-1451008520 None] Created volume successfully. Jul 30 17:01:12 devstack sudo[101502]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-449ae58b-2660-420d-9cef-75eb3a80f546 tempest-CreateVolumesFromSnapshotTest-266944850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0183b9e2-1d57-4ab3-9667-5770999ba441 1073741824" returned: 0 in 0.423s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-449ae58b-2660-420d-9cef-75eb3a80f546 tempest-CreateVolumesFromSnapshotTest-266944850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0183b9e2-1d57-4ab3-9667-5770999ba441 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:12 devstack sudo[101508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0183b9e2-1d57-4ab3-9667-5770999ba441 Jul 30 17:01:12 devstack sudo[101508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:12 devstack sudo[101508]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-449ae58b-2660-420d-9cef-75eb3a80f546 tempest-CreateVolumesFromSnapshotTest-266944850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0183b9e2-1d57-4ab3-9667-5770999ba441" returned: 0 in 0.285s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:12 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-449ae58b-2660-420d-9cef-75eb3a80f546 tempest-CreateVolumesFromSnapshotTest-266944850 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:01:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-449ae58b-2660-420d-9cef-75eb3a80f546 tempest-CreateVolumesFromSnapshotTest-266944850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:01:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-664c6b05-7b7d-41d7-8a97-d16418f4f596 tempest-GroupSnapshotsTest-1016258839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.190s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:01:12 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-664c6b05-7b7d-41d7-8a97-d16418f4f596 tempest-GroupSnapshotsTest-1016258839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7f1e756f-63b4-4c0b-bc75-8e476cc6fd4c,created_at=2026-07-30T15:01:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1502652786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7f1e756f-63b4-4c0b-bc75-8e476cc6fd4c,host='devstack@QuobyteHD#QuobyteHD',id=c81b8bc5-de70-4083-949e-cde9740a06bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b492a05000f4134822a5d9ffd72aa2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:01:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:01:11Z,use_quota=True,user_id='6c9b5dc45fb14a9c8a7df96de3b9b516',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(137b6b46-cd67-49b2-8e3e-249cdc15f55b),volume_type_id=137b6b46-cd67-49b2-8e3e-249cdc15f55b)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:01:12 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-664c6b05-7b7d-41d7-8a97-d16418f4f596 tempest-GroupSnapshotsTest-1016258839 None] Creating volume c81b8bc5-de70-4083-949e-cde9740a06bb {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:01:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-664c6b05-7b7d-41d7-8a97-d16418f4f596 tempest-GroupSnapshotsTest-1016258839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:01:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-664c6b05-7b7d-41d7-8a97-d16418f4f596 tempest-GroupSnapshotsTest-1016258839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:01:12 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-664c6b05-7b7d-41d7-8a97-d16418f4f596 tempest-GroupSnapshotsTest-1016258839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:01:12 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-664c6b05-7b7d-41d7-8a97-d16418f4f596 tempest-GroupSnapshotsTest-1016258839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:01:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-664c6b05-7b7d-41d7-8a97-d16418f4f596 tempest-GroupSnapshotsTest-1016258839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:01:12 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-664c6b05-7b7d-41d7-8a97-d16418f4f596 tempest-GroupSnapshotsTest-1016258839 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:01:12 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-664c6b05-7b7d-41d7-8a97-d16418f4f596 tempest-GroupSnapshotsTest-1016258839 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:01:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-664c6b05-7b7d-41d7-8a97-d16418f4f596 tempest-GroupSnapshotsTest-1016258839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c81b8bc5-de70-4083-949e-cde9740a06bb 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:12 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-449ae58b-2660-420d-9cef-75eb3a80f546 tempest-CreateVolumesFromSnapshotTest-266944850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (757a6f10-4eaa-4d6e-a388-81c415da2a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0183b9e2-1d57-4ab3-9667-5770999ba441', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:12 devstack sudo[101511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c81b8bc5-de70-4083-949e-cde9740a06bb 1073741824 Jul 30 17:01:12 devstack sudo[101511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:12 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-449ae58b-2660-420d-9cef-75eb3a80f546 tempest-CreateVolumesFromSnapshotTest-266944850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de3e11fb-3af4-4fc1-9cae-4fdc9042f6bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:12 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-449ae58b-2660-420d-9cef-75eb3a80f546 tempest-CreateVolumesFromSnapshotTest-266944850 None] Volume volume-0183b9e2-1d57-4ab3-9667-5770999ba441 (0183b9e2-1d57-4ab3-9667-5770999ba441): created successfully Jul 30 17:01:12 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-449ae58b-2660-420d-9cef-75eb3a80f546 tempest-CreateVolumesFromSnapshotTest-266944850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de3e11fb-3af4-4fc1-9cae-4fdc9042f6bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:12 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-449ae58b-2660-420d-9cef-75eb3a80f546 tempest-CreateVolumesFromSnapshotTest-266944850 None] Flow 'volume_create_manager' (627ad045-a52e-4ea3-9de8-d1105618480d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:01:12 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-449ae58b-2660-420d-9cef-75eb3a80f546 tempest-CreateVolumesFromSnapshotTest-266944850 None] Created volume successfully. Jul 30 17:01:12 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-3e3ef606-c27a-4047-9dad-6e0c2f62e16c tempest-VolumesCloneTest-1451008520 None] Acquiring lock "cinder-1bc71622-1681-4b59-b547-8f06de2f89df-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:01:13 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-3e3ef606-c27a-4047-9dad-6e0c2f62e16c tempest-VolumesCloneTest-1451008520 None] Lock "cinder-1bc71622-1681-4b59-b547-8f06de2f89df-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:01:13 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-3e3ef606-c27a-4047-9dad-6e0c2f62e16c tempest-VolumesCloneTest-1451008520 None] Acquiring lock "cinder-quobyte-1bc71622-1681-4b59-b547-8f06de2f89df" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:01:13 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-3e3ef606-c27a-4047-9dad-6e0c2f62e16c tempest-VolumesCloneTest-1451008520 None] Lock "cinder-quobyte-1bc71622-1681-4b59-b547-8f06de2f89df" acquired by "delete_volume" :: waited 0.023s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:01:13 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[78370007-d59b-4dd8-a191-885eb6b71074]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:01:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-3e3ef606-c27a-4047-9dad-6e0c2f62e16c tempest-VolumesCloneTest-1451008520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-1bc71622-1681-4b59-b547-8f06de2f89df {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:13 devstack sudo[101511]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-664c6b05-7b7d-41d7-8a97-d16418f4f596 tempest-GroupSnapshotsTest-1016258839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c81b8bc5-de70-4083-949e-cde9740a06bb 1073741824" returned: 0 in 0.537s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-fe86a986-d521-4f57-9cea-06d18fd112f7 tempest-CreateVolumesFromSnapshotTest-266944850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:01:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-664c6b05-7b7d-41d7-8a97-d16418f4f596 tempest-GroupSnapshotsTest-1016258839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c81b8bc5-de70-4083-949e-cde9740a06bb {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:13 devstack sudo[101519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c81b8bc5-de70-4083-949e-cde9740a06bb Jul 30 17:01:13 devstack sudo[101519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:13 devstack sudo[101518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-1bc71622-1681-4b59-b547-8f06de2f89df Jul 30 17:01:13 devstack sudo[101518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:13 devstack sudo[101519]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-664c6b05-7b7d-41d7-8a97-d16418f4f596 tempest-GroupSnapshotsTest-1016258839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c81b8bc5-de70-4083-949e-cde9740a06bb" returned: 0 in 0.251s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:13 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-664c6b05-7b7d-41d7-8a97-d16418f4f596 tempest-GroupSnapshotsTest-1016258839 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:01:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-664c6b05-7b7d-41d7-8a97-d16418f4f596 tempest-GroupSnapshotsTest-1016258839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:01:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-fe86a986-d521-4f57-9cea-06d18fd112f7 tempest-CreateVolumesFromSnapshotTest-266944850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.283s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:01:13 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-664c6b05-7b7d-41d7-8a97-d16418f4f596 tempest-GroupSnapshotsTest-1016258839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bb7e4b1-3081-4f56-8559-3e49b4fcbe1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c81b8bc5-de70-4083-949e-cde9740a06bb', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:13 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-664c6b05-7b7d-41d7-8a97-d16418f4f596 tempest-GroupSnapshotsTest-1016258839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa178629-b117-421d-af4f-1edc7f6924ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:13 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-fe86a986-d521-4f57-9cea-06d18fd112f7 tempest-CreateVolumesFromSnapshotTest-266944850 None] Creating offline snapshot 3db6f2af-4921-43a0-a9ab-25177fb0b2ee of volume 0183b9e2-1d57-4ab3-9667-5770999ba441 {{(pid=88568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:01:13 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-664c6b05-7b7d-41d7-8a97-d16418f4f596 tempest-GroupSnapshotsTest-1016258839 None] Volume volume-c81b8bc5-de70-4083-949e-cde9740a06bb (c81b8bc5-de70-4083-949e-cde9740a06bb): created successfully Jul 30 17:01:13 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-664c6b05-7b7d-41d7-8a97-d16418f4f596 tempest-GroupSnapshotsTest-1016258839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa178629-b117-421d-af4f-1edc7f6924ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:13 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-664c6b05-7b7d-41d7-8a97-d16418f4f596 tempest-GroupSnapshotsTest-1016258839 None] Flow 'volume_create_manager' (afc92266-1b08-4811-9742-5aad97695d2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:01:13 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[68acebc2-5b2b-4a15-bc52-aeeca626eb2a]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:01:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fe86a986-d521-4f57-9cea-06d18fd112f7 tempest-CreateVolumesFromSnapshotTest-266944850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0183b9e2-1d57-4ab3-9667-5770999ba441 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:13 devstack sudo[101518]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-3e3ef606-c27a-4047-9dad-6e0c2f62e16c tempest-VolumesCloneTest-1451008520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-1bc71622-1681-4b59-b547-8f06de2f89df" returned: 0 in 0.382s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-3e3ef606-c27a-4047-9dad-6e0c2f62e16c tempest-VolumesCloneTest-1451008520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-1bc71622-1681-4b59-b547-8f06de2f89df {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:13 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-664c6b05-7b7d-41d7-8a97-d16418f4f596 tempest-GroupSnapshotsTest-1016258839 None] Created volume successfully. Jul 30 17:01:13 devstack sudo[101527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-1bc71622-1681-4b59-b547-8f06de2f89df Jul 30 17:01:13 devstack sudo[101527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:13 devstack sudo[101526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0183b9e2-1d57-4ab3-9667-5770999ba441 Jul 30 17:01:13 devstack sudo[101526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:13 devstack sudo[101527]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-3e3ef606-c27a-4047-9dad-6e0c2f62e16c tempest-VolumesCloneTest-1451008520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-1bc71622-1681-4b59-b547-8f06de2f89df" returned: 0 in 0.268s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:13 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-3e3ef606-c27a-4047-9dad-6e0c2f62e16c tempest-VolumesCloneTest-1451008520 None] Lock "cinder-quobyte-1bc71622-1681-4b59-b547-8f06de2f89df" released by "delete_volume" :: held 0.709s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:01:13 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-3e3ef606-c27a-4047-9dad-6e0c2f62e16c tempest-VolumesCloneTest-1451008520 None] Created reservations ['dc4448ff-6de8-4850-b5e3-214ed11b8c46', '8c22dc73-3ac4-4528-8491-c2d4c7eb8c49', '2d13fb30-4ce8-4823-9264-c438834ea05c', '0844776f-0d9f-42e4-920f-3fadd7bc04b0'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:01:13 devstack sudo[101526]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fe86a986-d521-4f57-9cea-06d18fd112f7 tempest-CreateVolumesFromSnapshotTest-266944850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0183b9e2-1d57-4ab3-9667-5770999ba441" returned: 0 in 0.397s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fe86a986-d521-4f57-9cea-06d18fd112f7 tempest-CreateVolumesFromSnapshotTest-266944850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0183b9e2-1d57-4ab3-9667-5770999ba441,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0183b9e2-1d57-4ab3-9667-5770999ba441.3db6f2af-4921-43a0-a9ab-25177fb0b2ee 1G {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:13 devstack sudo[101534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0183b9e2-1d57-4ab3-9667-5770999ba441,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0183b9e2-1d57-4ab3-9667-5770999ba441.3db6f2af-4921-43a0-a9ab-25177fb0b2ee 1G Jul 30 17:01:13 devstack sudo[101534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:13 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-a2c7c085-0124-4bd8-8179-2960fd24f59d tempest-GroupSnapshotsTest-1016258839 None] GroupSnapshot ec949122-81ec-44b1-a495-b68407e35cdf: creating. Jul 30 17:01:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-3e3ef606-c27a-4047-9dad-6e0c2f62e16c tempest-VolumesCloneTest-1451008520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:01:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-3e3ef606-c27a-4047-9dad-6e0c2f62e16c tempest-VolumesCloneTest-1451008520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:01:13 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-3e3ef606-c27a-4047-9dad-6e0c2f62e16c tempest-VolumesCloneTest-1451008520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:01:13 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-3e3ef606-c27a-4047-9dad-6e0c2f62e16c tempest-VolumesCloneTest-1451008520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:01:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-3e3ef606-c27a-4047-9dad-6e0c2f62e16c tempest-VolumesCloneTest-1451008520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:01:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-3e3ef606-c27a-4047-9dad-6e0c2f62e16c tempest-VolumesCloneTest-1451008520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:13 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a2c7c085-0124-4bd8-8179-2960fd24f59d tempest-GroupSnapshotsTest-1016258839 None] Group snapshot ec949122-81ec-44b1-a495-b68407e35cdf: creating. {{(pid=88568) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 30 17:01:13 devstack sudo[101536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:01:13 devstack sudo[101536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a2c7c085-0124-4bd8-8179-2960fd24f59d tempest-GroupSnapshotsTest-1016258839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:01:14 devstack sudo[101536]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:14 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-41b9f368-c124-4057-a89d-92f87176eb63 tempest-VolumesCloneTest-1451008520 None] Acquiring lock "cinder-f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:01:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-3e3ef606-c27a-4047-9dad-6e0c2f62e16c tempest-VolumesCloneTest-1451008520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.263s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:14 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-3e3ef606-c27a-4047-9dad-6e0c2f62e16c tempest-VolumesCloneTest-1451008520 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:01:14 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-3e3ef606-c27a-4047-9dad-6e0c2f62e16c tempest-VolumesCloneTest-1451008520 None] Deleted volume successfully. Jul 30 17:01:14 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-41b9f368-c124-4057-a89d-92f87176eb63 tempest-VolumesCloneTest-1451008520 None] Lock "cinder-f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:01:14 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-3e3ef606-c27a-4047-9dad-6e0c2f62e16c tempest-VolumesCloneTest-1451008520 None] Lock "cinder-1bc71622-1681-4b59-b547-8f06de2f89df-delete_volume" released by "delete_volume" :: held 1.276s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:01:14 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-41b9f368-c124-4057-a89d-92f87176eb63 tempest-VolumesCloneTest-1451008520 None] Acquiring lock "cinder-quobyte-f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:01:14 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-41b9f368-c124-4057-a89d-92f87176eb63 tempest-VolumesCloneTest-1451008520 None] Lock "cinder-quobyte-f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b" acquired by "delete_volume" :: waited 0.015s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:01:14 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6079e40-390f-4186-b882-0315678e978b]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:01:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-41b9f368-c124-4057-a89d-92f87176eb63 tempest-VolumesCloneTest-1451008520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:14 devstack sudo[101534]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fe86a986-d521-4f57-9cea-06d18fd112f7 tempest-CreateVolumesFromSnapshotTest-266944850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0183b9e2-1d57-4ab3-9667-5770999ba441,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0183b9e2-1d57-4ab3-9667-5770999ba441.3db6f2af-4921-43a0-a9ab-25177fb0b2ee 1G" returned: 0 in 0.486s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fe86a986-d521-4f57-9cea-06d18fd112f7 tempest-CreateVolumesFromSnapshotTest-266944850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0183b9e2-1d57-4ab3-9667-5770999ba441 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0183b9e2-1d57-4ab3-9667-5770999ba441.3db6f2af-4921-43a0-a9ab-25177fb0b2ee {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:14 devstack sudo[101544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0183b9e2-1d57-4ab3-9667-5770999ba441 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0183b9e2-1d57-4ab3-9667-5770999ba441.3db6f2af-4921-43a0-a9ab-25177fb0b2ee Jul 30 17:01:14 devstack sudo[101544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:14 devstack sudo[101543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b Jul 30 17:01:14 devstack sudo[101543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:14 devstack sudo[101544]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fe86a986-d521-4f57-9cea-06d18fd112f7 tempest-CreateVolumesFromSnapshotTest-266944850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0183b9e2-1d57-4ab3-9667-5770999ba441 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0183b9e2-1d57-4ab3-9667-5770999ba441.3db6f2af-4921-43a0-a9ab-25177fb0b2ee" returned: 0 in 0.284s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:14 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-fe86a986-d521-4f57-9cea-06d18fd112f7 tempest-CreateVolumesFromSnapshotTest-266944850 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0183b9e2-1d57-4ab3-9667-5770999ba441.3db6f2af-4921-43a0-a9ab-25177fb0b2ee is being set with open permissions: ugo+rw Jul 30 17:01:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fe86a986-d521-4f57-9cea-06d18fd112f7 tempest-CreateVolumesFromSnapshotTest-266944850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0183b9e2-1d57-4ab3-9667-5770999ba441.3db6f2af-4921-43a0-a9ab-25177fb0b2ee {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:14 devstack sudo[101552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0183b9e2-1d57-4ab3-9667-5770999ba441.3db6f2af-4921-43a0-a9ab-25177fb0b2ee Jul 30 17:01:14 devstack sudo[101552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:14 devstack sudo[101543]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-41b9f368-c124-4057-a89d-92f87176eb63 tempest-VolumesCloneTest-1451008520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b" returned: 0 in 0.366s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-41b9f368-c124-4057-a89d-92f87176eb63 tempest-VolumesCloneTest-1451008520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:14 devstack sudo[101557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b Jul 30 17:01:14 devstack sudo[101557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:14 devstack sudo[101552]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fe86a986-d521-4f57-9cea-06d18fd112f7 tempest-CreateVolumesFromSnapshotTest-266944850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0183b9e2-1d57-4ab3-9667-5770999ba441.3db6f2af-4921-43a0-a9ab-25177fb0b2ee" returned: 0 in 0.244s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fe86a986-d521-4f57-9cea-06d18fd112f7 tempest-CreateVolumesFromSnapshotTest-266944850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0183b9e2-1d57-4ab3-9667-5770999ba441.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:14 devstack sudo[101557]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:14 devstack sudo[101561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0183b9e2-1d57-4ab3-9667-5770999ba441.info Jul 30 17:01:14 devstack sudo[101561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-41b9f368-c124-4057-a89d-92f87176eb63 tempest-VolumesCloneTest-1451008520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b" returned: 0 in 0.251s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:14 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-41b9f368-c124-4057-a89d-92f87176eb63 tempest-VolumesCloneTest-1451008520 None] Lock "cinder-quobyte-f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b" released by "delete_volume" :: held 0.677s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:01:15 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-41b9f368-c124-4057-a89d-92f87176eb63 tempest-VolumesCloneTest-1451008520 None] Created reservations ['ce1de4d7-348e-4031-b7fa-943ea902937b', '712e0944-e503-4b99-bd9f-91cd1b17d448', '27366fe8-44b2-455d-b70b-3e21177b6ef0', 'c4e73acb-07c6-4a3b-8d3f-1403d9e3a796'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:01:15 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-41b9f368-c124-4057-a89d-92f87176eb63 tempest-VolumesCloneTest-1451008520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:01:15 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-41b9f368-c124-4057-a89d-92f87176eb63 tempest-VolumesCloneTest-1451008520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:01:15 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-41b9f368-c124-4057-a89d-92f87176eb63 tempest-VolumesCloneTest-1451008520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:01:15 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-41b9f368-c124-4057-a89d-92f87176eb63 tempest-VolumesCloneTest-1451008520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:01:15 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-41b9f368-c124-4057-a89d-92f87176eb63 tempest-VolumesCloneTest-1451008520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:01:15 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-41b9f368-c124-4057-a89d-92f87176eb63 tempest-VolumesCloneTest-1451008520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:15 devstack sudo[101563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:01:15 devstack sudo[101563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:15 devstack sudo[101561]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:15 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fe86a986-d521-4f57-9cea-06d18fd112f7 tempest-CreateVolumesFromSnapshotTest-266944850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0183b9e2-1d57-4ab3-9667-5770999ba441.info" returned: 0 in 0.258s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:15 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-fe86a986-d521-4f57-9cea-06d18fd112f7 tempest-CreateVolumesFromSnapshotTest-266944850 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0183b9e2-1d57-4ab3-9667-5770999ba441.info is being set with open permissions: ugo+rw Jul 30 17:01:15 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fe86a986-d521-4f57-9cea-06d18fd112f7 tempest-CreateVolumesFromSnapshotTest-266944850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0183b9e2-1d57-4ab3-9667-5770999ba441.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:15 devstack sudo[101566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0183b9e2-1d57-4ab3-9667-5770999ba441.info Jul 30 17:01:15 devstack sudo[101566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:15 devstack sudo[101563]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:15 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-41b9f368-c124-4057-a89d-92f87176eb63 tempest-VolumesCloneTest-1451008520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.259s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:15 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-41b9f368-c124-4057-a89d-92f87176eb63 tempest-VolumesCloneTest-1451008520 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:01:15 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-41b9f368-c124-4057-a89d-92f87176eb63 tempest-VolumesCloneTest-1451008520 None] Deleted volume successfully. Jul 30 17:01:15 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-41b9f368-c124-4057-a89d-92f87176eb63 tempest-VolumesCloneTest-1451008520 None] Lock "cinder-f4c8e8a0-5b95-468a-8a9a-4f76fbe5301b-delete_volume" released by "delete_volume" :: held 1.146s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:01:15 devstack sudo[101566]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:15 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fe86a986-d521-4f57-9cea-06d18fd112f7 tempest-CreateVolumesFromSnapshotTest-266944850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0183b9e2-1d57-4ab3-9667-5770999ba441.info" returned: 0 in 0.266s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:15 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-fe86a986-d521-4f57-9cea-06d18fd112f7 tempest-CreateVolumesFromSnapshotTest-266944850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.057s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:01:15 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a2c7c085-0124-4bd8-8179-2960fd24f59d tempest-GroupSnapshotsTest-1016258839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.485s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:01:15 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-a2c7c085-0124-4bd8-8179-2960fd24f59d tempest-GroupSnapshotsTest-1016258839 None] Creating offline snapshot bf626300-6caf-44a0-bae7-16da05cae967 of volume c81b8bc5-de70-4083-949e-cde9740a06bb {{(pid=88568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:01:15 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-fe86a986-d521-4f57-9cea-06d18fd112f7 tempest-CreateVolumesFromSnapshotTest-266944850 None] Create snapshot completed successfully Jul 30 17:01:15 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[999a3fe8-ddc5-464d-ad52-138862e65fc3]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:01:15 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a2c7c085-0124-4bd8-8179-2960fd24f59d tempest-GroupSnapshotsTest-1016258839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c81b8bc5-de70-4083-949e-cde9740a06bb {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:15 devstack sudo[101570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c81b8bc5-de70-4083-949e-cde9740a06bb Jul 30 17:01:15 devstack sudo[101570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:15 devstack sudo[101570]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:15 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a2c7c085-0124-4bd8-8179-2960fd24f59d tempest-GroupSnapshotsTest-1016258839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c81b8bc5-de70-4083-949e-cde9740a06bb" returned: 0 in 0.376s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:15 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a2c7c085-0124-4bd8-8179-2960fd24f59d tempest-GroupSnapshotsTest-1016258839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c81b8bc5-de70-4083-949e-cde9740a06bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c81b8bc5-de70-4083-949e-cde9740a06bb.bf626300-6caf-44a0-bae7-16da05cae967 1G {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:15 devstack sudo[101576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c81b8bc5-de70-4083-949e-cde9740a06bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c81b8bc5-de70-4083-949e-cde9740a06bb.bf626300-6caf-44a0-bae7-16da05cae967 1G Jul 30 17:01:15 devstack sudo[101576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:16 devstack sudo[101576]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:16 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a2c7c085-0124-4bd8-8179-2960fd24f59d tempest-GroupSnapshotsTest-1016258839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c81b8bc5-de70-4083-949e-cde9740a06bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c81b8bc5-de70-4083-949e-cde9740a06bb.bf626300-6caf-44a0-bae7-16da05cae967 1G" returned: 0 in 0.474s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:16 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a2c7c085-0124-4bd8-8179-2960fd24f59d tempest-GroupSnapshotsTest-1016258839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c81b8bc5-de70-4083-949e-cde9740a06bb -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c81b8bc5-de70-4083-949e-cde9740a06bb.bf626300-6caf-44a0-bae7-16da05cae967 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:16 devstack sudo[101582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c81b8bc5-de70-4083-949e-cde9740a06bb -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c81b8bc5-de70-4083-949e-cde9740a06bb.bf626300-6caf-44a0-bae7-16da05cae967 Jul 30 17:01:16 devstack sudo[101582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:16 devstack sudo[101582]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:16 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a2c7c085-0124-4bd8-8179-2960fd24f59d tempest-GroupSnapshotsTest-1016258839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c81b8bc5-de70-4083-949e-cde9740a06bb -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c81b8bc5-de70-4083-949e-cde9740a06bb.bf626300-6caf-44a0-bae7-16da05cae967" returned: 0 in 0.375s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:16 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-a2c7c085-0124-4bd8-8179-2960fd24f59d tempest-GroupSnapshotsTest-1016258839 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c81b8bc5-de70-4083-949e-cde9740a06bb.bf626300-6caf-44a0-bae7-16da05cae967 is being set with open permissions: ugo+rw: NotImplementedError Jul 30 17:01:16 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a2c7c085-0124-4bd8-8179-2960fd24f59d tempest-GroupSnapshotsTest-1016258839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c81b8bc5-de70-4083-949e-cde9740a06bb.bf626300-6caf-44a0-bae7-16da05cae967 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:16 devstack sudo[101589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c81b8bc5-de70-4083-949e-cde9740a06bb.bf626300-6caf-44a0-bae7-16da05cae967 Jul 30 17:01:16 devstack sudo[101589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:16 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-24d9435a-6581-4115-9a42-29379b187398 tempest-CreateVolumesFromSnapshotTest-266944850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:01:16 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-24d9435a-6581-4115-9a42-29379b187398 tempest-CreateVolumesFromSnapshotTest-266944850 None] Flow 'volume_create_manager' (4c6ccc35-f6e1-4934-897a-a4c007d675f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:01:16 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-24d9435a-6581-4115-9a42-29379b187398 tempest-CreateVolumesFromSnapshotTest-266944850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03ebae9c-df3c-4d44-8888-4242700641d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-24d9435a-6581-4115-9a42-29379b187398 tempest-CreateVolumesFromSnapshotTest-266944850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03ebae9c-df3c-4d44-8888-4242700641d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:01:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2051211561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f172482-6714-4ca9-bebd-224a830b485c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eea1270cda6460aba4b40f636e4e171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:01:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:01:17Z,use_quota=True,user_id='3442fa64ab634822907c5e08e96701ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-24d9435a-6581-4115-9a42-29379b187398 tempest-CreateVolumesFromSnapshotTest-266944850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab9327f3-c83a-420f-940d-0a0da4ef3b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-24d9435a-6581-4115-9a42-29379b187398 tempest-CreateVolumesFromSnapshotTest-266944850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab9327f3-c83a-420f-940d-0a0da4ef3b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-24d9435a-6581-4115-9a42-29379b187398 tempest-CreateVolumesFromSnapshotTest-266944850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (628aa43b-0aae-44a1-9ce7-dfb7c3b4feaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-24d9435a-6581-4115-9a42-29379b187398 tempest-CreateVolumesFromSnapshotTest-266944850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (628aa43b-0aae-44a1-9ce7-dfb7c3b4feaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f172482-6714-4ca9-bebd-224a830b485c', 'volume_name': 'volume-0f172482-6714-4ca9-bebd-224a830b485c', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-24d9435a-6581-4115-9a42-29379b187398 tempest-CreateVolumesFromSnapshotTest-266944850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f689fb8-b6b0-4c8c-986f-344e5d1c4f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-24d9435a-6581-4115-9a42-29379b187398 tempest-CreateVolumesFromSnapshotTest-266944850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f689fb8-b6b0-4c8c-986f-344e5d1c4f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-24d9435a-6581-4115-9a42-29379b187398 tempest-CreateVolumesFromSnapshotTest-266944850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87b489a2-a6f5-40dd-b80e-4813fd18988b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:17 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-24d9435a-6581-4115-9a42-29379b187398 tempest-CreateVolumesFromSnapshotTest-266944850 None] Volume 0f172482-6714-4ca9-bebd-224a830b485c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f172482-6714-4ca9-bebd-224a830b485c', 'volume_size': 1} Jul 30 17:01:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-24d9435a-6581-4115-9a42-29379b187398 tempest-CreateVolumesFromSnapshotTest-266944850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:01:17 devstack sudo[101589]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a2c7c085-0124-4bd8-8179-2960fd24f59d tempest-GroupSnapshotsTest-1016258839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c81b8bc5-de70-4083-949e-cde9740a06bb.bf626300-6caf-44a0-bae7-16da05cae967" returned: 0 in 0.323s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a2c7c085-0124-4bd8-8179-2960fd24f59d tempest-GroupSnapshotsTest-1016258839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c81b8bc5-de70-4083-949e-cde9740a06bb.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:17 devstack sudo[101592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c81b8bc5-de70-4083-949e-cde9740a06bb.info Jul 30 17:01:17 devstack sudo[101592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:17 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-91615bd8-981b-4639-902e-023ebbafc12a tempest-CreateVolumesFromSnapshotTest-266944850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:01:17 devstack sudo[101592]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-91615bd8-981b-4639-902e-023ebbafc12a tempest-CreateVolumesFromSnapshotTest-266944850 None] Flow 'volume_create_manager' (b769f273-efe3-47f0-8e32-3d671ddd4fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:01:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-91615bd8-981b-4639-902e-023ebbafc12a tempest-CreateVolumesFromSnapshotTest-266944850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1f60555-594b-40f7-8090-b9b76b39e698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a2c7c085-0124-4bd8-8179-2960fd24f59d tempest-GroupSnapshotsTest-1016258839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c81b8bc5-de70-4083-949e-cde9740a06bb.info" returned: 0 in 0.334s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:17 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-a2c7c085-0124-4bd8-8179-2960fd24f59d tempest-GroupSnapshotsTest-1016258839 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c81b8bc5-de70-4083-949e-cde9740a06bb.info is being set with open permissions: ugo+rw: NotImplementedError Jul 30 17:01:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a2c7c085-0124-4bd8-8179-2960fd24f59d tempest-GroupSnapshotsTest-1016258839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c81b8bc5-de70-4083-949e-cde9740a06bb.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-91615bd8-981b-4639-902e-023ebbafc12a tempest-CreateVolumesFromSnapshotTest-266944850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1f60555-594b-40f7-8090-b9b76b39e698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:01:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-517729973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c953467c-76a1-4eac-8b57-b4211745a899,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eea1270cda6460aba4b40f636e4e171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:01:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:01:17Z,use_quota=True,user_id='3442fa64ab634822907c5e08e96701ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:17 devstack sudo[101595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c81b8bc5-de70-4083-949e-cde9740a06bb.info Jul 30 17:01:17 devstack sudo[101595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-91615bd8-981b-4639-902e-023ebbafc12a tempest-CreateVolumesFromSnapshotTest-266944850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48634a72-64ff-44aa-b8a0-034cd8bd0a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-91615bd8-981b-4639-902e-023ebbafc12a tempest-CreateVolumesFromSnapshotTest-266944850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48634a72-64ff-44aa-b8a0-034cd8bd0a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-91615bd8-981b-4639-902e-023ebbafc12a tempest-CreateVolumesFromSnapshotTest-266944850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (097e9c6e-ca50-4831-bb4f-7389e54b3161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-91615bd8-981b-4639-902e-023ebbafc12a tempest-CreateVolumesFromSnapshotTest-266944850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (097e9c6e-ca50-4831-bb4f-7389e54b3161) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c953467c-76a1-4eac-8b57-b4211745a899', 'volume_name': 'volume-c953467c-76a1-4eac-8b57-b4211745a899', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-91615bd8-981b-4639-902e-023ebbafc12a tempest-CreateVolumesFromSnapshotTest-266944850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7736fd18-c3d9-469d-9df2-65c2211a093d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-91615bd8-981b-4639-902e-023ebbafc12a tempest-CreateVolumesFromSnapshotTest-266944850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7736fd18-c3d9-469d-9df2-65c2211a093d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-91615bd8-981b-4639-902e-023ebbafc12a tempest-CreateVolumesFromSnapshotTest-266944850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b86e48d4-0fd9-4187-b774-ac7cc3e5fb89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:17 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-91615bd8-981b-4639-902e-023ebbafc12a tempest-CreateVolumesFromSnapshotTest-266944850 None] Volume c953467c-76a1-4eac-8b57-b4211745a899: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c953467c-76a1-4eac-8b57-b4211745a899', 'volume_size': 1} Jul 30 17:01:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-91615bd8-981b-4639-902e-023ebbafc12a tempest-CreateVolumesFromSnapshotTest-266944850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:01:17 devstack sudo[101595]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a2c7c085-0124-4bd8-8179-2960fd24f59d tempest-GroupSnapshotsTest-1016258839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c81b8bc5-de70-4083-949e-cde9740a06bb.info" returned: 0 in 0.305s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a2c7c085-0124-4bd8-8179-2960fd24f59d tempest-GroupSnapshotsTest-1016258839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.283s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:01:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-24d9435a-6581-4115-9a42-29379b187398 tempest-CreateVolumesFromSnapshotTest-266944850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.705s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:01:17 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-24d9435a-6581-4115-9a42-29379b187398 tempest-CreateVolumesFromSnapshotTest-266944850 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:01:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2051211561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f172482-6714-4ca9-bebd-224a830b485c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eea1270cda6460aba4b40f636e4e171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:01:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:01:17Z,use_quota=True,user_id='3442fa64ab634822907c5e08e96701ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:01:17 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-24d9435a-6581-4115-9a42-29379b187398 tempest-CreateVolumesFromSnapshotTest-266944850 None] Creating volume 0f172482-6714-4ca9-bebd-224a830b485c {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:01:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-24d9435a-6581-4115-9a42-29379b187398 tempest-CreateVolumesFromSnapshotTest-266944850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:01:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-24d9435a-6581-4115-9a42-29379b187398 tempest-CreateVolumesFromSnapshotTest-266944850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:01:17 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-24d9435a-6581-4115-9a42-29379b187398 tempest-CreateVolumesFromSnapshotTest-266944850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:01:17 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-24d9435a-6581-4115-9a42-29379b187398 tempest-CreateVolumesFromSnapshotTest-266944850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:01:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-24d9435a-6581-4115-9a42-29379b187398 tempest-CreateVolumesFromSnapshotTest-266944850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:01:17 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-24d9435a-6581-4115-9a42-29379b187398 tempest-CreateVolumesFromSnapshotTest-266944850 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:01:17 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-24d9435a-6581-4115-9a42-29379b187398 tempest-CreateVolumesFromSnapshotTest-266944850 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:01:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-24d9435a-6581-4115-9a42-29379b187398 tempest-CreateVolumesFromSnapshotTest-266944850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0f172482-6714-4ca9-bebd-224a830b485c 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:17 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c3a074c-acc0-4973-887a-57848239d0eb tempest-CreateVolumesFromSnapshotTest-266944850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:01:17 devstack sudo[101598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0f172482-6714-4ca9-bebd-224a830b485c 1073741824 Jul 30 17:01:17 devstack sudo[101598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-2c3a074c-acc0-4973-887a-57848239d0eb tempest-CreateVolumesFromSnapshotTest-266944850 None] Flow 'volume_create_manager' (7b7f895f-7e2a-4114-b279-39f8b62f7543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:01:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-2c3a074c-acc0-4973-887a-57848239d0eb tempest-CreateVolumesFromSnapshotTest-266944850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5761b98-78bd-4980-bfc5-b7c55fce5e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-2c3a074c-acc0-4973-887a-57848239d0eb tempest-CreateVolumesFromSnapshotTest-266944850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5761b98-78bd-4980-bfc5-b7c55fce5e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:01:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-717976175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95abc6c8-ba6f-46e0-94d0-4202afa9c6ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eea1270cda6460aba4b40f636e4e171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:01:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:01:18Z,use_quota=True,user_id='3442fa64ab634822907c5e08e96701ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-2c3a074c-acc0-4973-887a-57848239d0eb tempest-CreateVolumesFromSnapshotTest-266944850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2a49310-22f7-4dce-ab7d-2f1abcf4f00a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-2c3a074c-acc0-4973-887a-57848239d0eb tempest-CreateVolumesFromSnapshotTest-266944850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2a49310-22f7-4dce-ab7d-2f1abcf4f00a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-2c3a074c-acc0-4973-887a-57848239d0eb tempest-CreateVolumesFromSnapshotTest-266944850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (240405cb-42aa-49c7-929e-d29b0ea09516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-2c3a074c-acc0-4973-887a-57848239d0eb tempest-CreateVolumesFromSnapshotTest-266944850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (240405cb-42aa-49c7-929e-d29b0ea09516) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95abc6c8-ba6f-46e0-94d0-4202afa9c6ba', 'volume_name': 'volume-95abc6c8-ba6f-46e0-94d0-4202afa9c6ba', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-2c3a074c-acc0-4973-887a-57848239d0eb tempest-CreateVolumesFromSnapshotTest-266944850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0de58e73-a274-4e38-ab5a-18ec04ff0d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-2c3a074c-acc0-4973-887a-57848239d0eb tempest-CreateVolumesFromSnapshotTest-266944850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0de58e73-a274-4e38-ab5a-18ec04ff0d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-2c3a074c-acc0-4973-887a-57848239d0eb tempest-CreateVolumesFromSnapshotTest-266944850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dae78e3b-8b7f-4aec-b59a-59107c431db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:17 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-2c3a074c-acc0-4973-887a-57848239d0eb tempest-CreateVolumesFromSnapshotTest-266944850 None] Volume 95abc6c8-ba6f-46e0-94d0-4202afa9c6ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95abc6c8-ba6f-46e0-94d0-4202afa9c6ba', 'volume_size': 1} Jul 30 17:01:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-2c3a074c-acc0-4973-887a-57848239d0eb tempest-CreateVolumesFromSnapshotTest-266944850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:01:17 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-a2c7c085-0124-4bd8-8179-2960fd24f59d tempest-GroupSnapshotsTest-1016258839 None] group_snapshot ec949122-81ec-44b1-a495-b68407e35cdf: created successfully Jul 30 17:01:18 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-e08c0011-9b6c-464d-81c7-5ce1418f1fde tempest-CreateVolumesFromSnapshotTest-266944850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:01:18 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e08c0011-9b6c-464d-81c7-5ce1418f1fde tempest-CreateVolumesFromSnapshotTest-266944850 None] Flow 'volume_create_manager' (3538a37d-4f71-4c22-abd9-130a4fb23991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:01:18 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e08c0011-9b6c-464d-81c7-5ce1418f1fde tempest-CreateVolumesFromSnapshotTest-266944850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98af2fe7-0375-4eb9-ad62-b3a1e778eb1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:18 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e08c0011-9b6c-464d-81c7-5ce1418f1fde tempest-CreateVolumesFromSnapshotTest-266944850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98af2fe7-0375-4eb9-ad62-b3a1e778eb1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:01:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1948917303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bad6c33-1992-410c-b87b-764df4cc1bf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eea1270cda6460aba4b40f636e4e171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:01:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:01:18Z,use_quota=True,user_id='3442fa64ab634822907c5e08e96701ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:18 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e08c0011-9b6c-464d-81c7-5ce1418f1fde tempest-CreateVolumesFromSnapshotTest-266944850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef35326c-1ab8-4adb-9d85-b3c30c42c65a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:18 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e08c0011-9b6c-464d-81c7-5ce1418f1fde tempest-CreateVolumesFromSnapshotTest-266944850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef35326c-1ab8-4adb-9d85-b3c30c42c65a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:18 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e08c0011-9b6c-464d-81c7-5ce1418f1fde tempest-CreateVolumesFromSnapshotTest-266944850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28ad1cb5-0132-476e-9eb2-01b24f8830d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:18 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e08c0011-9b6c-464d-81c7-5ce1418f1fde tempest-CreateVolumesFromSnapshotTest-266944850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28ad1cb5-0132-476e-9eb2-01b24f8830d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bad6c33-1992-410c-b87b-764df4cc1bf1', 'volume_name': 'volume-9bad6c33-1992-410c-b87b-764df4cc1bf1', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:18 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e08c0011-9b6c-464d-81c7-5ce1418f1fde tempest-CreateVolumesFromSnapshotTest-266944850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8c45181-5f68-4dfa-9582-4c66c406449a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:18 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e08c0011-9b6c-464d-81c7-5ce1418f1fde tempest-CreateVolumesFromSnapshotTest-266944850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8c45181-5f68-4dfa-9582-4c66c406449a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:18 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e08c0011-9b6c-464d-81c7-5ce1418f1fde tempest-CreateVolumesFromSnapshotTest-266944850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a86085df-1701-4073-b28d-f9b321b40f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:18 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-e08c0011-9b6c-464d-81c7-5ce1418f1fde tempest-CreateVolumesFromSnapshotTest-266944850 None] Volume 9bad6c33-1992-410c-b87b-764df4cc1bf1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bad6c33-1992-410c-b87b-764df4cc1bf1', 'volume_size': 1} Jul 30 17:01:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-e08c0011-9b6c-464d-81c7-5ce1418f1fde tempest-CreateVolumesFromSnapshotTest-266944850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:01:18 devstack sudo[101598]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-24d9435a-6581-4115-9a42-29379b187398 tempest-CreateVolumesFromSnapshotTest-266944850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0f172482-6714-4ca9-bebd-224a830b485c 1073741824" returned: 0 in 0.568s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-24d9435a-6581-4115-9a42-29379b187398 tempest-CreateVolumesFromSnapshotTest-266944850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0f172482-6714-4ca9-bebd-224a830b485c {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:18 devstack sudo[101604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0f172482-6714-4ca9-bebd-224a830b485c Jul 30 17:01:18 devstack sudo[101604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:18 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-95ad5fbb-b7e2-4980-8968-4121b612161e tempest-GroupSnapshotsTest-1016258839 None] group_snapshot ec949122-81ec-44b1-a495-b68407e35cdf: deleting Jul 30 17:01:18 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed74566c-d96e-48f1-86dc-8b0dde32ce0b tempest-CreateVolumesFromSnapshotTest-266944850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:01:18 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ed74566c-d96e-48f1-86dc-8b0dde32ce0b tempest-CreateVolumesFromSnapshotTest-266944850 None] Flow 'volume_create_manager' (97861ef6-e4c6-42b1-b9c9-ac5cbeb3b164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:01:18 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ed74566c-d96e-48f1-86dc-8b0dde32ce0b tempest-CreateVolumesFromSnapshotTest-266944850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ed7b21b-8414-4f9a-b77c-a5b9c859d632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:18 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-95ad5fbb-b7e2-4980-8968-4121b612161e tempest-GroupSnapshotsTest-1016258839 None] group_snapshot ec949122-81ec-44b1-a495-b68407e35cdf: deleting {{(pid=88568) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 30 17:01:18 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ed74566c-d96e-48f1-86dc-8b0dde32ce0b tempest-CreateVolumesFromSnapshotTest-266944850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ed7b21b-8414-4f9a-b77c-a5b9c859d632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:01:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-753828631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83050062-da16-4f3f-8c26-5f086c2d5e8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eea1270cda6460aba4b40f636e4e171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:01:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:01:19Z,use_quota=True,user_id='3442fa64ab634822907c5e08e96701ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:18 devstack sudo[101604]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:18 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ed74566c-d96e-48f1-86dc-8b0dde32ce0b tempest-CreateVolumesFromSnapshotTest-266944850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (224addad-cf00-4d59-9e35-35f4dd302194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:18 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ed74566c-d96e-48f1-86dc-8b0dde32ce0b tempest-CreateVolumesFromSnapshotTest-266944850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (224addad-cf00-4d59-9e35-35f4dd302194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:18 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ed74566c-d96e-48f1-86dc-8b0dde32ce0b tempest-CreateVolumesFromSnapshotTest-266944850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (750afad5-6367-48c7-9d95-9db78ef3bdf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:18 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ed74566c-d96e-48f1-86dc-8b0dde32ce0b tempest-CreateVolumesFromSnapshotTest-266944850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (750afad5-6367-48c7-9d95-9db78ef3bdf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83050062-da16-4f3f-8c26-5f086c2d5e8a', 'volume_name': 'volume-83050062-da16-4f3f-8c26-5f086c2d5e8a', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:18 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ed74566c-d96e-48f1-86dc-8b0dde32ce0b tempest-CreateVolumesFromSnapshotTest-266944850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28bd248c-91a7-4b2c-879d-d6924338f0eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:18 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ed74566c-d96e-48f1-86dc-8b0dde32ce0b tempest-CreateVolumesFromSnapshotTest-266944850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28bd248c-91a7-4b2c-879d-d6924338f0eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:18 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ed74566c-d96e-48f1-86dc-8b0dde32ce0b tempest-CreateVolumesFromSnapshotTest-266944850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baa094f6-91a8-4fab-a649-10dd7d3a44f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:18 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-ed74566c-d96e-48f1-86dc-8b0dde32ce0b tempest-CreateVolumesFromSnapshotTest-266944850 None] Volume 83050062-da16-4f3f-8c26-5f086c2d5e8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83050062-da16-4f3f-8c26-5f086c2d5e8a', 'volume_size': 1} Jul 30 17:01:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-ed74566c-d96e-48f1-86dc-8b0dde32ce0b tempest-CreateVolumesFromSnapshotTest-266944850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:01:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-24d9435a-6581-4115-9a42-29379b187398 tempest-CreateVolumesFromSnapshotTest-266944850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0f172482-6714-4ca9-bebd-224a830b485c" returned: 0 in 0.371s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:18 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-24d9435a-6581-4115-9a42-29379b187398 tempest-CreateVolumesFromSnapshotTest-266944850 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:01:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-24d9435a-6581-4115-9a42-29379b187398 tempest-CreateVolumesFromSnapshotTest-266944850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:01:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-91615bd8-981b-4639-902e-023ebbafc12a tempest-CreateVolumesFromSnapshotTest-266944850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.252s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:01:18 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-91615bd8-981b-4639-902e-023ebbafc12a tempest-CreateVolumesFromSnapshotTest-266944850 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:01:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-517729973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c953467c-76a1-4eac-8b57-b4211745a899,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eea1270cda6460aba4b40f636e4e171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:01:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:01:17Z,use_quota=True,user_id='3442fa64ab634822907c5e08e96701ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:01:18 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-91615bd8-981b-4639-902e-023ebbafc12a tempest-CreateVolumesFromSnapshotTest-266944850 None] Creating volume c953467c-76a1-4eac-8b57-b4211745a899 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:01:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-91615bd8-981b-4639-902e-023ebbafc12a tempest-CreateVolumesFromSnapshotTest-266944850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:01:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-91615bd8-981b-4639-902e-023ebbafc12a tempest-CreateVolumesFromSnapshotTest-266944850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:01:18 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-91615bd8-981b-4639-902e-023ebbafc12a tempest-CreateVolumesFromSnapshotTest-266944850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:01:18 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-91615bd8-981b-4639-902e-023ebbafc12a tempest-CreateVolumesFromSnapshotTest-266944850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:01:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-91615bd8-981b-4639-902e-023ebbafc12a tempest-CreateVolumesFromSnapshotTest-266944850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:01:18 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-91615bd8-981b-4639-902e-023ebbafc12a tempest-CreateVolumesFromSnapshotTest-266944850 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:01:18 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-91615bd8-981b-4639-902e-023ebbafc12a tempest-CreateVolumesFromSnapshotTest-266944850 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:01:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-91615bd8-981b-4639-902e-023ebbafc12a tempest-CreateVolumesFromSnapshotTest-266944850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c953467c-76a1-4eac-8b57-b4211745a899 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:18 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-95ad5fbb-b7e2-4980-8968-4121b612161e tempest-GroupSnapshotsTest-1016258839 None] Acquiring lock "cinder-quobyte-c81b8bc5-de70-4083-949e-cde9740a06bb" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:01:18 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-24d9435a-6581-4115-9a42-29379b187398 tempest-CreateVolumesFromSnapshotTest-266944850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87b489a2-a6f5-40dd-b80e-4813fd18988b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f172482-6714-4ca9-bebd-224a830b485c', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:18 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-24d9435a-6581-4115-9a42-29379b187398 tempest-CreateVolumesFromSnapshotTest-266944850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0ec3ea5-06f2-4dad-be67-961282c2d56b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:18 devstack sudo[101607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c953467c-76a1-4eac-8b57-b4211745a899 1073741824 Jul 30 17:01:18 devstack sudo[101607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:18 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-95ad5fbb-b7e2-4980-8968-4121b612161e tempest-GroupSnapshotsTest-1016258839 None] Lock "cinder-quobyte-c81b8bc5-de70-4083-949e-cde9740a06bb" acquired by "delete_snapshot" :: waited 0.054s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:01:18 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-95ad5fbb-b7e2-4980-8968-4121b612161e tempest-GroupSnapshotsTest-1016258839 None] Acquiring lock "cinder-quobyte-bf626300-6caf-44a0-bae7-16da05cae967" by "_delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:01:18 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-24d9435a-6581-4115-9a42-29379b187398 tempest-CreateVolumesFromSnapshotTest-266944850 None] Volume volume-0f172482-6714-4ca9-bebd-224a830b485c (0f172482-6714-4ca9-bebd-224a830b485c): created successfully Jul 30 17:01:18 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-24d9435a-6581-4115-9a42-29379b187398 tempest-CreateVolumesFromSnapshotTest-266944850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0ec3ea5-06f2-4dad-be67-961282c2d56b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:18 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-24d9435a-6581-4115-9a42-29379b187398 tempest-CreateVolumesFromSnapshotTest-266944850 None] Flow 'volume_create_manager' (4c6ccc35-f6e1-4934-897a-a4c007d675f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:01:18 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-95ad5fbb-b7e2-4980-8968-4121b612161e tempest-GroupSnapshotsTest-1016258839 None] Lock "cinder-quobyte-bf626300-6caf-44a0-bae7-16da05cae967" acquired by "_delete_snapshot" :: waited 0.057s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:01:18 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-95ad5fbb-b7e2-4980-8968-4121b612161e tempest-GroupSnapshotsTest-1016258839 None] Deleting offline snapshot bf626300-6caf-44a0-bae7-16da05cae967 of volume c81b8bc5-de70-4083-949e-cde9740a06bb {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:01:18 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-95ad5fbb-b7e2-4980-8968-4121b612161e tempest-GroupSnapshotsTest-1016258839 None] snapshot_file for this snap is: volume-c81b8bc5-de70-4083-949e-cde9740a06bb.bf626300-6caf-44a0-bae7-16da05cae967 {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:01:18 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-24d9435a-6581-4115-9a42-29379b187398 tempest-CreateVolumesFromSnapshotTest-266944850 None] Created volume successfully. Jul 30 17:01:18 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[d528ac21-e89c-4cbe-a8da-b3b4e8c4c7c5]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:01:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-95ad5fbb-b7e2-4980-8968-4121b612161e tempest-GroupSnapshotsTest-1016258839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c81b8bc5-de70-4083-949e-cde9740a06bb.bf626300-6caf-44a0-bae7-16da05cae967 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:19 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc61b1ea-63f9-40fb-9dab-73c6031950b3 tempest-VolumesExtendTest-719667368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:01:19 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fc61b1ea-63f9-40fb-9dab-73c6031950b3 tempest-VolumesExtendTest-719667368 None] Flow 'volume_create_manager' (79ce2488-4caf-4e3c-b576-29b0810e11d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:01:19 devstack sudo[101609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c81b8bc5-de70-4083-949e-cde9740a06bb.bf626300-6caf-44a0-bae7-16da05cae967 Jul 30 17:01:19 devstack sudo[101609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:19 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fc61b1ea-63f9-40fb-9dab-73c6031950b3 tempest-VolumesExtendTest-719667368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28a08507-0223-4f32-9f84-3aae05ce81c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:19 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fc61b1ea-63f9-40fb-9dab-73c6031950b3 tempest-VolumesExtendTest-719667368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28a08507-0223-4f32-9f84-3aae05ce81c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:01:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-955138376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=184de0c7-4bb0-4057-a4d9-72519feb5a32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb9f62d3088f454897cc8a64f20043e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:01:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:01:19Z,use_quota=True,user_id='88b01a22a72b46cba74cbdaba3ecebd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:19 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fc61b1ea-63f9-40fb-9dab-73c6031950b3 tempest-VolumesExtendTest-719667368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5469740-23ed-46c5-84d2-5e07a893326d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:19 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fc61b1ea-63f9-40fb-9dab-73c6031950b3 tempest-VolumesExtendTest-719667368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5469740-23ed-46c5-84d2-5e07a893326d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:19 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fc61b1ea-63f9-40fb-9dab-73c6031950b3 tempest-VolumesExtendTest-719667368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3bf653c-218a-4edd-ac82-e8c824b7dc9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:19 devstack cinder-volume[88568]: DEBUG cinder.image.glance [None req-fc61b1ea-63f9-40fb-9dab-73c6031950b3 tempest-VolumesExtendTest-719667368 None] Creating Keystone auth plugin from conf {{(pid=88568) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 30 17:01:19 devstack sudo[101607]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:19 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-91615bd8-981b-4639-902e-023ebbafc12a tempest-CreateVolumesFromSnapshotTest-266944850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c953467c-76a1-4eac-8b57-b4211745a899 1073741824" returned: 0 in 0.520s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:19 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-91615bd8-981b-4639-902e-023ebbafc12a tempest-CreateVolumesFromSnapshotTest-266944850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c953467c-76a1-4eac-8b57-b4211745a899 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:19 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fc61b1ea-63f9-40fb-9dab-73c6031950b3 tempest-VolumesExtendTest-719667368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3bf653c-218a-4edd-ac82-e8c824b7dc9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '184de0c7-4bb0-4057-a4d9-72519feb5a32', 'volume_name': 'volume-184de0c7-4bb0-4057-a4d9-72519feb5a32', 'volume_size': 1, 'image_id': '6126230f-0fba-48b9-943c-1885f4fc4be0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6126230f-0fba-48b9-943c-1885f4fc4be0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2802aa975ace4011a130c68c7a9c96bb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6126230f-0fba-48b9-943c-1885f4fc4be0', 'created_at': datetime.datetime(2026, 7, 30, 14, 43, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 43, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6126230f-0fba-48b9-943c-1885f4fc4be0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:19 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fc61b1ea-63f9-40fb-9dab-73c6031950b3 tempest-VolumesExtendTest-719667368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75be2a90-6e2f-4b84-9955-4e0d2488a19f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:19 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fc61b1ea-63f9-40fb-9dab-73c6031950b3 tempest-VolumesExtendTest-719667368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75be2a90-6e2f-4b84-9955-4e0d2488a19f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:19 devstack sudo[101618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c953467c-76a1-4eac-8b57-b4211745a899 Jul 30 17:01:19 devstack sudo[101618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:19 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fc61b1ea-63f9-40fb-9dab-73c6031950b3 tempest-VolumesExtendTest-719667368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4475aea7-ef65-4d24-9a8c-8f1e98ce6999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:19 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-fc61b1ea-63f9-40fb-9dab-73c6031950b3 tempest-VolumesExtendTest-719667368 None] Volume 184de0c7-4bb0-4057-a4d9-72519feb5a32: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-184de0c7-4bb0-4057-a4d9-72519feb5a32', 'volume_size': 1, 'image_id': '6126230f-0fba-48b9-943c-1885f4fc4be0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6126230f-0fba-48b9-943c-1885f4fc4be0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2802aa975ace4011a130c68c7a9c96bb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6126230f-0fba-48b9-943c-1885f4fc4be0', 'created_at': datetime.datetime(2026, 7, 30, 14, 43, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 43, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6126230f-0fba-48b9-943c-1885f4fc4be0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 30 17:01:19 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc61b1ea-63f9-40fb-9dab-73c6031950b3 tempest-VolumesExtendTest-719667368 None] Trying to clone 184de0c7-4bb0-4057-a4d9-72519feb5a32 from image 6126230f-0fba-48b9-943c-1885f4fc4be0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6126230f-0fba-48b9-943c-1885f4fc4be0', 'metadata': {}}]). {{(pid=88568) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 30 17:01:19 devstack sudo[101609]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:19 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-95ad5fbb-b7e2-4980-8968-4121b612161e tempest-GroupSnapshotsTest-1016258839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c81b8bc5-de70-4083-949e-cde9740a06bb.bf626300-6caf-44a0-bae7-16da05cae967" returned: 0 in 0.427s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:19 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-95ad5fbb-b7e2-4980-8968-4121b612161e tempest-GroupSnapshotsTest-1016258839 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c81b8bc5-de70-4083-949e-cde9740a06bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:01:19 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[33933651-b601-46ee-ac11-58c68c273add]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:01:19 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-95ad5fbb-b7e2-4980-8968-4121b612161e tempest-GroupSnapshotsTest-1016258839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c81b8bc5-de70-4083-949e-cde9740a06bb {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:19 devstack sudo[101620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c81b8bc5-de70-4083-949e-cde9740a06bb Jul 30 17:01:19 devstack sudo[101620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:19 devstack sudo[101618]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:19 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-91615bd8-981b-4639-902e-023ebbafc12a tempest-CreateVolumesFromSnapshotTest-266944850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c953467c-76a1-4eac-8b57-b4211745a899" returned: 0 in 0.319s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:19 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-91615bd8-981b-4639-902e-023ebbafc12a tempest-CreateVolumesFromSnapshotTest-266944850 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:01:19 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-91615bd8-981b-4639-902e-023ebbafc12a tempest-CreateVolumesFromSnapshotTest-266944850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:01:19 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-2c3a074c-acc0-4973-887a-57848239d0eb tempest-CreateVolumesFromSnapshotTest-266944850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.760s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:01:19 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-2c3a074c-acc0-4973-887a-57848239d0eb tempest-CreateVolumesFromSnapshotTest-266944850 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:01:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-717976175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95abc6c8-ba6f-46e0-94d0-4202afa9c6ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eea1270cda6460aba4b40f636e4e171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:01:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:01:18Z,use_quota=True,user_id='3442fa64ab634822907c5e08e96701ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:01:19 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-2c3a074c-acc0-4973-887a-57848239d0eb tempest-CreateVolumesFromSnapshotTest-266944850 None] Creating volume 95abc6c8-ba6f-46e0-94d0-4202afa9c6ba {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:01:19 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-2c3a074c-acc0-4973-887a-57848239d0eb tempest-CreateVolumesFromSnapshotTest-266944850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:01:19 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-2c3a074c-acc0-4973-887a-57848239d0eb tempest-CreateVolumesFromSnapshotTest-266944850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:01:19 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-2c3a074c-acc0-4973-887a-57848239d0eb tempest-CreateVolumesFromSnapshotTest-266944850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:01:19 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-2c3a074c-acc0-4973-887a-57848239d0eb tempest-CreateVolumesFromSnapshotTest-266944850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:01:19 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-2c3a074c-acc0-4973-887a-57848239d0eb tempest-CreateVolumesFromSnapshotTest-266944850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:01:19 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-2c3a074c-acc0-4973-887a-57848239d0eb tempest-CreateVolumesFromSnapshotTest-266944850 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:01:19 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-2c3a074c-acc0-4973-887a-57848239d0eb tempest-CreateVolumesFromSnapshotTest-266944850 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:01:19 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2c3a074c-acc0-4973-887a-57848239d0eb tempest-CreateVolumesFromSnapshotTest-266944850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-95abc6c8-ba6f-46e0-94d0-4202afa9c6ba 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:19 devstack sudo[101623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-95abc6c8-ba6f-46e0-94d0-4202afa9c6ba 1073741824 Jul 30 17:01:19 devstack sudo[101623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:19 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-91615bd8-981b-4639-902e-023ebbafc12a tempest-CreateVolumesFromSnapshotTest-266944850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b86e48d4-0fd9-4187-b774-ac7cc3e5fb89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c953467c-76a1-4eac-8b57-b4211745a899', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:19 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-91615bd8-981b-4639-902e-023ebbafc12a tempest-CreateVolumesFromSnapshotTest-266944850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (667084ac-ae94-4ff5-b083-21072229d8d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:19 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-91615bd8-981b-4639-902e-023ebbafc12a tempest-CreateVolumesFromSnapshotTest-266944850 None] Volume volume-c953467c-76a1-4eac-8b57-b4211745a899 (c953467c-76a1-4eac-8b57-b4211745a899): created successfully Jul 30 17:01:19 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-91615bd8-981b-4639-902e-023ebbafc12a tempest-CreateVolumesFromSnapshotTest-266944850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (667084ac-ae94-4ff5-b083-21072229d8d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:19 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-91615bd8-981b-4639-902e-023ebbafc12a tempest-CreateVolumesFromSnapshotTest-266944850 None] Flow 'volume_create_manager' (b769f273-efe3-47f0-8e32-3d671ddd4fa3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:01:19 devstack sudo[101620]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:19 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-91615bd8-981b-4639-902e-023ebbafc12a tempest-CreateVolumesFromSnapshotTest-266944850 None] Created volume successfully. Jul 30 17:01:19 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-95ad5fbb-b7e2-4980-8968-4121b612161e tempest-GroupSnapshotsTest-1016258839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c81b8bc5-de70-4083-949e-cde9740a06bb" returned: 0 in 0.434s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:19 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-95ad5fbb-b7e2-4980-8968-4121b612161e tempest-GroupSnapshotsTest-1016258839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c81b8bc5-de70-4083-949e-cde9740a06bb.bf626300-6caf-44a0-bae7-16da05cae967 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:19 devstack cinder-volume[88568]: DEBUG cinder.image.image_utils [None req-fc61b1ea-63f9-40fb-9dab-73c6031950b3 tempest-VolumesExtendTest-719667368 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6126230f-0fba-48b9-943c-1885f4fc4be0_hn0m6khkdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88568) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 30 17:01:19 devstack cinder-volume[88568]: INFO cinder.image.image_utils [None req-fc61b1ea-63f9-40fb-9dab-73c6031950b3 tempest-VolumesExtendTest-719667368 None] Image download 20.69 MB at 20.69 MB/s Jul 30 17:01:19 devstack sudo[101629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c81b8bc5-de70-4083-949e-cde9740a06bb.bf626300-6caf-44a0-bae7-16da05cae967 Jul 30 17:01:19 devstack sudo[101629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:20 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37c8b15-da50-4165-a64e-a01774394c04]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:01:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fc61b1ea-63f9-40fb-9dab-73c6031950b3 tempest-VolumesExtendTest-719667368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6126230f-0fba-48b9-943c-1885f4fc4be0_hn0m6khkdevstack@QuobyteHD {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:20 devstack sudo[101631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6126230f-0fba-48b9-943c-1885f4fc4be0_hn0m6khkdevstack@QuobyteHD Jul 30 17:01:20 devstack sudo[101631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:20 devstack sudo[101623]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2c3a074c-acc0-4973-887a-57848239d0eb tempest-CreateVolumesFromSnapshotTest-266944850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-95abc6c8-ba6f-46e0-94d0-4202afa9c6ba 1073741824" returned: 0 in 0.548s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:20 devstack sudo[101629]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-95ad5fbb-b7e2-4980-8968-4121b612161e tempest-GroupSnapshotsTest-1016258839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c81b8bc5-de70-4083-949e-cde9740a06bb.bf626300-6caf-44a0-bae7-16da05cae967" returned: 0 in 0.405s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-95ad5fbb-b7e2-4980-8968-4121b612161e tempest-GroupSnapshotsTest-1016258839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c81b8bc5-de70-4083-949e-cde9740a06bb.bf626300-6caf-44a0-bae7-16da05cae967 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2c3a074c-acc0-4973-887a-57848239d0eb tempest-CreateVolumesFromSnapshotTest-266944850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-95abc6c8-ba6f-46e0-94d0-4202afa9c6ba {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:20 devstack sudo[101641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c81b8bc5-de70-4083-949e-cde9740a06bb.bf626300-6caf-44a0-bae7-16da05cae967 Jul 30 17:01:20 devstack sudo[101641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:20 devstack sudo[101642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-95abc6c8-ba6f-46e0-94d0-4202afa9c6ba Jul 30 17:01:20 devstack sudo[101642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:20 devstack sudo[101631]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fc61b1ea-63f9-40fb-9dab-73c6031950b3 tempest-VolumesExtendTest-719667368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6126230f-0fba-48b9-943c-1885f4fc4be0_hn0m6khkdevstack@QuobyteHD" returned: 0 in 0.371s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:20 devstack cinder-volume[88568]: DEBUG cinder.image.image_utils [None req-fc61b1ea-63f9-40fb-9dab-73c6031950b3 tempest-VolumesExtendTest-719667368 None] Temporary image 6126230f-0fba-48b9-943c-1885f4fc4be0 is fetched for user 88b01a22a72b46cba74cbdaba3ecebd5. {{(pid=88568) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 30 17:01:20 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77deb2e-3561-42d2-88e4-5c76de51b26a]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:01:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fc61b1ea-63f9-40fb-9dab-73c6031950b3 tempest-VolumesExtendTest-719667368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6126230f-0fba-48b9-943c-1885f4fc4be0_hn0m6khkdevstack@QuobyteHD {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:20 devstack sudo[101641]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:20 devstack sudo[101648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6126230f-0fba-48b9-943c-1885f4fc4be0_hn0m6khkdevstack@QuobyteHD Jul 30 17:01:20 devstack sudo[101648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-95ad5fbb-b7e2-4980-8968-4121b612161e tempest-GroupSnapshotsTest-1016258839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c81b8bc5-de70-4083-949e-cde9740a06bb.bf626300-6caf-44a0-bae7-16da05cae967" returned: 0 in 0.271s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:20 devstack sudo[101642]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2c3a074c-acc0-4973-887a-57848239d0eb tempest-CreateVolumesFromSnapshotTest-266944850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-95abc6c8-ba6f-46e0-94d0-4202afa9c6ba" returned: 0 in 0.286s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:20 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-2c3a074c-acc0-4973-887a-57848239d0eb tempest-CreateVolumesFromSnapshotTest-266944850 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:01:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-2c3a074c-acc0-4973-887a-57848239d0eb tempest-CreateVolumesFromSnapshotTest-266944850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:01:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-e08c0011-9b6c-464d-81c7-5ce1418f1fde tempest-CreateVolumesFromSnapshotTest-266944850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.280s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:01:20 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-e08c0011-9b6c-464d-81c7-5ce1418f1fde tempest-CreateVolumesFromSnapshotTest-266944850 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:01:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1948917303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bad6c33-1992-410c-b87b-764df4cc1bf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eea1270cda6460aba4b40f636e4e171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:01:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:01:18Z,use_quota=True,user_id='3442fa64ab634822907c5e08e96701ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:01:20 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-e08c0011-9b6c-464d-81c7-5ce1418f1fde tempest-CreateVolumesFromSnapshotTest-266944850 None] Creating volume 9bad6c33-1992-410c-b87b-764df4cc1bf1 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:01:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-e08c0011-9b6c-464d-81c7-5ce1418f1fde tempest-CreateVolumesFromSnapshotTest-266944850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:01:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-e08c0011-9b6c-464d-81c7-5ce1418f1fde tempest-CreateVolumesFromSnapshotTest-266944850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:01:20 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-e08c0011-9b6c-464d-81c7-5ce1418f1fde tempest-CreateVolumesFromSnapshotTest-266944850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:01:20 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-e08c0011-9b6c-464d-81c7-5ce1418f1fde tempest-CreateVolumesFromSnapshotTest-266944850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:01:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-e08c0011-9b6c-464d-81c7-5ce1418f1fde tempest-CreateVolumesFromSnapshotTest-266944850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:01:20 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-e08c0011-9b6c-464d-81c7-5ce1418f1fde tempest-CreateVolumesFromSnapshotTest-266944850 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:01:20 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-e08c0011-9b6c-464d-81c7-5ce1418f1fde tempest-CreateVolumesFromSnapshotTest-266944850 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:01:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e08c0011-9b6c-464d-81c7-5ce1418f1fde tempest-CreateVolumesFromSnapshotTest-266944850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9bad6c33-1992-410c-b87b-764df4cc1bf1 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:20 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-95ad5fbb-b7e2-4980-8968-4121b612161e tempest-GroupSnapshotsTest-1016258839 None] Lock "cinder-quobyte-bf626300-6caf-44a0-bae7-16da05cae967" released by "_delete_snapshot" :: held 1.700s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:01:20 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-2c3a074c-acc0-4973-887a-57848239d0eb tempest-CreateVolumesFromSnapshotTest-266944850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dae78e3b-8b7f-4aec-b59a-59107c431db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95abc6c8-ba6f-46e0-94d0-4202afa9c6ba', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:20 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-2c3a074c-acc0-4973-887a-57848239d0eb tempest-CreateVolumesFromSnapshotTest-266944850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ede22b46-83df-4bca-a7ea-1abdca036954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:20 devstack sudo[101652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9bad6c33-1992-410c-b87b-764df4cc1bf1 1073741824 Jul 30 17:01:20 devstack sudo[101652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:20 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-95ad5fbb-b7e2-4980-8968-4121b612161e tempest-GroupSnapshotsTest-1016258839 None] Lock "cinder-quobyte-c81b8bc5-de70-4083-949e-cde9740a06bb" released by "delete_snapshot" :: held 1.786s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:01:20 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-2c3a074c-acc0-4973-887a-57848239d0eb tempest-CreateVolumesFromSnapshotTest-266944850 None] Volume volume-95abc6c8-ba6f-46e0-94d0-4202afa9c6ba (95abc6c8-ba6f-46e0-94d0-4202afa9c6ba): created successfully Jul 30 17:01:20 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-2c3a074c-acc0-4973-887a-57848239d0eb tempest-CreateVolumesFromSnapshotTest-266944850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ede22b46-83df-4bca-a7ea-1abdca036954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:20 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-2c3a074c-acc0-4973-887a-57848239d0eb tempest-CreateVolumesFromSnapshotTest-266944850 None] Flow 'volume_create_manager' (7b7f895f-7e2a-4114-b279-39f8b62f7543) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:01:20 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-2c3a074c-acc0-4973-887a-57848239d0eb tempest-CreateVolumesFromSnapshotTest-266944850 None] Created volume successfully. Jul 30 17:01:20 devstack cinder-volume[88568]: WARNING cinder.quota [None req-95ad5fbb-b7e2-4980-8968-4121b612161e tempest-GroupSnapshotsTest-1016258839 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1923624752 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1923624752, it is now deprecated. Please use the default quota class for default quota. Jul 30 17:01:20 devstack cinder-volume[88568]: WARNING cinder.quota [None req-95ad5fbb-b7e2-4980-8968-4121b612161e tempest-GroupSnapshotsTest-1016258839 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1923624752 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1923624752, it is now deprecated. Please use the default quota class for default quota. Jul 30 17:01:20 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-95ad5fbb-b7e2-4980-8968-4121b612161e tempest-GroupSnapshotsTest-1016258839 None] Created reservations ['460903e3-55b3-423b-b9e6-03407fa7ce05', 'c7a0223d-12ba-4782-9e3d-2d8a5454e07a', '6711b7bb-37e2-4120-b820-55ffe013a581', '127e55d7-de54-4309-ae1d-84dc6e65cae7'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:01:20 devstack sudo[101648]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fc61b1ea-63f9-40fb-9dab-73c6031950b3 tempest-VolumesExtendTest-719667368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6126230f-0fba-48b9-943c-1885f4fc4be0_hn0m6khkdevstack@QuobyteHD" returned: 0 in 0.368s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-fc61b1ea-63f9-40fb-9dab-73c6031950b3 tempest-VolumesExtendTest-719667368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:01:20 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-95ad5fbb-b7e2-4980-8968-4121b612161e tempest-GroupSnapshotsTest-1016258839 None] group_snapshot ec949122-81ec-44b1-a495-b68407e35cdf: deleted successfully Jul 30 17:01:21 devstack sudo[101652]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:21 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e08c0011-9b6c-464d-81c7-5ce1418f1fde tempest-CreateVolumesFromSnapshotTest-266944850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9bad6c33-1992-410c-b87b-764df4cc1bf1 1073741824" returned: 0 in 0.492s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:21 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e08c0011-9b6c-464d-81c7-5ce1418f1fde tempest-CreateVolumesFromSnapshotTest-266944850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9bad6c33-1992-410c-b87b-764df4cc1bf1 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:21 devstack sudo[101662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9bad6c33-1992-410c-b87b-764df4cc1bf1 Jul 30 17:01:21 devstack sudo[101662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:21 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-8d49631a-7be2-4caf-a03d-14070cd70178 tempest-GroupSnapshotsTest-1016258839 None] Acquiring lock "cinder-quobyte-c81b8bc5-de70-4083-949e-cde9740a06bb" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:01:21 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-8d49631a-7be2-4caf-a03d-14070cd70178 tempest-GroupSnapshotsTest-1016258839 None] Lock "cinder-quobyte-c81b8bc5-de70-4083-949e-cde9740a06bb" acquired by "delete_volume" :: waited 0.020s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:01:21 devstack sudo[101662]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:21 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e08c0011-9b6c-464d-81c7-5ce1418f1fde tempest-CreateVolumesFromSnapshotTest-266944850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9bad6c33-1992-410c-b87b-764df4cc1bf1" returned: 0 in 0.264s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:21 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-e08c0011-9b6c-464d-81c7-5ce1418f1fde tempest-CreateVolumesFromSnapshotTest-266944850 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:01:21 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-e08c0011-9b6c-464d-81c7-5ce1418f1fde tempest-CreateVolumesFromSnapshotTest-266944850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:01:21 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-ed74566c-d96e-48f1-86dc-8b0dde32ce0b tempest-CreateVolumesFromSnapshotTest-266944850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.639s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:01:21 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-ed74566c-d96e-48f1-86dc-8b0dde32ce0b tempest-CreateVolumesFromSnapshotTest-266944850 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:01:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-753828631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83050062-da16-4f3f-8c26-5f086c2d5e8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eea1270cda6460aba4b40f636e4e171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:01:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:01:19Z,use_quota=True,user_id='3442fa64ab634822907c5e08e96701ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:01:21 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-ed74566c-d96e-48f1-86dc-8b0dde32ce0b tempest-CreateVolumesFromSnapshotTest-266944850 None] Creating volume 83050062-da16-4f3f-8c26-5f086c2d5e8a {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:01:21 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-ed74566c-d96e-48f1-86dc-8b0dde32ce0b tempest-CreateVolumesFromSnapshotTest-266944850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:01:21 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-ed74566c-d96e-48f1-86dc-8b0dde32ce0b tempest-CreateVolumesFromSnapshotTest-266944850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:01:21 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-ed74566c-d96e-48f1-86dc-8b0dde32ce0b tempest-CreateVolumesFromSnapshotTest-266944850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:01:21 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-ed74566c-d96e-48f1-86dc-8b0dde32ce0b tempest-CreateVolumesFromSnapshotTest-266944850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:01:21 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-ed74566c-d96e-48f1-86dc-8b0dde32ce0b tempest-CreateVolumesFromSnapshotTest-266944850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:01:21 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-ed74566c-d96e-48f1-86dc-8b0dde32ce0b tempest-CreateVolumesFromSnapshotTest-266944850 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:01:21 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-ed74566c-d96e-48f1-86dc-8b0dde32ce0b tempest-CreateVolumesFromSnapshotTest-266944850 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:01:21 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-ed74566c-d96e-48f1-86dc-8b0dde32ce0b tempest-CreateVolumesFromSnapshotTest-266944850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-83050062-da16-4f3f-8c26-5f086c2d5e8a 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:21 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[f947375b-ad7e-4b0b-b397-b29461b88981]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:01:21 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8d49631a-7be2-4caf-a03d-14070cd70178 tempest-GroupSnapshotsTest-1016258839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c81b8bc5-de70-4083-949e-cde9740a06bb {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:21 devstack sudo[101665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-83050062-da16-4f3f-8c26-5f086c2d5e8a 1073741824 Jul 30 17:01:21 devstack sudo[101665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:21 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e08c0011-9b6c-464d-81c7-5ce1418f1fde tempest-CreateVolumesFromSnapshotTest-266944850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a86085df-1701-4073-b28d-f9b321b40f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bad6c33-1992-410c-b87b-764df4cc1bf1', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:21 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e08c0011-9b6c-464d-81c7-5ce1418f1fde tempest-CreateVolumesFromSnapshotTest-266944850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b26e2a2-dafd-4cd7-b164-2fa669604100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:21 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-e08c0011-9b6c-464d-81c7-5ce1418f1fde tempest-CreateVolumesFromSnapshotTest-266944850 None] Volume volume-9bad6c33-1992-410c-b87b-764df4cc1bf1 (9bad6c33-1992-410c-b87b-764df4cc1bf1): created successfully Jul 30 17:01:21 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e08c0011-9b6c-464d-81c7-5ce1418f1fde tempest-CreateVolumesFromSnapshotTest-266944850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b26e2a2-dafd-4cd7-b164-2fa669604100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:21 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e08c0011-9b6c-464d-81c7-5ce1418f1fde tempest-CreateVolumesFromSnapshotTest-266944850 None] Flow 'volume_create_manager' (3538a37d-4f71-4c22-abd9-130a4fb23991) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:01:21 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-e08c0011-9b6c-464d-81c7-5ce1418f1fde tempest-CreateVolumesFromSnapshotTest-266944850 None] Created volume successfully. Jul 30 17:01:21 devstack sudo[101666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c81b8bc5-de70-4083-949e-cde9740a06bb Jul 30 17:01:21 devstack sudo[101666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:21 devstack sudo[101666]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:21 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8d49631a-7be2-4caf-a03d-14070cd70178 tempest-GroupSnapshotsTest-1016258839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c81b8bc5-de70-4083-949e-cde9740a06bb" returned: 0 in 0.415s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:21 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8d49631a-7be2-4caf-a03d-14070cd70178 tempest-GroupSnapshotsTest-1016258839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c81b8bc5-de70-4083-949e-cde9740a06bb {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:21 devstack sudo[101676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c81b8bc5-de70-4083-949e-cde9740a06bb Jul 30 17:01:21 devstack sudo[101676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:21 devstack sudo[101665]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:21 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-ed74566c-d96e-48f1-86dc-8b0dde32ce0b tempest-CreateVolumesFromSnapshotTest-266944850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-83050062-da16-4f3f-8c26-5f086c2d5e8a 1073741824" returned: 0 in 0.489s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:21 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-ed74566c-d96e-48f1-86dc-8b0dde32ce0b tempest-CreateVolumesFromSnapshotTest-266944850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-83050062-da16-4f3f-8c26-5f086c2d5e8a {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:21 devstack sudo[101678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-83050062-da16-4f3f-8c26-5f086c2d5e8a Jul 30 17:01:21 devstack sudo[101678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:22 devstack sudo[101676]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:22 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8d49631a-7be2-4caf-a03d-14070cd70178 tempest-GroupSnapshotsTest-1016258839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c81b8bc5-de70-4083-949e-cde9740a06bb" returned: 0 in 0.258s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:22 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-8d49631a-7be2-4caf-a03d-14070cd70178 tempest-GroupSnapshotsTest-1016258839 None] Lock "cinder-quobyte-c81b8bc5-de70-4083-949e-cde9740a06bb" released by "delete_volume" :: held 0.769s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:01:22 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-8d49631a-7be2-4caf-a03d-14070cd70178 tempest-GroupSnapshotsTest-1016258839 None] Created reservations ['4c1b660b-f0f0-4379-a877-179ac0eff4a8'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:01:22 devstack sudo[101678]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:22 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-ed74566c-d96e-48f1-86dc-8b0dde32ce0b tempest-CreateVolumesFromSnapshotTest-266944850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-83050062-da16-4f3f-8c26-5f086c2d5e8a" returned: 0 in 0.279s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:22 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-ed74566c-d96e-48f1-86dc-8b0dde32ce0b tempest-CreateVolumesFromSnapshotTest-266944850 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:01:22 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-ed74566c-d96e-48f1-86dc-8b0dde32ce0b tempest-CreateVolumesFromSnapshotTest-266944850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:01:22 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-fc61b1ea-63f9-40fb-9dab-73c6031950b3 tempest-VolumesExtendTest-719667368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.422s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:01:22 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-fc61b1ea-63f9-40fb-9dab-73c6031950b3 tempest-VolumesExtendTest-719667368 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:01:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-955138376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=184de0c7-4bb0-4057-a4d9-72519feb5a32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb9f62d3088f454897cc8a64f20043e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:01:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:01:19Z,use_quota=True,user_id='88b01a22a72b46cba74cbdaba3ecebd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:01:22 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-fc61b1ea-63f9-40fb-9dab-73c6031950b3 tempest-VolumesExtendTest-719667368 None] Creating volume 184de0c7-4bb0-4057-a4d9-72519feb5a32 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:01:22 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-fc61b1ea-63f9-40fb-9dab-73c6031950b3 tempest-VolumesExtendTest-719667368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:01:22 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-fc61b1ea-63f9-40fb-9dab-73c6031950b3 tempest-VolumesExtendTest-719667368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:01:22 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-fc61b1ea-63f9-40fb-9dab-73c6031950b3 tempest-VolumesExtendTest-719667368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:01:22 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-fc61b1ea-63f9-40fb-9dab-73c6031950b3 tempest-VolumesExtendTest-719667368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:01:22 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-fc61b1ea-63f9-40fb-9dab-73c6031950b3 tempest-VolumesExtendTest-719667368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:01:22 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-fc61b1ea-63f9-40fb-9dab-73c6031950b3 tempest-VolumesExtendTest-719667368 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:01:22 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-fc61b1ea-63f9-40fb-9dab-73c6031950b3 tempest-VolumesExtendTest-719667368 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:01:22 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fc61b1ea-63f9-40fb-9dab-73c6031950b3 tempest-VolumesExtendTest-719667368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-184de0c7-4bb0-4057-a4d9-72519feb5a32 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:22 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ed74566c-d96e-48f1-86dc-8b0dde32ce0b tempest-CreateVolumesFromSnapshotTest-266944850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baa094f6-91a8-4fab-a649-10dd7d3a44f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83050062-da16-4f3f-8c26-5f086c2d5e8a', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:22 devstack sudo[101682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-184de0c7-4bb0-4057-a4d9-72519feb5a32 1073741824 Jul 30 17:01:22 devstack sudo[101682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:22 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ed74566c-d96e-48f1-86dc-8b0dde32ce0b tempest-CreateVolumesFromSnapshotTest-266944850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d1a08c0-f5bc-4da8-bf69-36176a681457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:22 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-ed74566c-d96e-48f1-86dc-8b0dde32ce0b tempest-CreateVolumesFromSnapshotTest-266944850 None] Volume volume-83050062-da16-4f3f-8c26-5f086c2d5e8a (83050062-da16-4f3f-8c26-5f086c2d5e8a): created successfully Jul 30 17:01:22 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ed74566c-d96e-48f1-86dc-8b0dde32ce0b tempest-CreateVolumesFromSnapshotTest-266944850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d1a08c0-f5bc-4da8-bf69-36176a681457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:22 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ed74566c-d96e-48f1-86dc-8b0dde32ce0b tempest-CreateVolumesFromSnapshotTest-266944850 None] Flow 'volume_create_manager' (97861ef6-e4c6-42b1-b9c9-ac5cbeb3b164) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:01:22 devstack cinder-volume[88568]: WARNING cinder.quota [None req-8d49631a-7be2-4caf-a03d-14070cd70178 tempest-GroupSnapshotsTest-1016258839 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1923624752 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1923624752, it is now deprecated. Please use the default quota class for default quota. Jul 30 17:01:22 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-ed74566c-d96e-48f1-86dc-8b0dde32ce0b tempest-CreateVolumesFromSnapshotTest-266944850 None] Created volume successfully. Jul 30 17:01:22 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-8d49631a-7be2-4caf-a03d-14070cd70178 tempest-GroupSnapshotsTest-1016258839 None] Created reservations ['1061ab4b-3746-44d4-a470-a99b3b5101f1', '8cc69ba0-e83c-40f5-bf66-e9f31c8b0668', 'ef49d6a0-f118-4450-b9e3-650c380d277f', '16d654d7-4474-4539-a368-193f7121403f'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:01:22 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-8d49631a-7be2-4caf-a03d-14070cd70178 tempest-GroupSnapshotsTest-1016258839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:01:22 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-8d49631a-7be2-4caf-a03d-14070cd70178 tempest-GroupSnapshotsTest-1016258839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:01:22 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-8d49631a-7be2-4caf-a03d-14070cd70178 tempest-GroupSnapshotsTest-1016258839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:01:22 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-8d49631a-7be2-4caf-a03d-14070cd70178 tempest-GroupSnapshotsTest-1016258839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:01:22 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-8d49631a-7be2-4caf-a03d-14070cd70178 tempest-GroupSnapshotsTest-1016258839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:01:22 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8d49631a-7be2-4caf-a03d-14070cd70178 tempest-GroupSnapshotsTest-1016258839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:22 devstack sudo[101684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:01:22 devstack sudo[101684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:22 devstack sudo[101682]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:22 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fc61b1ea-63f9-40fb-9dab-73c6031950b3 tempest-VolumesExtendTest-719667368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-184de0c7-4bb0-4057-a4d9-72519feb5a32 1073741824" returned: 0 in 0.533s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:22 devstack sudo[101684]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:22 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8d49631a-7be2-4caf-a03d-14070cd70178 tempest-GroupSnapshotsTest-1016258839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.338s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:22 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-8d49631a-7be2-4caf-a03d-14070cd70178 tempest-GroupSnapshotsTest-1016258839 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:01:22 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fc61b1ea-63f9-40fb-9dab-73c6031950b3 tempest-VolumesExtendTest-719667368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-184de0c7-4bb0-4057-a4d9-72519feb5a32 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:22 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-8d49631a-7be2-4caf-a03d-14070cd70178 tempest-GroupSnapshotsTest-1016258839 None] Delete group completed successfully. Jul 30 17:01:22 devstack sudo[101691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-184de0c7-4bb0-4057-a4d9-72519feb5a32 Jul 30 17:01:22 devstack sudo[101691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:23 devstack sudo[101691]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:23 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fc61b1ea-63f9-40fb-9dab-73c6031950b3 tempest-VolumesExtendTest-719667368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-184de0c7-4bb0-4057-a4d9-72519feb5a32" returned: 0 in 0.287s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:23 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-fc61b1ea-63f9-40fb-9dab-73c6031950b3 tempest-VolumesExtendTest-719667368 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:01:23 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-fc61b1ea-63f9-40fb-9dab-73c6031950b3 tempest-VolumesExtendTest-719667368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:01:23 devstack cinder-volume[88568]: DEBUG cinder.volume.volume_utils [None req-fc61b1ea-63f9-40fb-9dab-73c6031950b3 tempest-VolumesExtendTest-719667368 None] Attempting download of 6126230f-0fba-48b9-943c-1885f4fc4be0 ((None, [{'url': 'file:///opt/stack/data/glance/images/6126230f-0fba-48b9-943c-1885f4fc4be0', 'metadata': {}}])) to volume 184de0c7-4bb0-4057-a4d9-72519feb5a32. {{(pid=88568) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 30 17:01:23 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[a57916a3-ba9a-463c-965f-0bf5471b0523]: (4, 'raw') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:01:23 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fc61b1ea-63f9-40fb-9dab-73c6031950b3 tempest-VolumesExtendTest-719667368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6126230f-0fba-48b9-943c-1885f4fc4be0_xm8e057x {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:23 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-d7cc1081-be76-4b44-90fa-c0a2006a408f tempest-CreateVolumesFromSnapshotTest-266944850 None] Acquiring lock "cinder-83050062-da16-4f3f-8c26-5f086c2d5e8a-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:01:23 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-d7cc1081-be76-4b44-90fa-c0a2006a408f tempest-CreateVolumesFromSnapshotTest-266944850 None] Lock "cinder-83050062-da16-4f3f-8c26-5f086c2d5e8a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:01:23 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-d7cc1081-be76-4b44-90fa-c0a2006a408f tempest-CreateVolumesFromSnapshotTest-266944850 None] Acquiring lock "cinder-quobyte-83050062-da16-4f3f-8c26-5f086c2d5e8a" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:01:23 devstack sudo[101694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6126230f-0fba-48b9-943c-1885f4fc4be0_xm8e057x Jul 30 17:01:23 devstack sudo[101694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:23 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-d7cc1081-be76-4b44-90fa-c0a2006a408f tempest-CreateVolumesFromSnapshotTest-266944850 None] Lock "cinder-quobyte-83050062-da16-4f3f-8c26-5f086c2d5e8a" acquired by "delete_volume" :: waited 0.020s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:01:23 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f92f90e-df3d-48f8-8f1a-16419f129616]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:01:23 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d7cc1081-be76-4b44-90fa-c0a2006a408f tempest-CreateVolumesFromSnapshotTest-266944850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-83050062-da16-4f3f-8c26-5f086c2d5e8a {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:23 devstack sudo[101696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-83050062-da16-4f3f-8c26-5f086c2d5e8a Jul 30 17:01:23 devstack sudo[101696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:23 devstack sudo[101694]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:23 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fc61b1ea-63f9-40fb-9dab-73c6031950b3 tempest-VolumesExtendTest-719667368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6126230f-0fba-48b9-943c-1885f4fc4be0_xm8e057x" returned: 0 in 0.409s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:23 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fc61b1ea-63f9-40fb-9dab-73c6031950b3 tempest-VolumesExtendTest-719667368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6126230f-0fba-48b9-943c-1885f4fc4be0_xm8e057x {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:23 devstack sudo[101700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6126230f-0fba-48b9-943c-1885f4fc4be0_xm8e057x Jul 30 17:01:23 devstack sudo[101700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:23 devstack sudo[101696]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:23 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d7cc1081-be76-4b44-90fa-c0a2006a408f tempest-CreateVolumesFromSnapshotTest-266944850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-83050062-da16-4f3f-8c26-5f086c2d5e8a" returned: 0 in 0.418s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:23 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d7cc1081-be76-4b44-90fa-c0a2006a408f tempest-CreateVolumesFromSnapshotTest-266944850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-83050062-da16-4f3f-8c26-5f086c2d5e8a {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:23 devstack sudo[101705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-83050062-da16-4f3f-8c26-5f086c2d5e8a Jul 30 17:01:23 devstack sudo[101705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:24 devstack sudo[101700]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fc61b1ea-63f9-40fb-9dab-73c6031950b3 tempest-VolumesExtendTest-719667368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6126230f-0fba-48b9-943c-1885f4fc4be0_xm8e057x" returned: 1 in 0.414s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fc61b1ea-63f9-40fb-9dab-73c6031950b3 tempest-VolumesExtendTest-719667368 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6126230f-0fba-48b9-943c-1885f4fc4be0_xm8e057x' failed. Not Retrying. {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 17:01:24 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b35e88b-0df1-4398-8833-5f30d7c019f3]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:01:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fc61b1ea-63f9-40fb-9dab-73c6031950b3 tempest-VolumesExtendTest-719667368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6126230f-0fba-48b9-943c-1885f4fc4be0_hn0m6khkdevstack@QuobyteHD {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:24 devstack sudo[101705]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d7cc1081-be76-4b44-90fa-c0a2006a408f tempest-CreateVolumesFromSnapshotTest-266944850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-83050062-da16-4f3f-8c26-5f086c2d5e8a" returned: 0 in 0.299s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:24 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-d7cc1081-be76-4b44-90fa-c0a2006a408f tempest-CreateVolumesFromSnapshotTest-266944850 None] Lock "cinder-quobyte-83050062-da16-4f3f-8c26-5f086c2d5e8a" released by "delete_volume" :: held 0.770s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:01:24 devstack sudo[101709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6126230f-0fba-48b9-943c-1885f4fc4be0_hn0m6khkdevstack@QuobyteHD Jul 30 17:01:24 devstack sudo[101709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:24 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-d7cc1081-be76-4b44-90fa-c0a2006a408f tempest-CreateVolumesFromSnapshotTest-266944850 None] Created reservations ['f54c2fe6-3a26-4f17-871f-ce8394c595e8', 'dd60c4f5-d12d-4cdc-8f29-a549556b2496', '28a09e2e-f82c-41ce-bbcc-c2cb8c56a580', 'cdeae8b5-8909-477f-93a0-49b7d2fd2021'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:01:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-d7cc1081-be76-4b44-90fa-c0a2006a408f tempest-CreateVolumesFromSnapshotTest-266944850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:01:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-d7cc1081-be76-4b44-90fa-c0a2006a408f tempest-CreateVolumesFromSnapshotTest-266944850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:01:24 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-d7cc1081-be76-4b44-90fa-c0a2006a408f tempest-CreateVolumesFromSnapshotTest-266944850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:01:24 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-d7cc1081-be76-4b44-90fa-c0a2006a408f tempest-CreateVolumesFromSnapshotTest-266944850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:01:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-d7cc1081-be76-4b44-90fa-c0a2006a408f tempest-CreateVolumesFromSnapshotTest-266944850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:01:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d7cc1081-be76-4b44-90fa-c0a2006a408f tempest-CreateVolumesFromSnapshotTest-266944850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:24 devstack sudo[101712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:01:24 devstack sudo[101712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:24 devstack sudo[101709]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fc61b1ea-63f9-40fb-9dab-73c6031950b3 tempest-VolumesExtendTest-719667368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6126230f-0fba-48b9-943c-1885f4fc4be0_hn0m6khkdevstack@QuobyteHD" returned: 0 in 0.433s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:24 devstack cinder-volume[88568]: DEBUG cinder.image.image_utils [None req-fc61b1ea-63f9-40fb-9dab-73c6031950b3 tempest-VolumesExtendTest-719667368 None] 6126230f-0fba-48b9-943c-1885f4fc4be0 was qcow2, converting to qcow2 {{(pid=88568) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 30 17:01:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fc61b1ea-63f9-40fb-9dab-73c6031950b3 tempest-VolumesExtendTest-719667368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6126230f-0fba-48b9-943c-1885f4fc4be0_hn0m6khkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-184de0c7-4bb0-4057-a4d9-72519feb5a32 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:24 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-2fa8a54d-9f4c-4e12-b6b7-a7cf36278e62 tempest-CreateVolumesFromSnapshotTest-266944850 None] Acquiring lock "cinder-9bad6c33-1992-410c-b87b-764df4cc1bf1-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:01:24 devstack sudo[101717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6126230f-0fba-48b9-943c-1885f4fc4be0_hn0m6khkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-184de0c7-4bb0-4057-a4d9-72519feb5a32 Jul 30 17:01:24 devstack sudo[101717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:24 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-2fa8a54d-9f4c-4e12-b6b7-a7cf36278e62 tempest-CreateVolumesFromSnapshotTest-266944850 None] Lock "cinder-9bad6c33-1992-410c-b87b-764df4cc1bf1-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:01:24 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-2fa8a54d-9f4c-4e12-b6b7-a7cf36278e62 tempest-CreateVolumesFromSnapshotTest-266944850 None] Acquiring lock "cinder-quobyte-9bad6c33-1992-410c-b87b-764df4cc1bf1" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:01:24 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-2fa8a54d-9f4c-4e12-b6b7-a7cf36278e62 tempest-CreateVolumesFromSnapshotTest-266944850 None] Lock "cinder-quobyte-9bad6c33-1992-410c-b87b-764df4cc1bf1" acquired by "delete_volume" :: waited 0.023s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:01:24 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[f167b358-e60b-450d-8dc7-69a8b0c127b3]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:01:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2fa8a54d-9f4c-4e12-b6b7-a7cf36278e62 tempest-CreateVolumesFromSnapshotTest-266944850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9bad6c33-1992-410c-b87b-764df4cc1bf1 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:24 devstack sudo[101712]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d7cc1081-be76-4b44-90fa-c0a2006a408f tempest-CreateVolumesFromSnapshotTest-266944850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.409s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:24 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-d7cc1081-be76-4b44-90fa-c0a2006a408f tempest-CreateVolumesFromSnapshotTest-266944850 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:01:24 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-d7cc1081-be76-4b44-90fa-c0a2006a408f tempest-CreateVolumesFromSnapshotTest-266944850 None] Deleted volume successfully. Jul 30 17:01:24 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-d7cc1081-be76-4b44-90fa-c0a2006a408f tempest-CreateVolumesFromSnapshotTest-266944850 None] Lock "cinder-83050062-da16-4f3f-8c26-5f086c2d5e8a-delete_volume" released by "delete_volume" :: held 1.433s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:01:24 devstack sudo[101721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9bad6c33-1992-410c-b87b-764df4cc1bf1 Jul 30 17:01:24 devstack sudo[101721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:25 devstack sudo[101721]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:25 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2fa8a54d-9f4c-4e12-b6b7-a7cf36278e62 tempest-CreateVolumesFromSnapshotTest-266944850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9bad6c33-1992-410c-b87b-764df4cc1bf1" returned: 0 in 0.449s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:25 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2fa8a54d-9f4c-4e12-b6b7-a7cf36278e62 tempest-CreateVolumesFromSnapshotTest-266944850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9bad6c33-1992-410c-b87b-764df4cc1bf1 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:25 devstack sudo[101732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9bad6c33-1992-410c-b87b-764df4cc1bf1 Jul 30 17:01:25 devstack sudo[101732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:25 devstack sudo[101732]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:25 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2fa8a54d-9f4c-4e12-b6b7-a7cf36278e62 tempest-CreateVolumesFromSnapshotTest-266944850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9bad6c33-1992-410c-b87b-764df4cc1bf1" returned: 0 in 0.314s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:25 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-2fa8a54d-9f4c-4e12-b6b7-a7cf36278e62 tempest-CreateVolumesFromSnapshotTest-266944850 None] Lock "cinder-quobyte-9bad6c33-1992-410c-b87b-764df4cc1bf1" released by "delete_volume" :: held 0.833s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:01:25 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-2fa8a54d-9f4c-4e12-b6b7-a7cf36278e62 tempest-CreateVolumesFromSnapshotTest-266944850 None] Created reservations ['7d114957-6028-44b1-91e6-6e9883cc13a8', '373ee213-88cd-43a1-8594-334d06cb315b', '9983616d-190b-4a95-9583-3b6e8669124b', 'ef81aff8-ef74-4536-b1af-381fcc5c6342'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:01:25 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-2fa8a54d-9f4c-4e12-b6b7-a7cf36278e62 tempest-CreateVolumesFromSnapshotTest-266944850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:01:25 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-2fa8a54d-9f4c-4e12-b6b7-a7cf36278e62 tempest-CreateVolumesFromSnapshotTest-266944850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:01:25 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-2fa8a54d-9f4c-4e12-b6b7-a7cf36278e62 tempest-CreateVolumesFromSnapshotTest-266944850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:01:25 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-2fa8a54d-9f4c-4e12-b6b7-a7cf36278e62 tempest-CreateVolumesFromSnapshotTest-266944850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:01:25 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-2fa8a54d-9f4c-4e12-b6b7-a7cf36278e62 tempest-CreateVolumesFromSnapshotTest-266944850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:01:25 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2fa8a54d-9f4c-4e12-b6b7-a7cf36278e62 tempest-CreateVolumesFromSnapshotTest-266944850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:25 devstack sudo[101735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:01:25 devstack sudo[101735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:25 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-717977c6-de7f-4a43-b48b-a3366c861b94 tempest-CreateVolumesFromSnapshotTest-266944850 None] Acquiring lock "cinder-95abc6c8-ba6f-46e0-94d0-4202afa9c6ba-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:01:25 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-717977c6-de7f-4a43-b48b-a3366c861b94 tempest-CreateVolumesFromSnapshotTest-266944850 None] Lock "cinder-95abc6c8-ba6f-46e0-94d0-4202afa9c6ba-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:01:25 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-717977c6-de7f-4a43-b48b-a3366c861b94 tempest-CreateVolumesFromSnapshotTest-266944850 None] Acquiring lock "cinder-quobyte-95abc6c8-ba6f-46e0-94d0-4202afa9c6ba" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:01:25 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-717977c6-de7f-4a43-b48b-a3366c861b94 tempest-CreateVolumesFromSnapshotTest-266944850 None] Lock "cinder-quobyte-95abc6c8-ba6f-46e0-94d0-4202afa9c6ba" acquired by "delete_volume" :: waited 0.021s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:01:25 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d35a8f-8187-428d-b328-ce1966fcf619]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:01:25 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-717977c6-de7f-4a43-b48b-a3366c861b94 tempest-CreateVolumesFromSnapshotTest-266944850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-95abc6c8-ba6f-46e0-94d0-4202afa9c6ba {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:26 devstack sudo[101735]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2fa8a54d-9f4c-4e12-b6b7-a7cf36278e62 tempest-CreateVolumesFromSnapshotTest-266944850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.355s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:26 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-2fa8a54d-9f4c-4e12-b6b7-a7cf36278e62 tempest-CreateVolumesFromSnapshotTest-266944850 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:01:26 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-2fa8a54d-9f4c-4e12-b6b7-a7cf36278e62 tempest-CreateVolumesFromSnapshotTest-266944850 None] Deleted volume successfully. Jul 30 17:01:26 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-2fa8a54d-9f4c-4e12-b6b7-a7cf36278e62 tempest-CreateVolumesFromSnapshotTest-266944850 None] Lock "cinder-9bad6c33-1992-410c-b87b-764df4cc1bf1-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:01:26 devstack sudo[101737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-95abc6c8-ba6f-46e0-94d0-4202afa9c6ba Jul 30 17:01:26 devstack sudo[101737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:26 devstack sudo[101737]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-717977c6-de7f-4a43-b48b-a3366c861b94 tempest-CreateVolumesFromSnapshotTest-266944850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-95abc6c8-ba6f-46e0-94d0-4202afa9c6ba" returned: 0 in 0.461s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-717977c6-de7f-4a43-b48b-a3366c861b94 tempest-CreateVolumesFromSnapshotTest-266944850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-95abc6c8-ba6f-46e0-94d0-4202afa9c6ba {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:26 devstack sudo[101743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-95abc6c8-ba6f-46e0-94d0-4202afa9c6ba Jul 30 17:01:26 devstack sudo[101743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:26 devstack sudo[101743]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-717977c6-de7f-4a43-b48b-a3366c861b94 tempest-CreateVolumesFromSnapshotTest-266944850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-95abc6c8-ba6f-46e0-94d0-4202afa9c6ba" returned: 0 in 0.314s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:26 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-717977c6-de7f-4a43-b48b-a3366c861b94 tempest-CreateVolumesFromSnapshotTest-266944850 None] Lock "cinder-quobyte-95abc6c8-ba6f-46e0-94d0-4202afa9c6ba" released by "delete_volume" :: held 0.824s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:01:26 devstack sudo[101717]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fc61b1ea-63f9-40fb-9dab-73c6031950b3 tempest-VolumesExtendTest-719667368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6126230f-0fba-48b9-943c-1885f4fc4be0_hn0m6khkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-184de0c7-4bb0-4057-a4d9-72519feb5a32" returned: 0 in 2.264s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:26 devstack cinder-volume[88568]: DEBUG cinder.image.image_utils [None req-fc61b1ea-63f9-40fb-9dab-73c6031950b3 tempest-VolumesExtendTest-719667368 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6126230f-0fba-48b9-943c-1885f4fc4be0_hn0m6khkdevstack@QuobyteHD, size 112.00 MB, duration 2.27 sec, destination /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-184de0c7-4bb0-4057-a4d9-72519feb5a32 {{(pid=88568) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 17:01:26 devstack cinder-volume[88568]: INFO cinder.image.image_utils [None req-fc61b1ea-63f9-40fb-9dab-73c6031950b3 tempest-VolumesExtendTest-719667368 None] Converted 112.00 MB image at 49.45 MB/s Jul 30 17:01:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fc61b1ea-63f9-40fb-9dab-73c6031950b3 tempest-VolumesExtendTest-719667368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-184de0c7-4bb0-4057-a4d9-72519feb5a32 1G {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:26 devstack sudo[101746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-184de0c7-4bb0-4057-a4d9-72519feb5a32 1G Jul 30 17:01:26 devstack sudo[101746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:26 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-717977c6-de7f-4a43-b48b-a3366c861b94 tempest-CreateVolumesFromSnapshotTest-266944850 None] Created reservations ['f978f0c5-09f0-4943-a1ca-d8acf70b959f', '73a14391-f86a-4fe2-9294-3170ed98a067', 'd368d39d-e2e0-42cf-9348-598661abbf39', '45e6c7da-f966-4be7-a75f-cfe116de9e5e'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:01:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-717977c6-de7f-4a43-b48b-a3366c861b94 tempest-CreateVolumesFromSnapshotTest-266944850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:01:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-717977c6-de7f-4a43-b48b-a3366c861b94 tempest-CreateVolumesFromSnapshotTest-266944850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:01:26 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-717977c6-de7f-4a43-b48b-a3366c861b94 tempest-CreateVolumesFromSnapshotTest-266944850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:01:26 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-717977c6-de7f-4a43-b48b-a3366c861b94 tempest-CreateVolumesFromSnapshotTest-266944850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:01:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-717977c6-de7f-4a43-b48b-a3366c861b94 tempest-CreateVolumesFromSnapshotTest-266944850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:01:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-717977c6-de7f-4a43-b48b-a3366c861b94 tempest-CreateVolumesFromSnapshotTest-266944850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:26 devstack sudo[101748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:01:26 devstack sudo[101748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:26 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-3546d7a2-3c3d-477a-9e7d-1813b0e2ab07 tempest-CreateVolumesFromSnapshotTest-266944850 None] Acquiring lock "cinder-c953467c-76a1-4eac-8b57-b4211745a899-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:01:27 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-3546d7a2-3c3d-477a-9e7d-1813b0e2ab07 tempest-CreateVolumesFromSnapshotTest-266944850 None] Lock "cinder-c953467c-76a1-4eac-8b57-b4211745a899-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:01:27 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-3546d7a2-3c3d-477a-9e7d-1813b0e2ab07 tempest-CreateVolumesFromSnapshotTest-266944850 None] Acquiring lock "cinder-quobyte-c953467c-76a1-4eac-8b57-b4211745a899" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:01:27 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-3546d7a2-3c3d-477a-9e7d-1813b0e2ab07 tempest-CreateVolumesFromSnapshotTest-266944850 None] Lock "cinder-quobyte-c953467c-76a1-4eac-8b57-b4211745a899" acquired by "delete_volume" :: waited 0.025s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:01:27 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa27211-e840-43d6-a2df-2e5f81d6dd8e]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:01:27 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-3546d7a2-3c3d-477a-9e7d-1813b0e2ab07 tempest-CreateVolumesFromSnapshotTest-266944850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c953467c-76a1-4eac-8b57-b4211745a899 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:27 devstack sudo[101746]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:27 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fc61b1ea-63f9-40fb-9dab-73c6031950b3 tempest-VolumesExtendTest-719667368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-184de0c7-4bb0-4057-a4d9-72519feb5a32 1G" returned: 0 in 0.478s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:27 devstack cinder-volume[88568]: DEBUG cinder.volume.volume_utils [None req-fc61b1ea-63f9-40fb-9dab-73c6031950b3 tempest-VolumesExtendTest-719667368 None] Downloaded image 6126230f-0fba-48b9-943c-1885f4fc4be0 ((None, [{'url': 'file:///opt/stack/data/glance/images/6126230f-0fba-48b9-943c-1885f4fc4be0', 'metadata': {}}])) to volume 184de0c7-4bb0-4057-a4d9-72519feb5a32 successfully. {{(pid=88568) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 30 17:01:27 devstack sudo[101748]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:27 devstack cinder-volume[88568]: DEBUG cinder.image.image_utils [None req-fc61b1ea-63f9-40fb-9dab-73c6031950b3 tempest-VolumesExtendTest-719667368 None] Temporary image 6126230f-0fba-48b9-943c-1885f4fc4be0 for user 88b01a22a72b46cba74cbdaba3ecebd5 is deleted. {{(pid=88568) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 30 17:01:27 devstack cinder-volume[88568]: DEBUG cinder.volume.volume_utils [None req-fc61b1ea-63f9-40fb-9dab-73c6031950b3 tempest-VolumesExtendTest-719667368 None] Marking volume 184de0c7-4bb0-4057-a4d9-72519feb5a32 as bootable. {{(pid=88568) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 30 17:01:27 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-717977c6-de7f-4a43-b48b-a3366c861b94 tempest-CreateVolumesFromSnapshotTest-266944850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.354s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:27 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-717977c6-de7f-4a43-b48b-a3366c861b94 tempest-CreateVolumesFromSnapshotTest-266944850 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:01:27 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-717977c6-de7f-4a43-b48b-a3366c861b94 tempest-CreateVolumesFromSnapshotTest-266944850 None] Deleted volume successfully. Jul 30 17:01:27 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc61b1ea-63f9-40fb-9dab-73c6031950b3 tempest-VolumesExtendTest-719667368 None] Copying metadata from image 6126230f-0fba-48b9-943c-1885f4fc4be0 to 184de0c7-4bb0-4057-a4d9-72519feb5a32. {{(pid=88568) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 30 17:01:27 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc61b1ea-63f9-40fb-9dab-73c6031950b3 tempest-VolumesExtendTest-719667368 None] Creating volume glance metadata for volume 184de0c7-4bb0-4057-a4d9-72519feb5a32 backed by image 6126230f-0fba-48b9-943c-1885f4fc4be0 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6126230f-0fba-48b9-943c-1885f4fc4be0', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88568) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 30 17:01:27 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-717977c6-de7f-4a43-b48b-a3366c861b94 tempest-CreateVolumesFromSnapshotTest-266944850 None] Lock "cinder-95abc6c8-ba6f-46e0-94d0-4202afa9c6ba-delete_volume" released by "delete_volume" :: held 1.499s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:01:27 devstack sudo[101753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c953467c-76a1-4eac-8b57-b4211745a899 Jul 30 17:01:27 devstack sudo[101753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:27 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fc61b1ea-63f9-40fb-9dab-73c6031950b3 tempest-VolumesExtendTest-719667368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4475aea7-ef65-4d24-9a8c-8f1e98ce6999) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-184de0c7-4bb0-4057-a4d9-72519feb5a32', 'volume_size': 1, 'image_id': '6126230f-0fba-48b9-943c-1885f4fc4be0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6126230f-0fba-48b9-943c-1885f4fc4be0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2802aa975ace4011a130c68c7a9c96bb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6126230f-0fba-48b9-943c-1885f4fc4be0', 'created_at': datetime.datetime(2026, 7, 30, 14, 43, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 43, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6126230f-0fba-48b9-943c-1885f4fc4be0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:27 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fc61b1ea-63f9-40fb-9dab-73c6031950b3 tempest-VolumesExtendTest-719667368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ee4d42c-4245-4b3d-b207-29711ca8bedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:27 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-fc61b1ea-63f9-40fb-9dab-73c6031950b3 tempest-VolumesExtendTest-719667368 None] Volume volume-184de0c7-4bb0-4057-a4d9-72519feb5a32 (184de0c7-4bb0-4057-a4d9-72519feb5a32): created successfully Jul 30 17:01:27 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fc61b1ea-63f9-40fb-9dab-73c6031950b3 tempest-VolumesExtendTest-719667368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ee4d42c-4245-4b3d-b207-29711ca8bedd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:27 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fc61b1ea-63f9-40fb-9dab-73c6031950b3 tempest-VolumesExtendTest-719667368 None] Flow 'volume_create_manager' (79ce2488-4caf-4e3c-b576-29b0810e11d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:01:27 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-fc61b1ea-63f9-40fb-9dab-73c6031950b3 tempest-VolumesExtendTest-719667368 None] Created volume successfully. Jul 30 17:01:27 devstack sudo[101753]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:27 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-3546d7a2-3c3d-477a-9e7d-1813b0e2ab07 tempest-CreateVolumesFromSnapshotTest-266944850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c953467c-76a1-4eac-8b57-b4211745a899" returned: 0 in 0.481s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:27 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-3546d7a2-3c3d-477a-9e7d-1813b0e2ab07 tempest-CreateVolumesFromSnapshotTest-266944850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c953467c-76a1-4eac-8b57-b4211745a899 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:27 devstack sudo[101759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c953467c-76a1-4eac-8b57-b4211745a899 Jul 30 17:01:27 devstack sudo[101759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:27 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-0dd36638-cee6-4c92-ad38-1da9c02c9868 tempest-VolumesExtendTest-719667368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:01:27 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-0dd36638-cee6-4c92-ad38-1da9c02c9868 tempest-VolumesExtendTest-719667368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:01:27 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[c07fa869-1a5b-45ca-afa5-66d433ac00d9]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:01:27 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0dd36638-cee6-4c92-ad38-1da9c02c9868 tempest-VolumesExtendTest-719667368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-184de0c7-4bb0-4057-a4d9-72519feb5a32 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:27 devstack sudo[101759]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:27 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-3546d7a2-3c3d-477a-9e7d-1813b0e2ab07 tempest-CreateVolumesFromSnapshotTest-266944850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c953467c-76a1-4eac-8b57-b4211745a899" returned: 0 in 0.326s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:27 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-3546d7a2-3c3d-477a-9e7d-1813b0e2ab07 tempest-CreateVolumesFromSnapshotTest-266944850 None] Lock "cinder-quobyte-c953467c-76a1-4eac-8b57-b4211745a899" released by "delete_volume" :: held 0.856s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:01:27 devstack sudo[101761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-184de0c7-4bb0-4057-a4d9-72519feb5a32 Jul 30 17:01:27 devstack sudo[101761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:28 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-3546d7a2-3c3d-477a-9e7d-1813b0e2ab07 tempest-CreateVolumesFromSnapshotTest-266944850 None] Created reservations ['0b24e2c8-9af8-43d9-85a1-76e6f6ae6719', '4980c337-4485-4b01-88ae-a8a5c88753af', 'd920d79a-7a39-4e3a-88b0-3e25953b3166', '4f86fee4-d407-4c58-800d-446e72a00cab'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:01:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-3546d7a2-3c3d-477a-9e7d-1813b0e2ab07 tempest-CreateVolumesFromSnapshotTest-266944850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:01:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-3546d7a2-3c3d-477a-9e7d-1813b0e2ab07 tempest-CreateVolumesFromSnapshotTest-266944850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:01:28 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-3546d7a2-3c3d-477a-9e7d-1813b0e2ab07 tempest-CreateVolumesFromSnapshotTest-266944850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:01:28 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-3546d7a2-3c3d-477a-9e7d-1813b0e2ab07 tempest-CreateVolumesFromSnapshotTest-266944850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:01:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-3546d7a2-3c3d-477a-9e7d-1813b0e2ab07 tempest-CreateVolumesFromSnapshotTest-266944850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:01:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-3546d7a2-3c3d-477a-9e7d-1813b0e2ab07 tempest-CreateVolumesFromSnapshotTest-266944850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:28 devstack sudo[101764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:01:28 devstack sudo[101764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:28 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-c87e0a8d-b722-41c1-84cd-02f38636aee4 tempest-CreateVolumesFromSnapshotTest-266944850 None] Acquiring lock "cinder-0f172482-6714-4ca9-bebd-224a830b485c-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:01:28 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-c87e0a8d-b722-41c1-84cd-02f38636aee4 tempest-CreateVolumesFromSnapshotTest-266944850 None] Lock "cinder-0f172482-6714-4ca9-bebd-224a830b485c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:01:28 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-c87e0a8d-b722-41c1-84cd-02f38636aee4 tempest-CreateVolumesFromSnapshotTest-266944850 None] Acquiring lock "cinder-quobyte-0f172482-6714-4ca9-bebd-224a830b485c" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:01:28 devstack sudo[101761]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:28 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-c87e0a8d-b722-41c1-84cd-02f38636aee4 tempest-CreateVolumesFromSnapshotTest-266944850 None] Lock "cinder-quobyte-0f172482-6714-4ca9-bebd-224a830b485c" acquired by "delete_volume" :: waited 0.024s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:01:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0dd36638-cee6-4c92-ad38-1da9c02c9868 tempest-VolumesExtendTest-719667368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-184de0c7-4bb0-4057-a4d9-72519feb5a32" returned: 0 in 0.480s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0dd36638-cee6-4c92-ad38-1da9c02c9868 tempest-VolumesExtendTest-719667368 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-184de0c7-4bb0-4057-a4d9-72519feb5a32 2G {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:28 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c1cbd09-1013-4919-b776-6eef32b7bbbf]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:01:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-c87e0a8d-b722-41c1-84cd-02f38636aee4 tempest-CreateVolumesFromSnapshotTest-266944850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0f172482-6714-4ca9-bebd-224a830b485c {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:28 devstack sudo[101764]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-3546d7a2-3c3d-477a-9e7d-1813b0e2ab07 tempest-CreateVolumesFromSnapshotTest-266944850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.336s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:28 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-3546d7a2-3c3d-477a-9e7d-1813b0e2ab07 tempest-CreateVolumesFromSnapshotTest-266944850 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:01:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0dd36638-cee6-4c92-ad38-1da9c02c9868 tempest-VolumesExtendTest-719667368 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-184de0c7-4bb0-4057-a4d9-72519feb5a32 2G" returned: 0 in 0.133s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-0dd36638-cee6-4c92-ad38-1da9c02c9868 tempest-VolumesExtendTest-719667368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.640s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:01:28 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-3546d7a2-3c3d-477a-9e7d-1813b0e2ab07 tempest-CreateVolumesFromSnapshotTest-266944850 None] Deleted volume successfully. Jul 30 17:01:28 devstack sudo[101770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0f172482-6714-4ca9-bebd-224a830b485c Jul 30 17:01:28 devstack sudo[101770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:28 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-3546d7a2-3c3d-477a-9e7d-1813b0e2ab07 tempest-CreateVolumesFromSnapshotTest-266944850 None] Lock "cinder-c953467c-76a1-4eac-8b57-b4211745a899-delete_volume" released by "delete_volume" :: held 1.476s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:01:28 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-0dd36638-cee6-4c92-ad38-1da9c02c9868 tempest-VolumesExtendTest-719667368 None] Extend volume completed successfully. Jul 30 17:01:28 devstack sudo[101770]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-c87e0a8d-b722-41c1-84cd-02f38636aee4 tempest-CreateVolumesFromSnapshotTest-266944850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0f172482-6714-4ca9-bebd-224a830b485c" returned: 0 in 0.423s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-c87e0a8d-b722-41c1-84cd-02f38636aee4 tempest-CreateVolumesFromSnapshotTest-266944850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0f172482-6714-4ca9-bebd-224a830b485c {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:28 devstack sudo[101779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0f172482-6714-4ca9-bebd-224a830b485c Jul 30 17:01:28 devstack sudo[101779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:29 devstack sudo[101779]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-c87e0a8d-b722-41c1-84cd-02f38636aee4 tempest-CreateVolumesFromSnapshotTest-266944850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0f172482-6714-4ca9-bebd-224a830b485c" returned: 0 in 0.265s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:29 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-c87e0a8d-b722-41c1-84cd-02f38636aee4 tempest-CreateVolumesFromSnapshotTest-266944850 None] Lock "cinder-quobyte-0f172482-6714-4ca9-bebd-224a830b485c" released by "delete_volume" :: held 0.744s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:01:29 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-c87e0a8d-b722-41c1-84cd-02f38636aee4 tempest-CreateVolumesFromSnapshotTest-266944850 None] Created reservations ['33ea4c38-d9a5-43fc-b140-ec9504d98fa9', '00f312da-5576-4d7c-9610-b7d6f1046eac', '8cb72632-9912-4b1b-a7de-a480797296e7', '9dcd6461-2a46-4ee0-8f57-9406d162165e'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:01:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-c87e0a8d-b722-41c1-84cd-02f38636aee4 tempest-CreateVolumesFromSnapshotTest-266944850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:01:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-c87e0a8d-b722-41c1-84cd-02f38636aee4 tempest-CreateVolumesFromSnapshotTest-266944850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:01:29 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-c87e0a8d-b722-41c1-84cd-02f38636aee4 tempest-CreateVolumesFromSnapshotTest-266944850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:01:29 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-c87e0a8d-b722-41c1-84cd-02f38636aee4 tempest-CreateVolumesFromSnapshotTest-266944850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:01:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-c87e0a8d-b722-41c1-84cd-02f38636aee4 tempest-CreateVolumesFromSnapshotTest-266944850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:01:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-c87e0a8d-b722-41c1-84cd-02f38636aee4 tempest-CreateVolumesFromSnapshotTest-266944850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:29 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-7371f74e-9381-4e61-a1ea-721fdaad5711 tempest-VolumesExtendTest-719667368 None] Acquiring lock "cinder-184de0c7-4bb0-4057-a4d9-72519feb5a32-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:01:29 devstack sudo[101782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:01:29 devstack sudo[101782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:29 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-7371f74e-9381-4e61-a1ea-721fdaad5711 tempest-VolumesExtendTest-719667368 None] Lock "cinder-184de0c7-4bb0-4057-a4d9-72519feb5a32-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:01:29 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-7371f74e-9381-4e61-a1ea-721fdaad5711 tempest-VolumesExtendTest-719667368 None] Acquiring lock "cinder-quobyte-184de0c7-4bb0-4057-a4d9-72519feb5a32" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:01:29 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-7371f74e-9381-4e61-a1ea-721fdaad5711 tempest-VolumesExtendTest-719667368 None] Lock "cinder-quobyte-184de0c7-4bb0-4057-a4d9-72519feb5a32" acquired by "delete_volume" :: waited 0.016s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:01:29 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f382fa-68ef-4435-9031-4c0fe732df1b]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:01:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7371f74e-9381-4e61-a1ea-721fdaad5711 tempest-VolumesExtendTest-719667368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-184de0c7-4bb0-4057-a4d9-72519feb5a32 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:29 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-b89994eb-59b3-40d8-baf0-7394f42d09ed tempest-CreateVolumesFromSnapshotTest-266944850 None] Acquiring lock "cinder-3db6f2af-4921-43a0-a9ab-25177fb0b2ee-delete_snapshot" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:01:29 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-b89994eb-59b3-40d8-baf0-7394f42d09ed tempest-CreateVolumesFromSnapshotTest-266944850 None] Lock "cinder-3db6f2af-4921-43a0-a9ab-25177fb0b2ee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:01:29 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-b89994eb-59b3-40d8-baf0-7394f42d09ed tempest-CreateVolumesFromSnapshotTest-266944850 None] Acquiring lock "cinder-quobyte-0183b9e2-1d57-4ab3-9667-5770999ba441" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:01:29 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-b89994eb-59b3-40d8-baf0-7394f42d09ed tempest-CreateVolumesFromSnapshotTest-266944850 None] Lock "cinder-quobyte-0183b9e2-1d57-4ab3-9667-5770999ba441" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:01:29 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-b89994eb-59b3-40d8-baf0-7394f42d09ed tempest-CreateVolumesFromSnapshotTest-266944850 None] Acquiring lock "cinder-quobyte-3db6f2af-4921-43a0-a9ab-25177fb0b2ee" by "_delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:01:29 devstack sudo[101784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-184de0c7-4bb0-4057-a4d9-72519feb5a32 Jul 30 17:01:29 devstack sudo[101782]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:29 devstack sudo[101784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:29 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-b89994eb-59b3-40d8-baf0-7394f42d09ed tempest-CreateVolumesFromSnapshotTest-266944850 None] Lock "cinder-quobyte-3db6f2af-4921-43a0-a9ab-25177fb0b2ee" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:01:29 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-b89994eb-59b3-40d8-baf0-7394f42d09ed tempest-CreateVolumesFromSnapshotTest-266944850 None] Deleting offline snapshot 3db6f2af-4921-43a0-a9ab-25177fb0b2ee of volume 0183b9e2-1d57-4ab3-9667-5770999ba441 {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:01:29 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-b89994eb-59b3-40d8-baf0-7394f42d09ed tempest-CreateVolumesFromSnapshotTest-266944850 None] snapshot_file for this snap is: volume-0183b9e2-1d57-4ab3-9667-5770999ba441.3db6f2af-4921-43a0-a9ab-25177fb0b2ee {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:01:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-c87e0a8d-b722-41c1-84cd-02f38636aee4 tempest-CreateVolumesFromSnapshotTest-266944850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.344s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:29 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-c87e0a8d-b722-41c1-84cd-02f38636aee4 tempest-CreateVolumesFromSnapshotTest-266944850 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:01:29 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-c87e0a8d-b722-41c1-84cd-02f38636aee4 tempest-CreateVolumesFromSnapshotTest-266944850 None] Deleted volume successfully. Jul 30 17:01:29 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[f44229bb-f353-4c58-acf0-befcfaf587e4]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:01:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-b89994eb-59b3-40d8-baf0-7394f42d09ed tempest-CreateVolumesFromSnapshotTest-266944850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0183b9e2-1d57-4ab3-9667-5770999ba441.3db6f2af-4921-43a0-a9ab-25177fb0b2ee {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:29 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-c87e0a8d-b722-41c1-84cd-02f38636aee4 tempest-CreateVolumesFromSnapshotTest-266944850 None] Lock "cinder-0f172482-6714-4ca9-bebd-224a830b485c-delete_volume" released by "delete_volume" :: held 1.358s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:01:29 devstack sudo[101787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0183b9e2-1d57-4ab3-9667-5770999ba441.3db6f2af-4921-43a0-a9ab-25177fb0b2ee Jul 30 17:01:29 devstack sudo[101787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:29 devstack sudo[101784]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7371f74e-9381-4e61-a1ea-721fdaad5711 tempest-VolumesExtendTest-719667368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-184de0c7-4bb0-4057-a4d9-72519feb5a32" returned: 0 in 0.447s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7371f74e-9381-4e61-a1ea-721fdaad5711 tempest-VolumesExtendTest-719667368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-184de0c7-4bb0-4057-a4d9-72519feb5a32 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:29 devstack sudo[101792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-184de0c7-4bb0-4057-a4d9-72519feb5a32 Jul 30 17:01:29 devstack sudo[101792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:29 devstack sudo[101787]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-b89994eb-59b3-40d8-baf0-7394f42d09ed tempest-CreateVolumesFromSnapshotTest-266944850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0183b9e2-1d57-4ab3-9667-5770999ba441.3db6f2af-4921-43a0-a9ab-25177fb0b2ee" returned: 0 in 0.424s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:29 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-b89994eb-59b3-40d8-baf0-7394f42d09ed tempest-CreateVolumesFromSnapshotTest-266944850 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0183b9e2-1d57-4ab3-9667-5770999ba441(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:01:30 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dabb8b0-daa9-45be-a9d8-2db35831b2ae]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:01:30 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-b89994eb-59b3-40d8-baf0-7394f42d09ed tempest-CreateVolumesFromSnapshotTest-266944850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0183b9e2-1d57-4ab3-9667-5770999ba441 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:30 devstack sudo[101792]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:30 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7371f74e-9381-4e61-a1ea-721fdaad5711 tempest-VolumesExtendTest-719667368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-184de0c7-4bb0-4057-a4d9-72519feb5a32" returned: 0 in 0.281s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:30 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-7371f74e-9381-4e61-a1ea-721fdaad5711 tempest-VolumesExtendTest-719667368 None] Lock "cinder-quobyte-184de0c7-4bb0-4057-a4d9-72519feb5a32" released by "delete_volume" :: held 0.785s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:01:30 devstack sudo[101798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0183b9e2-1d57-4ab3-9667-5770999ba441 Jul 30 17:01:30 devstack sudo[101798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:30 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-7371f74e-9381-4e61-a1ea-721fdaad5711 tempest-VolumesExtendTest-719667368 None] Created reservations ['46705568-13f5-4246-9f7b-2587254adc1b', '3de728ed-8f8c-4982-b891-43c1f27d34c9', 'db7cfd85-783a-4441-a0b8-2a28ad6923fe', '71e3c4cb-a011-4cf5-93b4-7f0b02258905'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:01:30 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-7371f74e-9381-4e61-a1ea-721fdaad5711 tempest-VolumesExtendTest-719667368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:01:30 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-7371f74e-9381-4e61-a1ea-721fdaad5711 tempest-VolumesExtendTest-719667368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:01:30 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-7371f74e-9381-4e61-a1ea-721fdaad5711 tempest-VolumesExtendTest-719667368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:01:30 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-7371f74e-9381-4e61-a1ea-721fdaad5711 tempest-VolumesExtendTest-719667368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:01:30 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-7371f74e-9381-4e61-a1ea-721fdaad5711 tempest-VolumesExtendTest-719667368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:01:30 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7371f74e-9381-4e61-a1ea-721fdaad5711 tempest-VolumesExtendTest-719667368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:30 devstack sudo[101800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:01:30 devstack sudo[101800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:30 devstack sudo[101798]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:30 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-b89994eb-59b3-40d8-baf0-7394f42d09ed tempest-CreateVolumesFromSnapshotTest-266944850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0183b9e2-1d57-4ab3-9667-5770999ba441" returned: 0 in 0.460s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:30 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-b89994eb-59b3-40d8-baf0-7394f42d09ed tempest-CreateVolumesFromSnapshotTest-266944850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0183b9e2-1d57-4ab3-9667-5770999ba441.3db6f2af-4921-43a0-a9ab-25177fb0b2ee {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:30 devstack sudo[101805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0183b9e2-1d57-4ab3-9667-5770999ba441.3db6f2af-4921-43a0-a9ab-25177fb0b2ee Jul 30 17:01:30 devstack sudo[101805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:30 devstack sudo[101800]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:30 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7371f74e-9381-4e61-a1ea-721fdaad5711 tempest-VolumesExtendTest-719667368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.316s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:30 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-7371f74e-9381-4e61-a1ea-721fdaad5711 tempest-VolumesExtendTest-719667368 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:01:30 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-7371f74e-9381-4e61-a1ea-721fdaad5711 tempest-VolumesExtendTest-719667368 None] Deleted volume successfully. Jul 30 17:01:30 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-7371f74e-9381-4e61-a1ea-721fdaad5711 tempest-VolumesExtendTest-719667368 None] Lock "cinder-184de0c7-4bb0-4057-a4d9-72519feb5a32-delete_volume" released by "delete_volume" :: held 1.373s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:01:30 devstack sudo[101805]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:30 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-b89994eb-59b3-40d8-baf0-7394f42d09ed tempest-CreateVolumesFromSnapshotTest-266944850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0183b9e2-1d57-4ab3-9667-5770999ba441.3db6f2af-4921-43a0-a9ab-25177fb0b2ee" returned: 0 in 0.484s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:30 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-b89994eb-59b3-40d8-baf0-7394f42d09ed tempest-CreateVolumesFromSnapshotTest-266944850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0183b9e2-1d57-4ab3-9667-5770999ba441.3db6f2af-4921-43a0-a9ab-25177fb0b2ee {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:31 devstack sudo[101811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0183b9e2-1d57-4ab3-9667-5770999ba441.3db6f2af-4921-43a0-a9ab-25177fb0b2ee Jul 30 17:01:31 devstack sudo[101811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:31 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d69f4cf-2c8e-40e0-bed1-4b07fc2163cb tempest-VolumesExtendTest-719667368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:01:31 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7d69f4cf-2c8e-40e0-bed1-4b07fc2163cb tempest-VolumesExtendTest-719667368 None] Flow 'volume_create_manager' (6468f4b2-58e1-4e81-b8d7-e530156dfd50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:01:31 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7d69f4cf-2c8e-40e0-bed1-4b07fc2163cb tempest-VolumesExtendTest-719667368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b2de48c-3080-4e2e-9bb6-b38705f6020f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:31 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7d69f4cf-2c8e-40e0-bed1-4b07fc2163cb tempest-VolumesExtendTest-719667368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b2de48c-3080-4e2e-9bb6-b38705f6020f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:01:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-613027993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6192d6b7-47e9-4f1d-af34-82c469fa4c3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb9f62d3088f454897cc8a64f20043e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:01:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:01:31Z,use_quota=True,user_id='88b01a22a72b46cba74cbdaba3ecebd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:31 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7d69f4cf-2c8e-40e0-bed1-4b07fc2163cb tempest-VolumesExtendTest-719667368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d1cefdb-79c9-45aa-944b-a8d4ae9475ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:31 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7d69f4cf-2c8e-40e0-bed1-4b07fc2163cb tempest-VolumesExtendTest-719667368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d1cefdb-79c9-45aa-944b-a8d4ae9475ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:31 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7d69f4cf-2c8e-40e0-bed1-4b07fc2163cb tempest-VolumesExtendTest-719667368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e69cf127-c429-4a0a-9979-b7bd231062c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:31 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7d69f4cf-2c8e-40e0-bed1-4b07fc2163cb tempest-VolumesExtendTest-719667368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e69cf127-c429-4a0a-9979-b7bd231062c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6192d6b7-47e9-4f1d-af34-82c469fa4c3e', 'volume_name': 'volume-6192d6b7-47e9-4f1d-af34-82c469fa4c3e', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:31 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7d69f4cf-2c8e-40e0-bed1-4b07fc2163cb tempest-VolumesExtendTest-719667368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13850170-abf8-4b95-b672-46b76a9e2c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:31 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7d69f4cf-2c8e-40e0-bed1-4b07fc2163cb tempest-VolumesExtendTest-719667368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13850170-abf8-4b95-b672-46b76a9e2c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:31 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7d69f4cf-2c8e-40e0-bed1-4b07fc2163cb tempest-VolumesExtendTest-719667368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4f0510d-0abb-49b2-83fd-3d786be58159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:31 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-7d69f4cf-2c8e-40e0-bed1-4b07fc2163cb tempest-VolumesExtendTest-719667368 None] Volume 6192d6b7-47e9-4f1d-af34-82c469fa4c3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6192d6b7-47e9-4f1d-af34-82c469fa4c3e', 'volume_size': 1} Jul 30 17:01:31 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-7d69f4cf-2c8e-40e0-bed1-4b07fc2163cb tempest-VolumesExtendTest-719667368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:01:31 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-7d69f4cf-2c8e-40e0-bed1-4b07fc2163cb tempest-VolumesExtendTest-719667368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:01:31 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-7d69f4cf-2c8e-40e0-bed1-4b07fc2163cb tempest-VolumesExtendTest-719667368 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:01:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-613027993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6192d6b7-47e9-4f1d-af34-82c469fa4c3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb9f62d3088f454897cc8a64f20043e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:01:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:01:31Z,use_quota=True,user_id='88b01a22a72b46cba74cbdaba3ecebd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:01:31 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-7d69f4cf-2c8e-40e0-bed1-4b07fc2163cb tempest-VolumesExtendTest-719667368 None] Creating volume 6192d6b7-47e9-4f1d-af34-82c469fa4c3e {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:01:31 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-7d69f4cf-2c8e-40e0-bed1-4b07fc2163cb tempest-VolumesExtendTest-719667368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:01:31 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-7d69f4cf-2c8e-40e0-bed1-4b07fc2163cb tempest-VolumesExtendTest-719667368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:01:31 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-7d69f4cf-2c8e-40e0-bed1-4b07fc2163cb tempest-VolumesExtendTest-719667368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:01:31 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-7d69f4cf-2c8e-40e0-bed1-4b07fc2163cb tempest-VolumesExtendTest-719667368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:01:31 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-7d69f4cf-2c8e-40e0-bed1-4b07fc2163cb tempest-VolumesExtendTest-719667368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:01:31 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-7d69f4cf-2c8e-40e0-bed1-4b07fc2163cb tempest-VolumesExtendTest-719667368 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:01:31 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-7d69f4cf-2c8e-40e0-bed1-4b07fc2163cb tempest-VolumesExtendTest-719667368 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:01:31 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7d69f4cf-2c8e-40e0-bed1-4b07fc2163cb tempest-VolumesExtendTest-719667368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6192d6b7-47e9-4f1d-af34-82c469fa4c3e 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:31 devstack sudo[101813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6192d6b7-47e9-4f1d-af34-82c469fa4c3e 1073741824 Jul 30 17:01:31 devstack sudo[101813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:31 devstack sudo[101811]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:31 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-b89994eb-59b3-40d8-baf0-7394f42d09ed tempest-CreateVolumesFromSnapshotTest-266944850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0183b9e2-1d57-4ab3-9667-5770999ba441.3db6f2af-4921-43a0-a9ab-25177fb0b2ee" returned: 0 in 0.272s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:31 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-b89994eb-59b3-40d8-baf0-7394f42d09ed tempest-CreateVolumesFromSnapshotTest-266944850 None] Lock "cinder-quobyte-3db6f2af-4921-43a0-a9ab-25177fb0b2ee" released by "_delete_snapshot" :: held 1.790s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:01:31 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-b89994eb-59b3-40d8-baf0-7394f42d09ed tempest-CreateVolumesFromSnapshotTest-266944850 None] Lock "cinder-quobyte-0183b9e2-1d57-4ab3-9667-5770999ba441" released by "delete_snapshot" :: held 1.825s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:01:31 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-b89994eb-59b3-40d8-baf0-7394f42d09ed tempest-CreateVolumesFromSnapshotTest-266944850 None] Created reservations ['36e16b26-184b-470c-afe5-291c3557c319', '40d02ef4-3b1d-4c99-b4df-d19e4d8cd4df', '833858f5-5804-4f72-855f-66448c13a482', 'bdf649a5-9a59-4f49-aea8-3bba2f2235d7'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:01:31 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-b89994eb-59b3-40d8-baf0-7394f42d09ed tempest-CreateVolumesFromSnapshotTest-266944850 None] Delete snapshot completed successfully. Jul 30 17:01:31 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-b89994eb-59b3-40d8-baf0-7394f42d09ed tempest-CreateVolumesFromSnapshotTest-266944850 None] Lock "cinder-3db6f2af-4921-43a0-a9ab-25177fb0b2ee-delete_snapshot" released by "delete_snapshot" :: held 2.008s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:01:31 devstack sudo[101813]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:31 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-5d76dea5-247b-48b2-9d44-7f94fb79422d tempest-CreateVolumesFromSnapshotTest-266944850 None] Acquiring lock "cinder-0183b9e2-1d57-4ab3-9667-5770999ba441-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:01:31 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7d69f4cf-2c8e-40e0-bed1-4b07fc2163cb tempest-VolumesExtendTest-719667368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6192d6b7-47e9-4f1d-af34-82c469fa4c3e 1073741824" returned: 0 in 0.571s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:31 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-5d76dea5-247b-48b2-9d44-7f94fb79422d tempest-CreateVolumesFromSnapshotTest-266944850 None] Lock "cinder-0183b9e2-1d57-4ab3-9667-5770999ba441-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:01:31 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7d69f4cf-2c8e-40e0-bed1-4b07fc2163cb tempest-VolumesExtendTest-719667368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6192d6b7-47e9-4f1d-af34-82c469fa4c3e {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:31 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-5d76dea5-247b-48b2-9d44-7f94fb79422d tempest-CreateVolumesFromSnapshotTest-266944850 None] Acquiring lock "cinder-quobyte-0183b9e2-1d57-4ab3-9667-5770999ba441" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:01:31 devstack sudo[101820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6192d6b7-47e9-4f1d-af34-82c469fa4c3e Jul 30 17:01:31 devstack sudo[101820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:31 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-5d76dea5-247b-48b2-9d44-7f94fb79422d tempest-CreateVolumesFromSnapshotTest-266944850 None] Lock "cinder-quobyte-0183b9e2-1d57-4ab3-9667-5770999ba441" acquired by "delete_volume" :: waited 0.025s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:01:31 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2aad623-d5d2-458f-a33c-12b47b49a007]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:01:31 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-5d76dea5-247b-48b2-9d44-7f94fb79422d tempest-CreateVolumesFromSnapshotTest-266944850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0183b9e2-1d57-4ab3-9667-5770999ba441 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:32 devstack sudo[101822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0183b9e2-1d57-4ab3-9667-5770999ba441 Jul 30 17:01:32 devstack sudo[101822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:32 devstack sudo[101820]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:32 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7d69f4cf-2c8e-40e0-bed1-4b07fc2163cb tempest-VolumesExtendTest-719667368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6192d6b7-47e9-4f1d-af34-82c469fa4c3e" returned: 0 in 0.332s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:32 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-7d69f4cf-2c8e-40e0-bed1-4b07fc2163cb tempest-VolumesExtendTest-719667368 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:01:32 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-7d69f4cf-2c8e-40e0-bed1-4b07fc2163cb tempest-VolumesExtendTest-719667368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:01:32 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7d69f4cf-2c8e-40e0-bed1-4b07fc2163cb tempest-VolumesExtendTest-719667368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4f0510d-0abb-49b2-83fd-3d786be58159) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6192d6b7-47e9-4f1d-af34-82c469fa4c3e', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:32 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7d69f4cf-2c8e-40e0-bed1-4b07fc2163cb tempest-VolumesExtendTest-719667368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65f807bf-2899-4ab6-87a3-7c17b52f9f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:32 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-7d69f4cf-2c8e-40e0-bed1-4b07fc2163cb tempest-VolumesExtendTest-719667368 None] Volume volume-6192d6b7-47e9-4f1d-af34-82c469fa4c3e (6192d6b7-47e9-4f1d-af34-82c469fa4c3e): created successfully Jul 30 17:01:32 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7d69f4cf-2c8e-40e0-bed1-4b07fc2163cb tempest-VolumesExtendTest-719667368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65f807bf-2899-4ab6-87a3-7c17b52f9f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:32 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7d69f4cf-2c8e-40e0-bed1-4b07fc2163cb tempest-VolumesExtendTest-719667368 None] Flow 'volume_create_manager' (6468f4b2-58e1-4e81-b8d7-e530156dfd50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:01:32 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-7d69f4cf-2c8e-40e0-bed1-4b07fc2163cb tempest-VolumesExtendTest-719667368 None] Created volume successfully. Jul 30 17:01:32 devstack sudo[101822]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:32 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-5d76dea5-247b-48b2-9d44-7f94fb79422d tempest-CreateVolumesFromSnapshotTest-266944850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0183b9e2-1d57-4ab3-9667-5770999ba441" returned: 0 in 0.448s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:32 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-5d76dea5-247b-48b2-9d44-7f94fb79422d tempest-CreateVolumesFromSnapshotTest-266944850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0183b9e2-1d57-4ab3-9667-5770999ba441 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:32 devstack sudo[101828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0183b9e2-1d57-4ab3-9667-5770999ba441 Jul 30 17:01:32 devstack sudo[101828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:32 devstack sudo[101828]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:32 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-5d76dea5-247b-48b2-9d44-7f94fb79422d tempest-CreateVolumesFromSnapshotTest-266944850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0183b9e2-1d57-4ab3-9667-5770999ba441" returned: 0 in 0.267s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:32 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-5d76dea5-247b-48b2-9d44-7f94fb79422d tempest-CreateVolumesFromSnapshotTest-266944850 None] Lock "cinder-quobyte-0183b9e2-1d57-4ab3-9667-5770999ba441" released by "delete_volume" :: held 0.801s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:01:32 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-5d76dea5-247b-48b2-9d44-7f94fb79422d tempest-CreateVolumesFromSnapshotTest-266944850 None] Created reservations ['9c225407-9503-44fa-afbc-3109d54d5d88', '3c4b83ba-eb43-47a4-b67e-2a72b313218d', 'dbbcbbaa-ecad-4850-bc2f-67f37799f9ca', 'ff4b7845-b328-431a-ad41-fb50a170d87e'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:01:32 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-5d76dea5-247b-48b2-9d44-7f94fb79422d tempest-CreateVolumesFromSnapshotTest-266944850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:01:32 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-5d76dea5-247b-48b2-9d44-7f94fb79422d tempest-CreateVolumesFromSnapshotTest-266944850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:01:32 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-5d76dea5-247b-48b2-9d44-7f94fb79422d tempest-CreateVolumesFromSnapshotTest-266944850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:01:32 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-5d76dea5-247b-48b2-9d44-7f94fb79422d tempest-CreateVolumesFromSnapshotTest-266944850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:01:32 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-5d76dea5-247b-48b2-9d44-7f94fb79422d tempest-CreateVolumesFromSnapshotTest-266944850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:01:32 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-5d76dea5-247b-48b2-9d44-7f94fb79422d tempest-CreateVolumesFromSnapshotTest-266944850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:32 devstack sudo[101831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:01:32 devstack sudo[101831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:33 devstack sudo[101831]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:33 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-5d76dea5-247b-48b2-9d44-7f94fb79422d tempest-CreateVolumesFromSnapshotTest-266944850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.277s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:33 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-5d76dea5-247b-48b2-9d44-7f94fb79422d tempest-CreateVolumesFromSnapshotTest-266944850 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:01:33 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-5d76dea5-247b-48b2-9d44-7f94fb79422d tempest-CreateVolumesFromSnapshotTest-266944850 None] Deleted volume successfully. Jul 30 17:01:33 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-5d76dea5-247b-48b2-9d44-7f94fb79422d tempest-CreateVolumesFromSnapshotTest-266944850 None] Lock "cinder-0183b9e2-1d57-4ab3-9667-5770999ba441-delete_volume" released by "delete_volume" :: held 1.369s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:01:33 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-67e17c2e-7e6d-4bfe-90f6-01c573da0c4f tempest-VolumesExtendTest-719667368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:01:33 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-67e17c2e-7e6d-4bfe-90f6-01c573da0c4f tempest-VolumesExtendTest-719667368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:01:33 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-67e17c2e-7e6d-4bfe-90f6-01c573da0c4f tempest-VolumesExtendTest-719667368 None] Creating offline snapshot 3d299c9e-f749-4cb0-80a2-64e31aaaa816 of volume 6192d6b7-47e9-4f1d-af34-82c469fa4c3e {{(pid=88568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:01:33 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae76ee0-7b8f-43a3-816f-07cbb3282ae4]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:01:33 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-67e17c2e-7e6d-4bfe-90f6-01c573da0c4f tempest-VolumesExtendTest-719667368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6192d6b7-47e9-4f1d-af34-82c469fa4c3e {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:33 devstack sudo[101834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6192d6b7-47e9-4f1d-af34-82c469fa4c3e Jul 30 17:01:33 devstack sudo[101834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:33 devstack sudo[101834]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:33 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-67e17c2e-7e6d-4bfe-90f6-01c573da0c4f tempest-VolumesExtendTest-719667368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6192d6b7-47e9-4f1d-af34-82c469fa4c3e" returned: 0 in 0.425s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:33 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-67e17c2e-7e6d-4bfe-90f6-01c573da0c4f tempest-VolumesExtendTest-719667368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6192d6b7-47e9-4f1d-af34-82c469fa4c3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6192d6b7-47e9-4f1d-af34-82c469fa4c3e.3d299c9e-f749-4cb0-80a2-64e31aaaa816 1G {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:33 devstack sudo[101840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6192d6b7-47e9-4f1d-af34-82c469fa4c3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6192d6b7-47e9-4f1d-af34-82c469fa4c3e.3d299c9e-f749-4cb0-80a2-64e31aaaa816 1G Jul 30 17:01:33 devstack sudo[101840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:34 devstack sudo[101840]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:34 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-67e17c2e-7e6d-4bfe-90f6-01c573da0c4f tempest-VolumesExtendTest-719667368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6192d6b7-47e9-4f1d-af34-82c469fa4c3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6192d6b7-47e9-4f1d-af34-82c469fa4c3e.3d299c9e-f749-4cb0-80a2-64e31aaaa816 1G" returned: 0 in 0.456s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:34 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-67e17c2e-7e6d-4bfe-90f6-01c573da0c4f tempest-VolumesExtendTest-719667368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6192d6b7-47e9-4f1d-af34-82c469fa4c3e -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6192d6b7-47e9-4f1d-af34-82c469fa4c3e.3d299c9e-f749-4cb0-80a2-64e31aaaa816 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:34 devstack sudo[101847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6192d6b7-47e9-4f1d-af34-82c469fa4c3e -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6192d6b7-47e9-4f1d-af34-82c469fa4c3e.3d299c9e-f749-4cb0-80a2-64e31aaaa816 Jul 30 17:01:34 devstack sudo[101847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:34 devstack sudo[101847]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:34 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-67e17c2e-7e6d-4bfe-90f6-01c573da0c4f tempest-VolumesExtendTest-719667368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6192d6b7-47e9-4f1d-af34-82c469fa4c3e -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6192d6b7-47e9-4f1d-af34-82c469fa4c3e.3d299c9e-f749-4cb0-80a2-64e31aaaa816" returned: 0 in 0.332s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:34 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-67e17c2e-7e6d-4bfe-90f6-01c573da0c4f tempest-VolumesExtendTest-719667368 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6192d6b7-47e9-4f1d-af34-82c469fa4c3e.3d299c9e-f749-4cb0-80a2-64e31aaaa816 is being set with open permissions: ugo+rw Jul 30 17:01:34 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-67e17c2e-7e6d-4bfe-90f6-01c573da0c4f tempest-VolumesExtendTest-719667368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6192d6b7-47e9-4f1d-af34-82c469fa4c3e.3d299c9e-f749-4cb0-80a2-64e31aaaa816 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:34 devstack sudo[101853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6192d6b7-47e9-4f1d-af34-82c469fa4c3e.3d299c9e-f749-4cb0-80a2-64e31aaaa816 Jul 30 17:01:34 devstack sudo[101853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:34 devstack sudo[101853]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:34 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-67e17c2e-7e6d-4bfe-90f6-01c573da0c4f tempest-VolumesExtendTest-719667368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6192d6b7-47e9-4f1d-af34-82c469fa4c3e.3d299c9e-f749-4cb0-80a2-64e31aaaa816" returned: 0 in 0.279s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:34 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-67e17c2e-7e6d-4bfe-90f6-01c573da0c4f tempest-VolumesExtendTest-719667368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6192d6b7-47e9-4f1d-af34-82c469fa4c3e.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:34 devstack sudo[101857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6192d6b7-47e9-4f1d-af34-82c469fa4c3e.info Jul 30 17:01:34 devstack sudo[101857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:35 devstack sudo[101857]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-67e17c2e-7e6d-4bfe-90f6-01c573da0c4f tempest-VolumesExtendTest-719667368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6192d6b7-47e9-4f1d-af34-82c469fa4c3e.info" returned: 0 in 0.270s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:35 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-67e17c2e-7e6d-4bfe-90f6-01c573da0c4f tempest-VolumesExtendTest-719667368 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6192d6b7-47e9-4f1d-af34-82c469fa4c3e.info is being set with open permissions: ugo+rw Jul 30 17:01:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-67e17c2e-7e6d-4bfe-90f6-01c573da0c4f tempest-VolumesExtendTest-719667368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6192d6b7-47e9-4f1d-af34-82c469fa4c3e.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:35 devstack sudo[101860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6192d6b7-47e9-4f1d-af34-82c469fa4c3e.info Jul 30 17:01:35 devstack sudo[101860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:35 devstack sudo[101860]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-67e17c2e-7e6d-4bfe-90f6-01c573da0c4f tempest-VolumesExtendTest-719667368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6192d6b7-47e9-4f1d-af34-82c469fa4c3e.info" returned: 0 in 0.290s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-67e17c2e-7e6d-4bfe-90f6-01c573da0c4f tempest-VolumesExtendTest-719667368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.168s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:01:35 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-67e17c2e-7e6d-4bfe-90f6-01c573da0c4f tempest-VolumesExtendTest-719667368 None] Create snapshot completed successfully Jul 30 17:01:36 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-e405535f-bb18-4a00-a031-8e2e2c264cd8 tempest-VolumeDependencyTests-369573918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:01:36 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e405535f-bb18-4a00-a031-8e2e2c264cd8 tempest-VolumeDependencyTests-369573918 None] Flow 'volume_create_manager' (2c4c1a72-ae31-4cc6-a50a-9ee22a56ba99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:01:36 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e405535f-bb18-4a00-a031-8e2e2c264cd8 tempest-VolumeDependencyTests-369573918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4be165b-399e-49e7-ba26-a469ee97d15d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:36 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e405535f-bb18-4a00-a031-8e2e2c264cd8 tempest-VolumeDependencyTests-369573918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4be165b-399e-49e7-ba26-a469ee97d15d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:01:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-416661992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79cc055b-3167-4030-b319-0c29251c33bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95d5e31e6bb34e1c8fc8f9eae59575a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:01:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:01:36Z,use_quota=True,user_id='aafb83285de54a90aa85bf9dedd22bc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:36 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e405535f-bb18-4a00-a031-8e2e2c264cd8 tempest-VolumeDependencyTests-369573918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5997aedc-331c-4128-bf98-ab61d1dfffad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:36 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e405535f-bb18-4a00-a031-8e2e2c264cd8 tempest-VolumeDependencyTests-369573918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5997aedc-331c-4128-bf98-ab61d1dfffad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:36 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e405535f-bb18-4a00-a031-8e2e2c264cd8 tempest-VolumeDependencyTests-369573918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaa5fb11-bbf4-468a-bbd7-2c4eeefe14b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:36 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e405535f-bb18-4a00-a031-8e2e2c264cd8 tempest-VolumeDependencyTests-369573918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaa5fb11-bbf4-468a-bbd7-2c4eeefe14b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79cc055b-3167-4030-b319-0c29251c33bf', 'volume_name': 'volume-79cc055b-3167-4030-b319-0c29251c33bf', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:36 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e405535f-bb18-4a00-a031-8e2e2c264cd8 tempest-VolumeDependencyTests-369573918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb669048-0d44-42dc-a7e6-2f66caa34705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:36 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e405535f-bb18-4a00-a031-8e2e2c264cd8 tempest-VolumeDependencyTests-369573918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb669048-0d44-42dc-a7e6-2f66caa34705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:36 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e405535f-bb18-4a00-a031-8e2e2c264cd8 tempest-VolumeDependencyTests-369573918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (844f981a-b6f6-4c41-8de0-46f790065e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:36 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-e405535f-bb18-4a00-a031-8e2e2c264cd8 tempest-VolumeDependencyTests-369573918 None] Volume 79cc055b-3167-4030-b319-0c29251c33bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79cc055b-3167-4030-b319-0c29251c33bf', 'volume_size': 1} Jul 30 17:01:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-e405535f-bb18-4a00-a031-8e2e2c264cd8 tempest-VolumeDependencyTests-369573918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:01:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-e405535f-bb18-4a00-a031-8e2e2c264cd8 tempest-VolumeDependencyTests-369573918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:01:36 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-e405535f-bb18-4a00-a031-8e2e2c264cd8 tempest-VolumeDependencyTests-369573918 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:01:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-416661992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79cc055b-3167-4030-b319-0c29251c33bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95d5e31e6bb34e1c8fc8f9eae59575a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:01:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:01:36Z,use_quota=True,user_id='aafb83285de54a90aa85bf9dedd22bc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:01:36 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-e405535f-bb18-4a00-a031-8e2e2c264cd8 tempest-VolumeDependencyTests-369573918 None] Creating volume 79cc055b-3167-4030-b319-0c29251c33bf {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:01:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-e405535f-bb18-4a00-a031-8e2e2c264cd8 tempest-VolumeDependencyTests-369573918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:01:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-e405535f-bb18-4a00-a031-8e2e2c264cd8 tempest-VolumeDependencyTests-369573918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:01:36 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-e405535f-bb18-4a00-a031-8e2e2c264cd8 tempest-VolumeDependencyTests-369573918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:01:36 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-e405535f-bb18-4a00-a031-8e2e2c264cd8 tempest-VolumeDependencyTests-369573918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:01:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-e405535f-bb18-4a00-a031-8e2e2c264cd8 tempest-VolumeDependencyTests-369573918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:01:36 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-e405535f-bb18-4a00-a031-8e2e2c264cd8 tempest-VolumeDependencyTests-369573918 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:01:36 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-e405535f-bb18-4a00-a031-8e2e2c264cd8 tempest-VolumeDependencyTests-369573918 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:01:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e405535f-bb18-4a00-a031-8e2e2c264cd8 tempest-VolumeDependencyTests-369573918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-79cc055b-3167-4030-b319-0c29251c33bf 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:36 devstack sudo[101897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-79cc055b-3167-4030-b319-0c29251c33bf 1073741824 Jul 30 17:01:36 devstack sudo[101897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-2e2d6c1f-9169-4cfa-aed6-5fb3d38b1a9b tempest-VolumesExtendTest-719667368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:01:36 devstack sudo[101897]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e405535f-bb18-4a00-a031-8e2e2c264cd8 tempest-VolumeDependencyTests-369573918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-79cc055b-3167-4030-b319-0c29251c33bf 1073741824" returned: 0 in 0.519s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e405535f-bb18-4a00-a031-8e2e2c264cd8 tempest-VolumeDependencyTests-369573918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-79cc055b-3167-4030-b319-0c29251c33bf {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:36 devstack sudo[101905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-79cc055b-3167-4030-b319-0c29251c33bf Jul 30 17:01:36 devstack sudo[101905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:37 devstack sudo[101905]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:37 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e405535f-bb18-4a00-a031-8e2e2c264cd8 tempest-VolumeDependencyTests-369573918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-79cc055b-3167-4030-b319-0c29251c33bf" returned: 0 in 0.242s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:37 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-e405535f-bb18-4a00-a031-8e2e2c264cd8 tempest-VolumeDependencyTests-369573918 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:01:37 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-e405535f-bb18-4a00-a031-8e2e2c264cd8 tempest-VolumeDependencyTests-369573918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:01:37 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-2e2d6c1f-9169-4cfa-aed6-5fb3d38b1a9b tempest-VolumesExtendTest-719667368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.503s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:01:37 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e405535f-bb18-4a00-a031-8e2e2c264cd8 tempest-VolumeDependencyTests-369573918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (844f981a-b6f6-4c41-8de0-46f790065e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79cc055b-3167-4030-b319-0c29251c33bf', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:37 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e405535f-bb18-4a00-a031-8e2e2c264cd8 tempest-VolumeDependencyTests-369573918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d93d5d96-0c3d-40e7-b920-dd370c1343cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:37 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a30ef88-4385-4a84-8e34-0b36d5946da7]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:01:37 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2e2d6c1f-9169-4cfa-aed6-5fb3d38b1a9b tempest-VolumesExtendTest-719667368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6192d6b7-47e9-4f1d-af34-82c469fa4c3e {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:37 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-e405535f-bb18-4a00-a031-8e2e2c264cd8 tempest-VolumeDependencyTests-369573918 None] Volume volume-79cc055b-3167-4030-b319-0c29251c33bf (79cc055b-3167-4030-b319-0c29251c33bf): created successfully Jul 30 17:01:37 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e405535f-bb18-4a00-a031-8e2e2c264cd8 tempest-VolumeDependencyTests-369573918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d93d5d96-0c3d-40e7-b920-dd370c1343cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:37 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e405535f-bb18-4a00-a031-8e2e2c264cd8 tempest-VolumeDependencyTests-369573918 None] Flow 'volume_create_manager' (2c4c1a72-ae31-4cc6-a50a-9ee22a56ba99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:01:37 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-e405535f-bb18-4a00-a031-8e2e2c264cd8 tempest-VolumeDependencyTests-369573918 None] Created volume successfully. Jul 30 17:01:37 devstack sudo[101908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6192d6b7-47e9-4f1d-af34-82c469fa4c3e Jul 30 17:01:37 devstack sudo[101908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:37 devstack sudo[101908]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:37 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2e2d6c1f-9169-4cfa-aed6-5fb3d38b1a9b tempest-VolumesExtendTest-719667368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6192d6b7-47e9-4f1d-af34-82c469fa4c3e" returned: 0 in 0.366s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:37 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2e2d6c1f-9169-4cfa-aed6-5fb3d38b1a9b tempest-VolumesExtendTest-719667368 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6192d6b7-47e9-4f1d-af34-82c469fa4c3e.3d299c9e-f749-4cb0-80a2-64e31aaaa816 2G {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:37 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2e2d6c1f-9169-4cfa-aed6-5fb3d38b1a9b tempest-VolumesExtendTest-719667368 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6192d6b7-47e9-4f1d-af34-82c469fa4c3e.3d299c9e-f749-4cb0-80a2-64e31aaaa816 2G" returned: 0 in 0.169s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:37 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-2e2d6c1f-9169-4cfa-aed6-5fb3d38b1a9b tempest-VolumesExtendTest-719667368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.583s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:01:37 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-2e2d6c1f-9169-4cfa-aed6-5fb3d38b1a9b tempest-VolumesExtendTest-719667368 None] Extend volume completed successfully. Jul 30 17:01:38 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-b1f52ed4-74dc-4f5f-89b7-9f76388bc819 tempest-VolumeDependencyTests-369573918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:01:38 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-b1f52ed4-74dc-4f5f-89b7-9f76388bc819 tempest-VolumeDependencyTests-369573918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:01:38 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-b1f52ed4-74dc-4f5f-89b7-9f76388bc819 tempest-VolumeDependencyTests-369573918 None] Creating offline snapshot 4ed1a05b-eebf-40e4-8edb-1c7a9238cd77 of volume 79cc055b-3167-4030-b319-0c29251c33bf {{(pid=88568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:01:38 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5e4056-6f25-478c-9a65-81780150087a]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:01:38 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-b1f52ed4-74dc-4f5f-89b7-9f76388bc819 tempest-VolumeDependencyTests-369573918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-79cc055b-3167-4030-b319-0c29251c33bf {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:38 devstack sudo[101918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-79cc055b-3167-4030-b319-0c29251c33bf Jul 30 17:01:38 devstack sudo[101918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:38 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-3a7efa54-2b2d-4c83-a74d-042b99d2f16c tempest-VolumesExtendTest-719667368 None] Acquiring lock "cinder-3d299c9e-f749-4cb0-80a2-64e31aaaa816-delete_snapshot" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:01:38 devstack sudo[101918]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:38 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-b1f52ed4-74dc-4f5f-89b7-9f76388bc819 tempest-VolumeDependencyTests-369573918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-79cc055b-3167-4030-b319-0c29251c33bf" returned: 0 in 0.389s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:38 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-b1f52ed4-74dc-4f5f-89b7-9f76388bc819 tempest-VolumeDependencyTests-369573918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-79cc055b-3167-4030-b319-0c29251c33bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-79cc055b-3167-4030-b319-0c29251c33bf.4ed1a05b-eebf-40e4-8edb-1c7a9238cd77 1G {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:39 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-3a7efa54-2b2d-4c83-a74d-042b99d2f16c tempest-VolumesExtendTest-719667368 None] Lock "cinder-3d299c9e-f749-4cb0-80a2-64e31aaaa816-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:01:39 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-3a7efa54-2b2d-4c83-a74d-042b99d2f16c tempest-VolumesExtendTest-719667368 None] Acquiring lock "cinder-quobyte-6192d6b7-47e9-4f1d-af34-82c469fa4c3e" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:01:39 devstack sudo[101923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-79cc055b-3167-4030-b319-0c29251c33bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-79cc055b-3167-4030-b319-0c29251c33bf.4ed1a05b-eebf-40e4-8edb-1c7a9238cd77 1G Jul 30 17:01:39 devstack sudo[101923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:39 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-3a7efa54-2b2d-4c83-a74d-042b99d2f16c tempest-VolumesExtendTest-719667368 None] Lock "cinder-quobyte-6192d6b7-47e9-4f1d-af34-82c469fa4c3e" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:01:39 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-3a7efa54-2b2d-4c83-a74d-042b99d2f16c tempest-VolumesExtendTest-719667368 None] Acquiring lock "cinder-quobyte-3d299c9e-f749-4cb0-80a2-64e31aaaa816" by "_delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:01:39 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-3a7efa54-2b2d-4c83-a74d-042b99d2f16c tempest-VolumesExtendTest-719667368 None] Lock "cinder-quobyte-3d299c9e-f749-4cb0-80a2-64e31aaaa816" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:01:39 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-3a7efa54-2b2d-4c83-a74d-042b99d2f16c tempest-VolumesExtendTest-719667368 None] Deleting offline snapshot 3d299c9e-f749-4cb0-80a2-64e31aaaa816 of volume 6192d6b7-47e9-4f1d-af34-82c469fa4c3e {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:01:39 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-3a7efa54-2b2d-4c83-a74d-042b99d2f16c tempest-VolumesExtendTest-719667368 None] snapshot_file for this snap is: volume-6192d6b7-47e9-4f1d-af34-82c469fa4c3e.3d299c9e-f749-4cb0-80a2-64e31aaaa816 {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:01:39 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e6acfb-d573-4d26-9432-34b8dc4851c8]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:01:39 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-3a7efa54-2b2d-4c83-a74d-042b99d2f16c tempest-VolumesExtendTest-719667368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6192d6b7-47e9-4f1d-af34-82c469fa4c3e.3d299c9e-f749-4cb0-80a2-64e31aaaa816 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:39 devstack sudo[101925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6192d6b7-47e9-4f1d-af34-82c469fa4c3e.3d299c9e-f749-4cb0-80a2-64e31aaaa816 Jul 30 17:01:39 devstack sudo[101925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:39 devstack sudo[101923]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:39 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-b1f52ed4-74dc-4f5f-89b7-9f76388bc819 tempest-VolumeDependencyTests-369573918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-79cc055b-3167-4030-b319-0c29251c33bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-79cc055b-3167-4030-b319-0c29251c33bf.4ed1a05b-eebf-40e4-8edb-1c7a9238cd77 1G" returned: 0 in 0.484s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:39 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-b1f52ed4-74dc-4f5f-89b7-9f76388bc819 tempest-VolumeDependencyTests-369573918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79cc055b-3167-4030-b319-0c29251c33bf -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-79cc055b-3167-4030-b319-0c29251c33bf.4ed1a05b-eebf-40e4-8edb-1c7a9238cd77 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:39 devstack sudo[101925]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:39 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-3a7efa54-2b2d-4c83-a74d-042b99d2f16c tempest-VolumesExtendTest-719667368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6192d6b7-47e9-4f1d-af34-82c469fa4c3e.3d299c9e-f749-4cb0-80a2-64e31aaaa816" returned: 0 in 0.405s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:39 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-3a7efa54-2b2d-4c83-a74d-042b99d2f16c tempest-VolumesExtendTest-719667368 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6192d6b7-47e9-4f1d-af34-82c469fa4c3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:01:39 devstack sudo[101934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79cc055b-3167-4030-b319-0c29251c33bf -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-79cc055b-3167-4030-b319-0c29251c33bf.4ed1a05b-eebf-40e4-8edb-1c7a9238cd77 Jul 30 17:01:39 devstack sudo[101934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:39 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b9b7f97-aa3a-451c-bcaf-222ccf3c09a1]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:01:39 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-3a7efa54-2b2d-4c83-a74d-042b99d2f16c tempest-VolumesExtendTest-719667368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6192d6b7-47e9-4f1d-af34-82c469fa4c3e {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:39 devstack sudo[101936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6192d6b7-47e9-4f1d-af34-82c469fa4c3e Jul 30 17:01:39 devstack sudo[101936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:39 devstack sudo[101934]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:39 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-b1f52ed4-74dc-4f5f-89b7-9f76388bc819 tempest-VolumeDependencyTests-369573918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79cc055b-3167-4030-b319-0c29251c33bf -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-79cc055b-3167-4030-b319-0c29251c33bf.4ed1a05b-eebf-40e4-8edb-1c7a9238cd77" returned: 0 in 0.316s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:39 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-b1f52ed4-74dc-4f5f-89b7-9f76388bc819 tempest-VolumeDependencyTests-369573918 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-79cc055b-3167-4030-b319-0c29251c33bf.4ed1a05b-eebf-40e4-8edb-1c7a9238cd77 is being set with open permissions: ugo+rw Jul 30 17:01:39 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-b1f52ed4-74dc-4f5f-89b7-9f76388bc819 tempest-VolumeDependencyTests-369573918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-79cc055b-3167-4030-b319-0c29251c33bf.4ed1a05b-eebf-40e4-8edb-1c7a9238cd77 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:39 devstack sudo[101941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-79cc055b-3167-4030-b319-0c29251c33bf.4ed1a05b-eebf-40e4-8edb-1c7a9238cd77 Jul 30 17:01:39 devstack sudo[101941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:39 devstack sudo[101936]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:39 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-3a7efa54-2b2d-4c83-a74d-042b99d2f16c tempest-VolumesExtendTest-719667368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6192d6b7-47e9-4f1d-af34-82c469fa4c3e" returned: 0 in 0.402s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:39 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-3a7efa54-2b2d-4c83-a74d-042b99d2f16c tempest-VolumesExtendTest-719667368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6192d6b7-47e9-4f1d-af34-82c469fa4c3e.3d299c9e-f749-4cb0-80a2-64e31aaaa816 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:39 devstack sudo[101947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6192d6b7-47e9-4f1d-af34-82c469fa4c3e.3d299c9e-f749-4cb0-80a2-64e31aaaa816 Jul 30 17:01:39 devstack sudo[101947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:40 devstack sudo[101941]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:40 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-b1f52ed4-74dc-4f5f-89b7-9f76388bc819 tempest-VolumeDependencyTests-369573918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-79cc055b-3167-4030-b319-0c29251c33bf.4ed1a05b-eebf-40e4-8edb-1c7a9238cd77" returned: 0 in 0.295s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:40 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-b1f52ed4-74dc-4f5f-89b7-9f76388bc819 tempest-VolumeDependencyTests-369573918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-79cc055b-3167-4030-b319-0c29251c33bf.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:40 devstack sudo[101950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-79cc055b-3167-4030-b319-0c29251c33bf.info Jul 30 17:01:40 devstack sudo[101950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:40 devstack sudo[101947]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:40 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-3a7efa54-2b2d-4c83-a74d-042b99d2f16c tempest-VolumesExtendTest-719667368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6192d6b7-47e9-4f1d-af34-82c469fa4c3e.3d299c9e-f749-4cb0-80a2-64e31aaaa816" returned: 0 in 0.445s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:40 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-3a7efa54-2b2d-4c83-a74d-042b99d2f16c tempest-VolumesExtendTest-719667368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6192d6b7-47e9-4f1d-af34-82c469fa4c3e.3d299c9e-f749-4cb0-80a2-64e31aaaa816 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:40 devstack sudo[101957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6192d6b7-47e9-4f1d-af34-82c469fa4c3e.3d299c9e-f749-4cb0-80a2-64e31aaaa816 Jul 30 17:01:40 devstack sudo[101957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:40 devstack sudo[101950]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:40 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-b1f52ed4-74dc-4f5f-89b7-9f76388bc819 tempest-VolumeDependencyTests-369573918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-79cc055b-3167-4030-b319-0c29251c33bf.info" returned: 0 in 0.296s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:40 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-b1f52ed4-74dc-4f5f-89b7-9f76388bc819 tempest-VolumeDependencyTests-369573918 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-79cc055b-3167-4030-b319-0c29251c33bf.info is being set with open permissions: ugo+rw Jul 30 17:01:40 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-b1f52ed4-74dc-4f5f-89b7-9f76388bc819 tempest-VolumeDependencyTests-369573918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-79cc055b-3167-4030-b319-0c29251c33bf.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:40 devstack sudo[101959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-79cc055b-3167-4030-b319-0c29251c33bf.info Jul 30 17:01:40 devstack sudo[101959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:40 devstack sudo[101957]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:40 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-3a7efa54-2b2d-4c83-a74d-042b99d2f16c tempest-VolumesExtendTest-719667368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6192d6b7-47e9-4f1d-af34-82c469fa4c3e.3d299c9e-f749-4cb0-80a2-64e31aaaa816" returned: 0 in 0.266s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:40 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-3a7efa54-2b2d-4c83-a74d-042b99d2f16c tempest-VolumesExtendTest-719667368 None] Lock "cinder-quobyte-3d299c9e-f749-4cb0-80a2-64e31aaaa816" released by "_delete_snapshot" :: held 1.643s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:01:40 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-3a7efa54-2b2d-4c83-a74d-042b99d2f16c tempest-VolumesExtendTest-719667368 None] Lock "cinder-quobyte-6192d6b7-47e9-4f1d-af34-82c469fa4c3e" released by "delete_snapshot" :: held 1.670s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:01:40 devstack sudo[101959]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:40 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-b1f52ed4-74dc-4f5f-89b7-9f76388bc819 tempest-VolumeDependencyTests-369573918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-79cc055b-3167-4030-b319-0c29251c33bf.info" returned: 0 in 0.288s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:40 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-b1f52ed4-74dc-4f5f-89b7-9f76388bc819 tempest-VolumeDependencyTests-369573918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.187s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:01:40 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-b1f52ed4-74dc-4f5f-89b7-9f76388bc819 tempest-VolumeDependencyTests-369573918 None] Create snapshot completed successfully Jul 30 17:01:40 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-3a7efa54-2b2d-4c83-a74d-042b99d2f16c tempest-VolumesExtendTest-719667368 None] Created reservations ['435ff1a5-4a0a-41f0-9d9e-b4d766480871', '7dd36f1d-d92b-40dd-ab09-8a7857897a0c', '2c179742-b060-4c83-86ee-85c654551c44', '4a898d28-9b67-4c7a-aaa5-150f909fbec1'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:01:40 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-3a7efa54-2b2d-4c83-a74d-042b99d2f16c tempest-VolumesExtendTest-719667368 None] Delete snapshot completed successfully. Jul 30 17:01:40 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-3a7efa54-2b2d-4c83-a74d-042b99d2f16c tempest-VolumesExtendTest-719667368 None] Lock "cinder-3d299c9e-f749-4cb0-80a2-64e31aaaa816-delete_snapshot" released by "delete_snapshot" :: held 1.864s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:01:41 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-5ee4f71a-2a64-4e46-8f7c-191f78a91e87 tempest-VolumesExtendTest-719667368 None] Acquiring lock "cinder-6192d6b7-47e9-4f1d-af34-82c469fa4c3e-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:01:41 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-5ee4f71a-2a64-4e46-8f7c-191f78a91e87 tempest-VolumesExtendTest-719667368 None] Lock "cinder-6192d6b7-47e9-4f1d-af34-82c469fa4c3e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:01:41 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-5ee4f71a-2a64-4e46-8f7c-191f78a91e87 tempest-VolumesExtendTest-719667368 None] Acquiring lock "cinder-quobyte-6192d6b7-47e9-4f1d-af34-82c469fa4c3e" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:01:41 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-5ee4f71a-2a64-4e46-8f7c-191f78a91e87 tempest-VolumesExtendTest-719667368 None] Lock "cinder-quobyte-6192d6b7-47e9-4f1d-af34-82c469fa4c3e" acquired by "delete_volume" :: waited 0.023s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:01:41 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a58ae9-f560-4bd2-8c1f-2a519fc9957a]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:01:41 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-5ee4f71a-2a64-4e46-8f7c-191f78a91e87 tempest-VolumesExtendTest-719667368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6192d6b7-47e9-4f1d-af34-82c469fa4c3e {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:41 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6c72b20-ed74-4ee6-a175-488db9e133ab tempest-VolumeQuotasNegativeTestJSON-1806893286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:01:41 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a6c72b20-ed74-4ee6-a175-488db9e133ab tempest-VolumeQuotasNegativeTestJSON-1806893286 None] Flow 'volume_create_manager' (cec46bd5-1e0a-42a7-b219-fdf385236988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:01:41 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a6c72b20-ed74-4ee6-a175-488db9e133ab tempest-VolumeQuotasNegativeTestJSON-1806893286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca280c11-e5c7-42e7-afc8-6f5e11366020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:41 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a6c72b20-ed74-4ee6-a175-488db9e133ab tempest-VolumeQuotasNegativeTestJSON-1806893286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca280c11-e5c7-42e7-afc8-6f5e11366020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:01:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-847344237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6156795c-2b1e-48a2-afe1-d0442c69719e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9657084fff843cd8e272e8993933af1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:01:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:01:41Z,use_quota=True,user_id='ebea3736ed684cd995c91d81cbbba048',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:41 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a6c72b20-ed74-4ee6-a175-488db9e133ab tempest-VolumeQuotasNegativeTestJSON-1806893286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c532983-3e96-442b-8156-b59e2e92f212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:41 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a6c72b20-ed74-4ee6-a175-488db9e133ab tempest-VolumeQuotasNegativeTestJSON-1806893286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c532983-3e96-442b-8156-b59e2e92f212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:41 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a6c72b20-ed74-4ee6-a175-488db9e133ab tempest-VolumeQuotasNegativeTestJSON-1806893286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a9a1a69-3a33-4144-bcb4-e807ece93f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:41 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a6c72b20-ed74-4ee6-a175-488db9e133ab tempest-VolumeQuotasNegativeTestJSON-1806893286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a9a1a69-3a33-4144-bcb4-e807ece93f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6156795c-2b1e-48a2-afe1-d0442c69719e', 'volume_name': 'volume-6156795c-2b1e-48a2-afe1-d0442c69719e', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:41 devstack sudo[101963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6192d6b7-47e9-4f1d-af34-82c469fa4c3e Jul 30 17:01:41 devstack sudo[101963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:41 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a6c72b20-ed74-4ee6-a175-488db9e133ab tempest-VolumeQuotasNegativeTestJSON-1806893286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93fdafbe-bd49-4594-a9d3-09245067f8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:41 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a6c72b20-ed74-4ee6-a175-488db9e133ab tempest-VolumeQuotasNegativeTestJSON-1806893286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93fdafbe-bd49-4594-a9d3-09245067f8dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:41 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a6c72b20-ed74-4ee6-a175-488db9e133ab tempest-VolumeQuotasNegativeTestJSON-1806893286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e924c018-48f3-4d88-9856-055c5bef7f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:41 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-a6c72b20-ed74-4ee6-a175-488db9e133ab tempest-VolumeQuotasNegativeTestJSON-1806893286 None] Volume 6156795c-2b1e-48a2-afe1-d0442c69719e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6156795c-2b1e-48a2-afe1-d0442c69719e', 'volume_size': 1} Jul 30 17:01:41 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a6c72b20-ed74-4ee6-a175-488db9e133ab tempest-VolumeQuotasNegativeTestJSON-1806893286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:01:41 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a6c72b20-ed74-4ee6-a175-488db9e133ab tempest-VolumeQuotasNegativeTestJSON-1806893286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:01:41 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-a6c72b20-ed74-4ee6-a175-488db9e133ab tempest-VolumeQuotasNegativeTestJSON-1806893286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:01:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-847344237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6156795c-2b1e-48a2-afe1-d0442c69719e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9657084fff843cd8e272e8993933af1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:01:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:01:41Z,use_quota=True,user_id='ebea3736ed684cd995c91d81cbbba048',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:01:41 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-a6c72b20-ed74-4ee6-a175-488db9e133ab tempest-VolumeQuotasNegativeTestJSON-1806893286 None] Creating volume 6156795c-2b1e-48a2-afe1-d0442c69719e {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:01:41 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a6c72b20-ed74-4ee6-a175-488db9e133ab tempest-VolumeQuotasNegativeTestJSON-1806893286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:01:41 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a6c72b20-ed74-4ee6-a175-488db9e133ab tempest-VolumeQuotasNegativeTestJSON-1806893286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:01:41 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-a6c72b20-ed74-4ee6-a175-488db9e133ab tempest-VolumeQuotasNegativeTestJSON-1806893286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:01:41 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-a6c72b20-ed74-4ee6-a175-488db9e133ab tempest-VolumeQuotasNegativeTestJSON-1806893286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:01:41 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a6c72b20-ed74-4ee6-a175-488db9e133ab tempest-VolumeQuotasNegativeTestJSON-1806893286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:01:41 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-a6c72b20-ed74-4ee6-a175-488db9e133ab tempest-VolumeQuotasNegativeTestJSON-1806893286 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:01:41 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-a6c72b20-ed74-4ee6-a175-488db9e133ab tempest-VolumeQuotasNegativeTestJSON-1806893286 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:01:41 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a6c72b20-ed74-4ee6-a175-488db9e133ab tempest-VolumeQuotasNegativeTestJSON-1806893286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6156795c-2b1e-48a2-afe1-d0442c69719e 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:41 devstack sudo[101965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6156795c-2b1e-48a2-afe1-d0442c69719e 1073741824 Jul 30 17:01:41 devstack sudo[101965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:41 devstack sudo[101963]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:41 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-5ee4f71a-2a64-4e46-8f7c-191f78a91e87 tempest-VolumesExtendTest-719667368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6192d6b7-47e9-4f1d-af34-82c469fa4c3e" returned: 0 in 0.396s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:41 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-5ee4f71a-2a64-4e46-8f7c-191f78a91e87 tempest-VolumesExtendTest-719667368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6192d6b7-47e9-4f1d-af34-82c469fa4c3e {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:41 devstack sudo[101973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6192d6b7-47e9-4f1d-af34-82c469fa4c3e Jul 30 17:01:41 devstack sudo[101973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:41 devstack sudo[101965]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:41 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a6c72b20-ed74-4ee6-a175-488db9e133ab tempest-VolumeQuotasNegativeTestJSON-1806893286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6156795c-2b1e-48a2-afe1-d0442c69719e 1073741824" returned: 0 in 0.440s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:41 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a6c72b20-ed74-4ee6-a175-488db9e133ab tempest-VolumeQuotasNegativeTestJSON-1806893286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6156795c-2b1e-48a2-afe1-d0442c69719e {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:41 devstack sudo[101977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6156795c-2b1e-48a2-afe1-d0442c69719e Jul 30 17:01:41 devstack sudo[101977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:41 devstack sudo[101973]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:41 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-5ee4f71a-2a64-4e46-8f7c-191f78a91e87 tempest-VolumesExtendTest-719667368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6192d6b7-47e9-4f1d-af34-82c469fa4c3e" returned: 0 in 0.262s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:42 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-5ee4f71a-2a64-4e46-8f7c-191f78a91e87 tempest-VolumesExtendTest-719667368 None] Lock "cinder-quobyte-6192d6b7-47e9-4f1d-af34-82c469fa4c3e" released by "delete_volume" :: held 0.722s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:01:42 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-5ee4f71a-2a64-4e46-8f7c-191f78a91e87 tempest-VolumesExtendTest-719667368 None] Created reservations ['a17844d7-092d-44b8-bfbc-eb47eeda361c', 'bb387eb1-908c-49d6-82a9-883be790b2ae', 'a818dd9e-f25a-4eca-a708-01af125476b9', '5a6e2811-deb0-49cb-96fd-e358901a6a4d'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:01:42 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-5ee4f71a-2a64-4e46-8f7c-191f78a91e87 tempest-VolumesExtendTest-719667368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:01:42 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-5ee4f71a-2a64-4e46-8f7c-191f78a91e87 tempest-VolumesExtendTest-719667368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:01:42 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-5ee4f71a-2a64-4e46-8f7c-191f78a91e87 tempest-VolumesExtendTest-719667368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:01:42 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-5ee4f71a-2a64-4e46-8f7c-191f78a91e87 tempest-VolumesExtendTest-719667368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:01:42 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-5ee4f71a-2a64-4e46-8f7c-191f78a91e87 tempest-VolumesExtendTest-719667368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:01:42 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-5ee4f71a-2a64-4e46-8f7c-191f78a91e87 tempest-VolumesExtendTest-719667368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:42 devstack sudo[101979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:01:42 devstack sudo[101979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:42 devstack sudo[101977]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:42 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a6c72b20-ed74-4ee6-a175-488db9e133ab tempest-VolumeQuotasNegativeTestJSON-1806893286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6156795c-2b1e-48a2-afe1-d0442c69719e" returned: 0 in 0.315s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:42 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-a6c72b20-ed74-4ee6-a175-488db9e133ab tempest-VolumeQuotasNegativeTestJSON-1806893286 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:01:42 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a6c72b20-ed74-4ee6-a175-488db9e133ab tempest-VolumeQuotasNegativeTestJSON-1806893286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:01:42 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a6c72b20-ed74-4ee6-a175-488db9e133ab tempest-VolumeQuotasNegativeTestJSON-1806893286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e924c018-48f3-4d88-9856-055c5bef7f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6156795c-2b1e-48a2-afe1-d0442c69719e', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:42 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a6c72b20-ed74-4ee6-a175-488db9e133ab tempest-VolumeQuotasNegativeTestJSON-1806893286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb803bc3-b7cc-46a2-924c-367a180941b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:42 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-a6c72b20-ed74-4ee6-a175-488db9e133ab tempest-VolumeQuotasNegativeTestJSON-1806893286 None] Volume volume-6156795c-2b1e-48a2-afe1-d0442c69719e (6156795c-2b1e-48a2-afe1-d0442c69719e): created successfully Jul 30 17:01:42 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a6c72b20-ed74-4ee6-a175-488db9e133ab tempest-VolumeQuotasNegativeTestJSON-1806893286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb803bc3-b7cc-46a2-924c-367a180941b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:42 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a6c72b20-ed74-4ee6-a175-488db9e133ab tempest-VolumeQuotasNegativeTestJSON-1806893286 None] Flow 'volume_create_manager' (cec46bd5-1e0a-42a7-b219-fdf385236988) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:01:42 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-a593d26f-5854-486b-911c-eca5d9a93129 tempest-VolumeDependencyTests-369573918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:01:42 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-a6c72b20-ed74-4ee6-a175-488db9e133ab tempest-VolumeQuotasNegativeTestJSON-1806893286 None] Created volume successfully. Jul 30 17:01:42 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a593d26f-5854-486b-911c-eca5d9a93129 tempest-VolumeDependencyTests-369573918 None] Flow 'volume_create_manager' (824aea2f-22a0-4e31-931f-61c7d7b76797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:01:42 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a593d26f-5854-486b-911c-eca5d9a93129 tempest-VolumeDependencyTests-369573918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bd604d8-c5c9-4e1a-8a26-d0049e883dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:42 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a593d26f-5854-486b-911c-eca5d9a93129 tempest-VolumeDependencyTests-369573918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bd604d8-c5c9-4e1a-8a26-d0049e883dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:01:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-291039347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e96abdb-ed5f-4d28-9f72-c7162f03e1a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95d5e31e6bb34e1c8fc8f9eae59575a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:01:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4ed1a05b-eebf-40e4-8edb-1c7a9238cd77,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:01:42Z,use_quota=True,user_id='aafb83285de54a90aa85bf9dedd22bc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:42 devstack sudo[101979]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:42 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a593d26f-5854-486b-911c-eca5d9a93129 tempest-VolumeDependencyTests-369573918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01bcec6e-7bc7-40da-b5d1-a693ff7ff989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:42 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a593d26f-5854-486b-911c-eca5d9a93129 tempest-VolumeDependencyTests-369573918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01bcec6e-7bc7-40da-b5d1-a693ff7ff989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:42 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a593d26f-5854-486b-911c-eca5d9a93129 tempest-VolumeDependencyTests-369573918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (281956e3-424e-4258-b446-e888d37197a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:42 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a593d26f-5854-486b-911c-eca5d9a93129 tempest-VolumeDependencyTests-369573918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (281956e3-424e-4258-b446-e888d37197a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0e96abdb-ed5f-4d28-9f72-c7162f03e1a5', 'volume_name': 'volume-0e96abdb-ed5f-4d28-9f72-c7162f03e1a5', 'volume_size': 1, 'snapshot_id': '4ed1a05b-eebf-40e4-8edb-1c7a9238cd77'}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:42 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a593d26f-5854-486b-911c-eca5d9a93129 tempest-VolumeDependencyTests-369573918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (547e4ba2-f446-4e13-a2d3-f4527260a9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:42 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a593d26f-5854-486b-911c-eca5d9a93129 tempest-VolumeDependencyTests-369573918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (547e4ba2-f446-4e13-a2d3-f4527260a9d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:42 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a593d26f-5854-486b-911c-eca5d9a93129 tempest-VolumeDependencyTests-369573918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffedc79e-5ba7-41ce-ad86-de814a2a8243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:42 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-a593d26f-5854-486b-911c-eca5d9a93129 tempest-VolumeDependencyTests-369573918 None] Volume 0e96abdb-ed5f-4d28-9f72-c7162f03e1a5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0e96abdb-ed5f-4d28-9f72-c7162f03e1a5', 'volume_size': 1, 'snapshot_id': '4ed1a05b-eebf-40e4-8edb-1c7a9238cd77'} Jul 30 17:01:42 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-5ee4f71a-2a64-4e46-8f7c-191f78a91e87 tempest-VolumesExtendTest-719667368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.308s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:42 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-5ee4f71a-2a64-4e46-8f7c-191f78a91e87 tempest-VolumesExtendTest-719667368 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:01:42 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-5ee4f71a-2a64-4e46-8f7c-191f78a91e87 tempest-VolumesExtendTest-719667368 None] Deleted volume successfully. Jul 30 17:01:42 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a593d26f-5854-486b-911c-eca5d9a93129 tempest-VolumeDependencyTests-369573918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:01:42 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a593d26f-5854-486b-911c-eca5d9a93129 tempest-VolumeDependencyTests-369573918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:01:42 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-a593d26f-5854-486b-911c-eca5d9a93129 tempest-VolumeDependencyTests-369573918 None] Acquiring lock "cinder-quobyte-4ed1a05b-eebf-40e4-8edb-1c7a9238cd77-0e96abdb-ed5f-4d28-9f72-c7162f03e1a5" by "_create_volume_from_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:01:42 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-a593d26f-5854-486b-911c-eca5d9a93129 tempest-VolumeDependencyTests-369573918 None] Lock "cinder-quobyte-4ed1a05b-eebf-40e4-8edb-1c7a9238cd77-0e96abdb-ed5f-4d28-9f72-c7162f03e1a5" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:01:42 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-a593d26f-5854-486b-911c-eca5d9a93129 tempest-VolumeDependencyTests-369573918 None] Creating volume 0e96abdb-ed5f-4d28-9f72-c7162f03e1a5 from snapshot 4ed1a05b-eebf-40e4-8edb-1c7a9238cd77 {{(pid=88568) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 30 17:01:42 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a593d26f-5854-486b-911c-eca5d9a93129 tempest-VolumeDependencyTests-369573918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:01:42 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a593d26f-5854-486b-911c-eca5d9a93129 tempest-VolumeDependencyTests-369573918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:01:42 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-a593d26f-5854-486b-911c-eca5d9a93129 tempest-VolumeDependencyTests-369573918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:01:42 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-a593d26f-5854-486b-911c-eca5d9a93129 tempest-VolumeDependencyTests-369573918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:01:42 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a593d26f-5854-486b-911c-eca5d9a93129 tempest-VolumeDependencyTests-369573918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:01:42 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-a593d26f-5854-486b-911c-eca5d9a93129 tempest-VolumeDependencyTests-369573918 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:01:42 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-a593d26f-5854-486b-911c-eca5d9a93129 tempest-VolumeDependencyTests-369573918 None] Acquiring lock "cinder-quobyte-0e96abdb-ed5f-4d28-9f72-c7162f03e1a5" by "_copy_volume_from_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:01:42 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-5ee4f71a-2a64-4e46-8f7c-191f78a91e87 tempest-VolumesExtendTest-719667368 None] Lock "cinder-6192d6b7-47e9-4f1d-af34-82c469fa4c3e-delete_volume" released by "delete_volume" :: held 1.265s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:01:42 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-a593d26f-5854-486b-911c-eca5d9a93129 tempest-VolumeDependencyTests-369573918 None] Lock "cinder-quobyte-0e96abdb-ed5f-4d28-9f72-c7162f03e1a5" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:01:42 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-a593d26f-5854-486b-911c-eca5d9a93129 tempest-VolumeDependencyTests-369573918 None] snapshot: 4ed1a05b-eebf-40e4-8edb-1c7a9238cd77, volume: 0e96abdb-ed5f-4d28-9f72-c7162f03e1a5, {{(pid=88568) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 30 17:01:42 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a593d26f-5854-486b-911c-eca5d9a93129 tempest-VolumeDependencyTests-369573918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:01:42 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a593d26f-5854-486b-911c-eca5d9a93129 tempest-VolumeDependencyTests-369573918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:01:42 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-a593d26f-5854-486b-911c-eca5d9a93129 tempest-VolumeDependencyTests-369573918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:01:42 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-a593d26f-5854-486b-911c-eca5d9a93129 tempest-VolumeDependencyTests-369573918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:01:42 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a593d26f-5854-486b-911c-eca5d9a93129 tempest-VolumeDependencyTests-369573918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:01:42 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac5e16ed-afaf-4eee-9f5a-4d53cb9cf942]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:01:42 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a593d26f-5854-486b-911c-eca5d9a93129 tempest-VolumeDependencyTests-369573918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-79cc055b-3167-4030-b319-0c29251c33bf.4ed1a05b-eebf-40e4-8edb-1c7a9238cd77 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:42 devstack sudo[101983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-79cc055b-3167-4030-b319-0c29251c33bf.4ed1a05b-eebf-40e4-8edb-1c7a9238cd77 Jul 30 17:01:42 devstack sudo[101983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:42 devstack sudo[101983]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:42 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a593d26f-5854-486b-911c-eca5d9a93129 tempest-VolumeDependencyTests-369573918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-79cc055b-3167-4030-b319-0c29251c33bf.4ed1a05b-eebf-40e4-8edb-1c7a9238cd77" returned: 0 in 0.371s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:42 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-a593d26f-5854-486b-911c-eca5d9a93129 tempest-VolumeDependencyTests-369573918 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79cc055b-3167-4030-b319-0c29251c33bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:01:42 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e5cefba-96ba-45fc-8a8d-ed830f1241b0]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:01:42 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a593d26f-5854-486b-911c-eca5d9a93129 tempest-VolumeDependencyTests-369573918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-79cc055b-3167-4030-b319-0c29251c33bf {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:43 devstack sudo[101988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-79cc055b-3167-4030-b319-0c29251c33bf Jul 30 17:01:43 devstack sudo[101988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:43 devstack sudo[101988]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:43 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a593d26f-5854-486b-911c-eca5d9a93129 tempest-VolumeDependencyTests-369573918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-79cc055b-3167-4030-b319-0c29251c33bf" returned: 0 in 0.379s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:43 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-a593d26f-5854-486b-911c-eca5d9a93129 tempest-VolumeDependencyTests-369573918 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-79cc055b-3167-4030-b319-0c29251c33bf {{(pid=88568) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 30 17:01:43 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-a593d26f-5854-486b-911c-eca5d9a93129 tempest-VolumeDependencyTests-369573918 None] Creating direct copy from snapshot {{(pid=88568) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 30 17:01:43 devstack cinder-volume[88568]: DEBUG cinder.utils [None req-a593d26f-5854-486b-911c-eca5d9a93129 tempest-VolumeDependencyTests-369573918 None] Path /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0e96abdb-ed5f-4d28-9f72-c7162f03e1a5 not found in is_blk_device check {{(pid=88568) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 30 17:01:43 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a593d26f-5854-486b-911c-eca5d9a93129 tempest-VolumeDependencyTests-369573918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-79cc055b-3167-4030-b319-0c29251c33bf /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0e96abdb-ed5f-4d28-9f72-c7162f03e1a5 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:43 devstack sudo[101993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-79cc055b-3167-4030-b319-0c29251c33bf /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0e96abdb-ed5f-4d28-9f72-c7162f03e1a5 Jul 30 17:01:43 devstack sudo[101993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:45 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-2054363c-eebd-495b-aa6a-21a9943ca540 tempest-VolumeQuotasNegativeTestJSON-1806893286 None] Acquiring lock "cinder-6156795c-2b1e-48a2-afe1-d0442c69719e-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:01:45 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-2054363c-eebd-495b-aa6a-21a9943ca540 tempest-VolumeQuotasNegativeTestJSON-1806893286 None] Lock "cinder-6156795c-2b1e-48a2-afe1-d0442c69719e-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:01:45 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-2054363c-eebd-495b-aa6a-21a9943ca540 tempest-VolumeQuotasNegativeTestJSON-1806893286 None] Acquiring lock "cinder-quobyte-6156795c-2b1e-48a2-afe1-d0442c69719e" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:01:45 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-2054363c-eebd-495b-aa6a-21a9943ca540 tempest-VolumeQuotasNegativeTestJSON-1806893286 None] Lock "cinder-quobyte-6156795c-2b1e-48a2-afe1-d0442c69719e" acquired by "delete_volume" :: waited 0.042s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:01:45 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[83101d2c-23fb-4d71-8ee9-ed89d808b5a7]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:01:45 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2054363c-eebd-495b-aa6a-21a9943ca540 tempest-VolumeQuotasNegativeTestJSON-1806893286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6156795c-2b1e-48a2-afe1-d0442c69719e {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:45 devstack sudo[102007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6156795c-2b1e-48a2-afe1-d0442c69719e Jul 30 17:01:45 devstack sudo[102007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:46 devstack sudo[102007]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:46 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2054363c-eebd-495b-aa6a-21a9943ca540 tempest-VolumeQuotasNegativeTestJSON-1806893286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6156795c-2b1e-48a2-afe1-d0442c69719e" returned: 0 in 0.770s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:46 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2054363c-eebd-495b-aa6a-21a9943ca540 tempest-VolumeQuotasNegativeTestJSON-1806893286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6156795c-2b1e-48a2-afe1-d0442c69719e {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:46 devstack sudo[102012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6156795c-2b1e-48a2-afe1-d0442c69719e Jul 30 17:01:46 devstack sudo[102012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:46 devstack sudo[102012]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:46 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2054363c-eebd-495b-aa6a-21a9943ca540 tempest-VolumeQuotasNegativeTestJSON-1806893286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6156795c-2b1e-48a2-afe1-d0442c69719e" returned: 0 in 0.642s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:46 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-2054363c-eebd-495b-aa6a-21a9943ca540 tempest-VolumeQuotasNegativeTestJSON-1806893286 None] Lock "cinder-quobyte-6156795c-2b1e-48a2-afe1-d0442c69719e" released by "delete_volume" :: held 1.536s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:01:47 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-2054363c-eebd-495b-aa6a-21a9943ca540 tempest-VolumeQuotasNegativeTestJSON-1806893286 None] Created reservations ['02a817dd-f49d-4ff1-99c6-def2f6ebdd33', '20408f53-7c2f-4516-bc9d-42d92952c6b5', '1fe95ed4-64f4-4dc8-8c97-25d0f45b0a5e', '0fb3995c-c4b8-44b6-ac4c-d2205dca1458'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:01:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-2054363c-eebd-495b-aa6a-21a9943ca540 tempest-VolumeQuotasNegativeTestJSON-1806893286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:01:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-2054363c-eebd-495b-aa6a-21a9943ca540 tempest-VolumeQuotasNegativeTestJSON-1806893286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:01:47 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-2054363c-eebd-495b-aa6a-21a9943ca540 tempest-VolumeQuotasNegativeTestJSON-1806893286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:01:47 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-2054363c-eebd-495b-aa6a-21a9943ca540 tempest-VolumeQuotasNegativeTestJSON-1806893286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:01:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-2054363c-eebd-495b-aa6a-21a9943ca540 tempest-VolumeQuotasNegativeTestJSON-1806893286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:01:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2054363c-eebd-495b-aa6a-21a9943ca540 tempest-VolumeQuotasNegativeTestJSON-1806893286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:47 devstack sudo[102015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:01:47 devstack sudo[102015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:47 devstack sudo[102015]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2054363c-eebd-495b-aa6a-21a9943ca540 tempest-VolumeQuotasNegativeTestJSON-1806893286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.600s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:47 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-2054363c-eebd-495b-aa6a-21a9943ca540 tempest-VolumeQuotasNegativeTestJSON-1806893286 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:01:47 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-2054363c-eebd-495b-aa6a-21a9943ca540 tempest-VolumeQuotasNegativeTestJSON-1806893286 None] Deleted volume successfully. Jul 30 17:01:47 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-2054363c-eebd-495b-aa6a-21a9943ca540 tempest-VolumeQuotasNegativeTestJSON-1806893286 None] Lock "cinder-6156795c-2b1e-48a2-afe1-d0442c69719e-delete_volume" released by "delete_volume" :: held 2.679s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:01:49 devstack sudo[101993]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:49 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a593d26f-5854-486b-911c-eca5d9a93129 tempest-VolumeDependencyTests-369573918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-79cc055b-3167-4030-b319-0c29251c33bf /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0e96abdb-ed5f-4d28-9f72-c7162f03e1a5" returned: 0 in 5.730s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:49 devstack cinder-volume[88568]: DEBUG cinder.image.image_utils [None req-a593d26f-5854-486b-911c-eca5d9a93129 tempest-VolumeDependencyTests-369573918 None] Image conversion details: src /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-79cc055b-3167-4030-b319-0c29251c33bf, size 1024.00 MB, duration 5.73 sec, destination /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0e96abdb-ed5f-4d28-9f72-c7162f03e1a5 {{(pid=88568) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 17:01:49 devstack cinder-volume[88568]: INFO cinder.image.image_utils [None req-a593d26f-5854-486b-911c-eca5d9a93129 tempest-VolumeDependencyTests-369573918 None] Converted 1024.00 MB image at 178.67 MB/s Jul 30 17:01:49 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-a593d26f-5854-486b-911c-eca5d9a93129 tempest-VolumeDependencyTests-369573918 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0e96abdb-ed5f-4d28-9f72-c7162f03e1a5 is being set with open permissions: ugo+rw Jul 30 17:01:49 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a593d26f-5854-486b-911c-eca5d9a93129 tempest-VolumeDependencyTests-369573918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0e96abdb-ed5f-4d28-9f72-c7162f03e1a5 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:49 devstack sudo[102024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0e96abdb-ed5f-4d28-9f72-c7162f03e1a5 Jul 30 17:01:49 devstack sudo[102024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:49 devstack sudo[102024]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:49 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a593d26f-5854-486b-911c-eca5d9a93129 tempest-VolumeDependencyTests-369573918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0e96abdb-ed5f-4d28-9f72-c7162f03e1a5" returned: 0 in 0.281s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:49 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-a593d26f-5854-486b-911c-eca5d9a93129 tempest-VolumeDependencyTests-369573918 None] Lock "cinder-quobyte-0e96abdb-ed5f-4d28-9f72-c7162f03e1a5" released by "_copy_volume_from_snapshot" :: held 6.856s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:01:49 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-a593d26f-5854-486b-911c-eca5d9a93129 tempest-VolumeDependencyTests-369573918 None] Lock "cinder-quobyte-4ed1a05b-eebf-40e4-8edb-1c7a9238cd77-0e96abdb-ed5f-4d28-9f72-c7162f03e1a5" released by "_create_volume_from_snapshot" :: held 6.930s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:01:49 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a593d26f-5854-486b-911c-eca5d9a93129 tempest-VolumeDependencyTests-369573918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.950s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:01:49 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a593d26f-5854-486b-911c-eca5d9a93129 tempest-VolumeDependencyTests-369573918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffedc79e-5ba7-41ce-ad86-de814a2a8243) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e96abdb-ed5f-4d28-9f72-c7162f03e1a5', 'volume_size': 1, 'snapshot_id': '4ed1a05b-eebf-40e4-8edb-1c7a9238cd77'}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:49 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a593d26f-5854-486b-911c-eca5d9a93129 tempest-VolumeDependencyTests-369573918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2873336a-bf11-4d81-92e9-b97173b58a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:49 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-a593d26f-5854-486b-911c-eca5d9a93129 tempest-VolumeDependencyTests-369573918 None] Volume volume-0e96abdb-ed5f-4d28-9f72-c7162f03e1a5 (0e96abdb-ed5f-4d28-9f72-c7162f03e1a5): created successfully Jul 30 17:01:49 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a593d26f-5854-486b-911c-eca5d9a93129 tempest-VolumeDependencyTests-369573918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2873336a-bf11-4d81-92e9-b97173b58a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:49 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a593d26f-5854-486b-911c-eca5d9a93129 tempest-VolumeDependencyTests-369573918 None] Flow 'volume_create_manager' (824aea2f-22a0-4e31-931f-61c7d7b76797) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:01:49 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-a593d26f-5854-486b-911c-eca5d9a93129 tempest-VolumeDependencyTests-369573918 None] Created volume successfully. Jul 30 17:01:50 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-17f9d539-d7d2-4e77-ac01-56dcef7bfdf9 tempest-VolumeDependencyTests-369573918 None] Acquiring lock "cinder-4ed1a05b-eebf-40e4-8edb-1c7a9238cd77-delete_snapshot" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:01:50 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-17f9d539-d7d2-4e77-ac01-56dcef7bfdf9 tempest-VolumeDependencyTests-369573918 None] Lock "cinder-4ed1a05b-eebf-40e4-8edb-1c7a9238cd77-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:01:50 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-17f9d539-d7d2-4e77-ac01-56dcef7bfdf9 tempest-VolumeDependencyTests-369573918 None] Acquiring lock "cinder-quobyte-79cc055b-3167-4030-b319-0c29251c33bf" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:01:50 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-17f9d539-d7d2-4e77-ac01-56dcef7bfdf9 tempest-VolumeDependencyTests-369573918 None] Lock "cinder-quobyte-79cc055b-3167-4030-b319-0c29251c33bf" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:01:50 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-17f9d539-d7d2-4e77-ac01-56dcef7bfdf9 tempest-VolumeDependencyTests-369573918 None] Acquiring lock "cinder-quobyte-4ed1a05b-eebf-40e4-8edb-1c7a9238cd77" by "_delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:01:50 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-17f9d539-d7d2-4e77-ac01-56dcef7bfdf9 tempest-VolumeDependencyTests-369573918 None] Lock "cinder-quobyte-4ed1a05b-eebf-40e4-8edb-1c7a9238cd77" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:01:50 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-17f9d539-d7d2-4e77-ac01-56dcef7bfdf9 tempest-VolumeDependencyTests-369573918 None] Deleting offline snapshot 4ed1a05b-eebf-40e4-8edb-1c7a9238cd77 of volume 79cc055b-3167-4030-b319-0c29251c33bf {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:01:50 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-17f9d539-d7d2-4e77-ac01-56dcef7bfdf9 tempest-VolumeDependencyTests-369573918 None] snapshot_file for this snap is: volume-79cc055b-3167-4030-b319-0c29251c33bf.4ed1a05b-eebf-40e4-8edb-1c7a9238cd77 {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:01:50 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c82143-5d39-4422-847d-8e3f52c7b789]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:01:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-17f9d539-d7d2-4e77-ac01-56dcef7bfdf9 tempest-VolumeDependencyTests-369573918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-79cc055b-3167-4030-b319-0c29251c33bf.4ed1a05b-eebf-40e4-8edb-1c7a9238cd77 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:50 devstack sudo[102027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-79cc055b-3167-4030-b319-0c29251c33bf.4ed1a05b-eebf-40e4-8edb-1c7a9238cd77 Jul 30 17:01:50 devstack sudo[102027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:50 devstack sudo[102027]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-17f9d539-d7d2-4e77-ac01-56dcef7bfdf9 tempest-VolumeDependencyTests-369573918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-79cc055b-3167-4030-b319-0c29251c33bf.4ed1a05b-eebf-40e4-8edb-1c7a9238cd77" returned: 0 in 0.403s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:50 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-17f9d539-d7d2-4e77-ac01-56dcef7bfdf9 tempest-VolumeDependencyTests-369573918 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79cc055b-3167-4030-b319-0c29251c33bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:01:50 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c9702f-19f8-4411-ad25-8bf75ea615f3]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:01:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-17f9d539-d7d2-4e77-ac01-56dcef7bfdf9 tempest-VolumeDependencyTests-369573918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-79cc055b-3167-4030-b319-0c29251c33bf {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:50 devstack sudo[102033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-79cc055b-3167-4030-b319-0c29251c33bf Jul 30 17:01:50 devstack sudo[102033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:51 devstack sudo[102033]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-17f9d539-d7d2-4e77-ac01-56dcef7bfdf9 tempest-VolumeDependencyTests-369573918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-79cc055b-3167-4030-b319-0c29251c33bf" returned: 0 in 0.637s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-17f9d539-d7d2-4e77-ac01-56dcef7bfdf9 tempest-VolumeDependencyTests-369573918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-79cc055b-3167-4030-b319-0c29251c33bf.4ed1a05b-eebf-40e4-8edb-1c7a9238cd77 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:51 devstack sudo[102038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-79cc055b-3167-4030-b319-0c29251c33bf.4ed1a05b-eebf-40e4-8edb-1c7a9238cd77 Jul 30 17:01:51 devstack sudo[102038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:51 devstack cinder-volume[88568]: DEBUG dbcounter [-] [88568] Writing DB stats cinder:SELECT=173,cinder:UPDATE=232,cinder:INSERT=50,cinder:DELETE=23 {{(pid=88568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 17:01:51 devstack cinder-volume[88568]: DEBUG dbcounter [-] [88568] Writing DB stats cinder:UPDATE=202,cinder:SELECT=185,cinder:INSERT=67,cinder:DELETE=6 {{(pid=88568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 17:01:51 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-20c8ca43-2170-4ce8-97c0-2c2f43f8af34 tempest-VolumesListTestJSON-2113661308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:01:51 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-20c8ca43-2170-4ce8-97c0-2c2f43f8af34 tempest-VolumesListTestJSON-2113661308 None] Flow 'volume_create_manager' (464d46b1-60da-42dc-929f-722e39e614d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:01:51 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-20c8ca43-2170-4ce8-97c0-2c2f43f8af34 tempest-VolumesListTestJSON-2113661308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0509f94-8c2d-4747-ae77-065d92f1c2a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:51 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-20c8ca43-2170-4ce8-97c0-2c2f43f8af34 tempest-VolumesListTestJSON-2113661308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0509f94-8c2d-4747-ae77-065d92f1c2a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:01:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-230851382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=855b3b63-8756-4d73-bbe4-889bbfba28f0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e3c1201c41644dc8b01e7e82e676bdf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:01:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:01:51Z,use_quota=True,user_id='3a638479e80944a3894c5b1b9318bae4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:51 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-20c8ca43-2170-4ce8-97c0-2c2f43f8af34 tempest-VolumesListTestJSON-2113661308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c4f4e87-19e9-45fc-9153-7040cf34fd26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:51 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-20c8ca43-2170-4ce8-97c0-2c2f43f8af34 tempest-VolumesListTestJSON-2113661308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c4f4e87-19e9-45fc-9153-7040cf34fd26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:51 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-20c8ca43-2170-4ce8-97c0-2c2f43f8af34 tempest-VolumesListTestJSON-2113661308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43e48cfe-f7e3-49e8-b18e-e47e96d05aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:51 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-20c8ca43-2170-4ce8-97c0-2c2f43f8af34 tempest-VolumesListTestJSON-2113661308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43e48cfe-f7e3-49e8-b18e-e47e96d05aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '855b3b63-8756-4d73-bbe4-889bbfba28f0', 'volume_name': 'volume-855b3b63-8756-4d73-bbe4-889bbfba28f0', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:51 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-20c8ca43-2170-4ce8-97c0-2c2f43f8af34 tempest-VolumesListTestJSON-2113661308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83f0227c-118c-40b7-b809-a6550a593151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:51 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-20c8ca43-2170-4ce8-97c0-2c2f43f8af34 tempest-VolumesListTestJSON-2113661308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83f0227c-118c-40b7-b809-a6550a593151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:51 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-20c8ca43-2170-4ce8-97c0-2c2f43f8af34 tempest-VolumesListTestJSON-2113661308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f756bb8-261e-4506-856c-fbe2ee760fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:51 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-20c8ca43-2170-4ce8-97c0-2c2f43f8af34 tempest-VolumesListTestJSON-2113661308 None] Volume 855b3b63-8756-4d73-bbe4-889bbfba28f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-855b3b63-8756-4d73-bbe4-889bbfba28f0', 'volume_size': 1} Jul 30 17:01:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-20c8ca43-2170-4ce8-97c0-2c2f43f8af34 tempest-VolumesListTestJSON-2113661308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:01:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-20c8ca43-2170-4ce8-97c0-2c2f43f8af34 tempest-VolumesListTestJSON-2113661308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:01:51 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-20c8ca43-2170-4ce8-97c0-2c2f43f8af34 tempest-VolumesListTestJSON-2113661308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:01:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-230851382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=855b3b63-8756-4d73-bbe4-889bbfba28f0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e3c1201c41644dc8b01e7e82e676bdf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:01:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:01:51Z,use_quota=True,user_id='3a638479e80944a3894c5b1b9318bae4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:01:51 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-20c8ca43-2170-4ce8-97c0-2c2f43f8af34 tempest-VolumesListTestJSON-2113661308 None] Creating volume 855b3b63-8756-4d73-bbe4-889bbfba28f0 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:01:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-20c8ca43-2170-4ce8-97c0-2c2f43f8af34 tempest-VolumesListTestJSON-2113661308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:01:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-20c8ca43-2170-4ce8-97c0-2c2f43f8af34 tempest-VolumesListTestJSON-2113661308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:01:51 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-20c8ca43-2170-4ce8-97c0-2c2f43f8af34 tempest-VolumesListTestJSON-2113661308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:01:51 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-20c8ca43-2170-4ce8-97c0-2c2f43f8af34 tempest-VolumesListTestJSON-2113661308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:01:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-20c8ca43-2170-4ce8-97c0-2c2f43f8af34 tempest-VolumesListTestJSON-2113661308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:01:51 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-20c8ca43-2170-4ce8-97c0-2c2f43f8af34 tempest-VolumesListTestJSON-2113661308 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:01:51 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-20c8ca43-2170-4ce8-97c0-2c2f43f8af34 tempest-VolumesListTestJSON-2113661308 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:01:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-20c8ca43-2170-4ce8-97c0-2c2f43f8af34 tempest-VolumesListTestJSON-2113661308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-855b3b63-8756-4d73-bbe4-889bbfba28f0 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:51 devstack sudo[102040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-855b3b63-8756-4d73-bbe4-889bbfba28f0 1073741824 Jul 30 17:01:51 devstack sudo[102040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:51 devstack sudo[102038]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-17f9d539-d7d2-4e77-ac01-56dcef7bfdf9 tempest-VolumeDependencyTests-369573918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-79cc055b-3167-4030-b319-0c29251c33bf.4ed1a05b-eebf-40e4-8edb-1c7a9238cd77" returned: 0 in 0.438s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-17f9d539-d7d2-4e77-ac01-56dcef7bfdf9 tempest-VolumeDependencyTests-369573918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-79cc055b-3167-4030-b319-0c29251c33bf.4ed1a05b-eebf-40e4-8edb-1c7a9238cd77 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:51 devstack sudo[102048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-79cc055b-3167-4030-b319-0c29251c33bf.4ed1a05b-eebf-40e4-8edb-1c7a9238cd77 Jul 30 17:01:51 devstack sudo[102048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:52 devstack sudo[102040]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-20c8ca43-2170-4ce8-97c0-2c2f43f8af34 tempest-VolumesListTestJSON-2113661308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-855b3b63-8756-4d73-bbe4-889bbfba28f0 1073741824" returned: 0 in 0.479s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-20c8ca43-2170-4ce8-97c0-2c2f43f8af34 tempest-VolumesListTestJSON-2113661308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-855b3b63-8756-4d73-bbe4-889bbfba28f0 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:52 devstack sudo[102048]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-17f9d539-d7d2-4e77-ac01-56dcef7bfdf9 tempest-VolumeDependencyTests-369573918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-79cc055b-3167-4030-b319-0c29251c33bf.4ed1a05b-eebf-40e4-8edb-1c7a9238cd77" returned: 0 in 0.299s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:52 devstack sudo[102053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-855b3b63-8756-4d73-bbe4-889bbfba28f0 Jul 30 17:01:52 devstack sudo[102053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:52 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-17f9d539-d7d2-4e77-ac01-56dcef7bfdf9 tempest-VolumeDependencyTests-369573918 None] Lock "cinder-quobyte-4ed1a05b-eebf-40e4-8edb-1c7a9238cd77" released by "_delete_snapshot" :: held 1.937s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:01:52 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-17f9d539-d7d2-4e77-ac01-56dcef7bfdf9 tempest-VolumeDependencyTests-369573918 None] Lock "cinder-quobyte-79cc055b-3167-4030-b319-0c29251c33bf" released by "delete_snapshot" :: held 1.971s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:01:52 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-17f9d539-d7d2-4e77-ac01-56dcef7bfdf9 tempest-VolumeDependencyTests-369573918 None] Created reservations ['13b62867-bad1-4dd5-8058-e5724c1e3d8b', 'a2cb63d4-f366-4cc2-a3a4-977ac952e20f', 'ceab8976-cfd4-4f35-b465-d73b1b95b134', '98ffbb7b-17b7-433d-a008-d62ddf0f8cdb'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:01:52 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-17f9d539-d7d2-4e77-ac01-56dcef7bfdf9 tempest-VolumeDependencyTests-369573918 None] Delete snapshot completed successfully. Jul 30 17:01:52 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-17f9d539-d7d2-4e77-ac01-56dcef7bfdf9 tempest-VolumeDependencyTests-369573918 None] Lock "cinder-4ed1a05b-eebf-40e4-8edb-1c7a9238cd77-delete_snapshot" released by "delete_snapshot" :: held 2.130s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:01:52 devstack sudo[102053]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-20c8ca43-2170-4ce8-97c0-2c2f43f8af34 tempest-VolumesListTestJSON-2113661308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-855b3b63-8756-4d73-bbe4-889bbfba28f0" returned: 0 in 0.267s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:52 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-20c8ca43-2170-4ce8-97c0-2c2f43f8af34 tempest-VolumesListTestJSON-2113661308 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:01:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-20c8ca43-2170-4ce8-97c0-2c2f43f8af34 tempest-VolumesListTestJSON-2113661308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:01:52 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-20c8ca43-2170-4ce8-97c0-2c2f43f8af34 tempest-VolumesListTestJSON-2113661308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f756bb8-261e-4506-856c-fbe2ee760fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-855b3b63-8756-4d73-bbe4-889bbfba28f0', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:52 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-20c8ca43-2170-4ce8-97c0-2c2f43f8af34 tempest-VolumesListTestJSON-2113661308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68624c5f-6c0a-43da-a93b-3bc687af5486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:52 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-20c8ca43-2170-4ce8-97c0-2c2f43f8af34 tempest-VolumesListTestJSON-2113661308 None] Volume volume-855b3b63-8756-4d73-bbe4-889bbfba28f0 (855b3b63-8756-4d73-bbe4-889bbfba28f0): created successfully Jul 30 17:01:52 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-20c8ca43-2170-4ce8-97c0-2c2f43f8af34 tempest-VolumesListTestJSON-2113661308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68624c5f-6c0a-43da-a93b-3bc687af5486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:52 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-20c8ca43-2170-4ce8-97c0-2c2f43f8af34 tempest-VolumesListTestJSON-2113661308 None] Flow 'volume_create_manager' (464d46b1-60da-42dc-929f-722e39e614d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:01:52 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-20c8ca43-2170-4ce8-97c0-2c2f43f8af34 tempest-VolumesListTestJSON-2113661308 None] Created volume successfully. Jul 30 17:01:52 devstack cinder-volume[88568]: DEBUG oslo_service.periodic_task [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 17:01:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:01:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:01:52 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:01:52 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:01:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:01:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:52 devstack sudo[102056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:01:52 devstack sudo[102056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:52 devstack sudo[102056]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.250s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:52 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:01:52 devstack cinder-volume[88568]: DEBUG oslo_service.periodic_task [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Running periodic task VolumeManager._thread_info {{(pid=88568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 17:01:52 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] thread count: 28 {{(pid=88568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 17:01:52 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] thread info: [<_MainThread(MainThread, started 127406866608256)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 17:01:53 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-8608c6ce-aee1-4c77-a401-550f5a8713c3 tempest-VolumeDependencyTests-369573918 None] Acquiring lock "cinder-79cc055b-3167-4030-b319-0c29251c33bf-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:01:53 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-8608c6ce-aee1-4c77-a401-550f5a8713c3 tempest-VolumeDependencyTests-369573918 None] Lock "cinder-79cc055b-3167-4030-b319-0c29251c33bf-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:01:53 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-8608c6ce-aee1-4c77-a401-550f5a8713c3 tempest-VolumeDependencyTests-369573918 None] Acquiring lock "cinder-quobyte-79cc055b-3167-4030-b319-0c29251c33bf" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:01:53 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-8608c6ce-aee1-4c77-a401-550f5a8713c3 tempest-VolumeDependencyTests-369573918 None] Lock "cinder-quobyte-79cc055b-3167-4030-b319-0c29251c33bf" acquired by "delete_volume" :: waited 0.016s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:01:53 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[1899dc78-163b-45fc-86aa-bc0a4c8bebba]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:01:53 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8608c6ce-aee1-4c77-a401-550f5a8713c3 tempest-VolumeDependencyTests-369573918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-79cc055b-3167-4030-b319-0c29251c33bf {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:53 devstack sudo[102059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-79cc055b-3167-4030-b319-0c29251c33bf Jul 30 17:01:53 devstack sudo[102059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:54 devstack sudo[102059]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8608c6ce-aee1-4c77-a401-550f5a8713c3 tempest-VolumeDependencyTests-369573918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-79cc055b-3167-4030-b319-0c29251c33bf" returned: 0 in 0.425s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8608c6ce-aee1-4c77-a401-550f5a8713c3 tempest-VolumeDependencyTests-369573918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-79cc055b-3167-4030-b319-0c29251c33bf {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:54 devstack sudo[102064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-79cc055b-3167-4030-b319-0c29251c33bf Jul 30 17:01:54 devstack sudo[102064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:54 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-3783e56e-e6dd-41fc-aa06-c649afff6f2e tempest-VolumesListTestJSON-2113661308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:01:54 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-3783e56e-e6dd-41fc-aa06-c649afff6f2e tempest-VolumesListTestJSON-2113661308 None] Flow 'volume_create_manager' (718d0534-b5a0-461e-99a8-9406834f99fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:01:54 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-3783e56e-e6dd-41fc-aa06-c649afff6f2e tempest-VolumesListTestJSON-2113661308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (104baed7-9825-4855-9014-fed9b64757d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:54 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-3783e56e-e6dd-41fc-aa06-c649afff6f2e tempest-VolumesListTestJSON-2113661308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (104baed7-9825-4855-9014-fed9b64757d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:01:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1151870377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba05f27d-7bbc-4450-b596-5191af25125d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e3c1201c41644dc8b01e7e82e676bdf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:01:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:01:54Z,use_quota=True,user_id='3a638479e80944a3894c5b1b9318bae4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:54 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-3783e56e-e6dd-41fc-aa06-c649afff6f2e tempest-VolumesListTestJSON-2113661308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7205fc72-3fdb-4fa8-85d4-3884c494d058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:54 devstack sudo[102064]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:54 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-3783e56e-e6dd-41fc-aa06-c649afff6f2e tempest-VolumesListTestJSON-2113661308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7205fc72-3fdb-4fa8-85d4-3884c494d058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:54 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-3783e56e-e6dd-41fc-aa06-c649afff6f2e tempest-VolumesListTestJSON-2113661308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fe1e6df-2f63-4686-9547-955c4e64d828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:54 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-3783e56e-e6dd-41fc-aa06-c649afff6f2e tempest-VolumesListTestJSON-2113661308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fe1e6df-2f63-4686-9547-955c4e64d828) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba05f27d-7bbc-4450-b596-5191af25125d', 'volume_name': 'volume-ba05f27d-7bbc-4450-b596-5191af25125d', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:54 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-3783e56e-e6dd-41fc-aa06-c649afff6f2e tempest-VolumesListTestJSON-2113661308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ba4c8c2-f5c6-46df-9a8e-a53a5cd8408b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:54 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-3783e56e-e6dd-41fc-aa06-c649afff6f2e tempest-VolumesListTestJSON-2113661308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ba4c8c2-f5c6-46df-9a8e-a53a5cd8408b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:54 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-3783e56e-e6dd-41fc-aa06-c649afff6f2e tempest-VolumesListTestJSON-2113661308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beae4b24-f5d5-4694-be29-a2f2fa6507e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:54 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-3783e56e-e6dd-41fc-aa06-c649afff6f2e tempest-VolumesListTestJSON-2113661308 None] Volume ba05f27d-7bbc-4450-b596-5191af25125d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba05f27d-7bbc-4450-b596-5191af25125d', 'volume_size': 1} Jul 30 17:01:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-3783e56e-e6dd-41fc-aa06-c649afff6f2e tempest-VolumesListTestJSON-2113661308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:01:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-3783e56e-e6dd-41fc-aa06-c649afff6f2e tempest-VolumesListTestJSON-2113661308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:01:54 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-3783e56e-e6dd-41fc-aa06-c649afff6f2e tempest-VolumesListTestJSON-2113661308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:01:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1151870377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba05f27d-7bbc-4450-b596-5191af25125d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e3c1201c41644dc8b01e7e82e676bdf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:01:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:01:54Z,use_quota=True,user_id='3a638479e80944a3894c5b1b9318bae4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:01:54 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-3783e56e-e6dd-41fc-aa06-c649afff6f2e tempest-VolumesListTestJSON-2113661308 None] Creating volume ba05f27d-7bbc-4450-b596-5191af25125d {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:01:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-3783e56e-e6dd-41fc-aa06-c649afff6f2e tempest-VolumesListTestJSON-2113661308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:01:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-3783e56e-e6dd-41fc-aa06-c649afff6f2e tempest-VolumesListTestJSON-2113661308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:01:54 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-3783e56e-e6dd-41fc-aa06-c649afff6f2e tempest-VolumesListTestJSON-2113661308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:01:54 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-3783e56e-e6dd-41fc-aa06-c649afff6f2e tempest-VolumesListTestJSON-2113661308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:01:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-3783e56e-e6dd-41fc-aa06-c649afff6f2e tempest-VolumesListTestJSON-2113661308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:01:54 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-3783e56e-e6dd-41fc-aa06-c649afff6f2e tempest-VolumesListTestJSON-2113661308 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:01:54 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-3783e56e-e6dd-41fc-aa06-c649afff6f2e tempest-VolumesListTestJSON-2113661308 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:01:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-3783e56e-e6dd-41fc-aa06-c649afff6f2e tempest-VolumesListTestJSON-2113661308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-ba05f27d-7bbc-4450-b596-5191af25125d 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8608c6ce-aee1-4c77-a401-550f5a8713c3 tempest-VolumeDependencyTests-369573918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-79cc055b-3167-4030-b319-0c29251c33bf" returned: 0 in 0.329s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:54 devstack sudo[102067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-ba05f27d-7bbc-4450-b596-5191af25125d 1073741824 Jul 30 17:01:54 devstack sudo[102067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:54 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-8608c6ce-aee1-4c77-a401-550f5a8713c3 tempest-VolumeDependencyTests-369573918 None] Lock "cinder-quobyte-79cc055b-3167-4030-b319-0c29251c33bf" released by "delete_volume" :: held 0.831s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:01:54 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-8608c6ce-aee1-4c77-a401-550f5a8713c3 tempest-VolumeDependencyTests-369573918 None] Created reservations ['678c216e-7d7d-4900-b7ef-a21b6f6f7f8c', 'b3537b59-c464-4ace-908a-bae5cb252aff', '96f47673-9a50-4f72-82a9-c3963407934f', 'b779afbd-6250-47d5-b3ce-a517cc3d557b'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:01:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-8608c6ce-aee1-4c77-a401-550f5a8713c3 tempest-VolumeDependencyTests-369573918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:01:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-8608c6ce-aee1-4c77-a401-550f5a8713c3 tempest-VolumeDependencyTests-369573918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:01:54 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-8608c6ce-aee1-4c77-a401-550f5a8713c3 tempest-VolumeDependencyTests-369573918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:01:54 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-8608c6ce-aee1-4c77-a401-550f5a8713c3 tempest-VolumeDependencyTests-369573918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:01:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-8608c6ce-aee1-4c77-a401-550f5a8713c3 tempest-VolumeDependencyTests-369573918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:01:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8608c6ce-aee1-4c77-a401-550f5a8713c3 tempest-VolumeDependencyTests-369573918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:54 devstack sudo[102069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:01:54 devstack sudo[102069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:54 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-a280da55-8dbd-4320-930f-39fe62dba13b tempest-VolumeDependencyTests-369573918 None] Acquiring lock "cinder-0e96abdb-ed5f-4d28-9f72-c7162f03e1a5-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:01:54 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-a280da55-8dbd-4320-930f-39fe62dba13b tempest-VolumeDependencyTests-369573918 None] Lock "cinder-0e96abdb-ed5f-4d28-9f72-c7162f03e1a5-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:01:54 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-a280da55-8dbd-4320-930f-39fe62dba13b tempest-VolumeDependencyTests-369573918 None] Acquiring lock "cinder-quobyte-0e96abdb-ed5f-4d28-9f72-c7162f03e1a5" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:01:54 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-a280da55-8dbd-4320-930f-39fe62dba13b tempest-VolumeDependencyTests-369573918 None] Lock "cinder-quobyte-0e96abdb-ed5f-4d28-9f72-c7162f03e1a5" acquired by "delete_volume" :: waited 0.018s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:01:54 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[99835fbe-bfd4-49c6-877c-f11a54cc3441]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:01:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a280da55-8dbd-4320-930f-39fe62dba13b tempest-VolumeDependencyTests-369573918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0e96abdb-ed5f-4d28-9f72-c7162f03e1a5 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:54 devstack sudo[102069]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8608c6ce-aee1-4c77-a401-550f5a8713c3 tempest-VolumeDependencyTests-369573918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.408s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:54 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-8608c6ce-aee1-4c77-a401-550f5a8713c3 tempest-VolumeDependencyTests-369573918 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:01:54 devstack sudo[102067]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:54 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-8608c6ce-aee1-4c77-a401-550f5a8713c3 tempest-VolumeDependencyTests-369573918 None] Deleted volume successfully. Jul 30 17:01:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-3783e56e-e6dd-41fc-aa06-c649afff6f2e tempest-VolumesListTestJSON-2113661308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-ba05f27d-7bbc-4450-b596-5191af25125d 1073741824" returned: 0 in 0.602s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:54 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-8608c6ce-aee1-4c77-a401-550f5a8713c3 tempest-VolumeDependencyTests-369573918 None] Lock "cinder-79cc055b-3167-4030-b319-0c29251c33bf-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:01:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-3783e56e-e6dd-41fc-aa06-c649afff6f2e tempest-VolumesListTestJSON-2113661308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-ba05f27d-7bbc-4450-b596-5191af25125d {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:54 devstack sudo[102077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0e96abdb-ed5f-4d28-9f72-c7162f03e1a5 Jul 30 17:01:54 devstack sudo[102077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:55 devstack sudo[102078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-ba05f27d-7bbc-4450-b596-5191af25125d Jul 30 17:01:55 devstack sudo[102078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:55 devstack sudo[102078]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-3783e56e-e6dd-41fc-aa06-c649afff6f2e tempest-VolumesListTestJSON-2113661308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-ba05f27d-7bbc-4450-b596-5191af25125d" returned: 0 in 0.282s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:55 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-3783e56e-e6dd-41fc-aa06-c649afff6f2e tempest-VolumesListTestJSON-2113661308 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:01:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-3783e56e-e6dd-41fc-aa06-c649afff6f2e tempest-VolumesListTestJSON-2113661308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:01:55 devstack sudo[102077]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:55 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-3783e56e-e6dd-41fc-aa06-c649afff6f2e tempest-VolumesListTestJSON-2113661308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beae4b24-f5d5-4694-be29-a2f2fa6507e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba05f27d-7bbc-4450-b596-5191af25125d', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:55 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-3783e56e-e6dd-41fc-aa06-c649afff6f2e tempest-VolumesListTestJSON-2113661308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3927cab0-38c4-4305-8264-2de79b30bb17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a280da55-8dbd-4320-930f-39fe62dba13b tempest-VolumeDependencyTests-369573918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0e96abdb-ed5f-4d28-9f72-c7162f03e1a5" returned: 0 in 0.430s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a280da55-8dbd-4320-930f-39fe62dba13b tempest-VolumeDependencyTests-369573918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0e96abdb-ed5f-4d28-9f72-c7162f03e1a5 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:55 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-3783e56e-e6dd-41fc-aa06-c649afff6f2e tempest-VolumesListTestJSON-2113661308 None] Volume volume-ba05f27d-7bbc-4450-b596-5191af25125d (ba05f27d-7bbc-4450-b596-5191af25125d): created successfully Jul 30 17:01:55 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-3783e56e-e6dd-41fc-aa06-c649afff6f2e tempest-VolumesListTestJSON-2113661308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3927cab0-38c4-4305-8264-2de79b30bb17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:55 devstack sudo[102085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0e96abdb-ed5f-4d28-9f72-c7162f03e1a5 Jul 30 17:01:55 devstack sudo[102085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:55 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-3783e56e-e6dd-41fc-aa06-c649afff6f2e tempest-VolumesListTestJSON-2113661308 None] Flow 'volume_create_manager' (718d0534-b5a0-461e-99a8-9406834f99fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:01:55 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-3783e56e-e6dd-41fc-aa06-c649afff6f2e tempest-VolumesListTestJSON-2113661308 None] Created volume successfully. Jul 30 17:01:55 devstack sudo[102085]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a280da55-8dbd-4320-930f-39fe62dba13b tempest-VolumeDependencyTests-369573918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0e96abdb-ed5f-4d28-9f72-c7162f03e1a5" returned: 0 in 0.240s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:55 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-a280da55-8dbd-4320-930f-39fe62dba13b tempest-VolumeDependencyTests-369573918 None] Lock "cinder-quobyte-0e96abdb-ed5f-4d28-9f72-c7162f03e1a5" released by "delete_volume" :: held 0.719s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:01:55 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-a280da55-8dbd-4320-930f-39fe62dba13b tempest-VolumeDependencyTests-369573918 None] Created reservations ['61a9151d-c241-4a7f-bf41-003689c58fbe', '00c4dc01-8856-4995-a130-079e45b0bb1b', 'e7b9f70f-254e-4a1d-9f47-3c453f12ca96', 'b1df4424-454d-4de1-a965-6dac21346d12'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:01:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a280da55-8dbd-4320-930f-39fe62dba13b tempest-VolumeDependencyTests-369573918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:01:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a280da55-8dbd-4320-930f-39fe62dba13b tempest-VolumeDependencyTests-369573918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:01:55 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-a280da55-8dbd-4320-930f-39fe62dba13b tempest-VolumeDependencyTests-369573918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:01:55 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-a280da55-8dbd-4320-930f-39fe62dba13b tempest-VolumeDependencyTests-369573918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:01:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a280da55-8dbd-4320-930f-39fe62dba13b tempest-VolumeDependencyTests-369573918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:01:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a280da55-8dbd-4320-930f-39fe62dba13b tempest-VolumeDependencyTests-369573918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:55 devstack sudo[102088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:01:55 devstack sudo[102088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:55 devstack sudo[102088]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a280da55-8dbd-4320-930f-39fe62dba13b tempest-VolumeDependencyTests-369573918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.269s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:55 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-a280da55-8dbd-4320-930f-39fe62dba13b tempest-VolumeDependencyTests-369573918 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:01:55 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-a280da55-8dbd-4320-930f-39fe62dba13b tempest-VolumeDependencyTests-369573918 None] Deleted volume successfully. Jul 30 17:01:55 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-a280da55-8dbd-4320-930f-39fe62dba13b tempest-VolumeDependencyTests-369573918 None] Lock "cinder-0e96abdb-ed5f-4d28-9f72-c7162f03e1a5-delete_volume" released by "delete_volume" :: held 1.235s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:01:56 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-4da66110-9671-4554-959a-247962f20919 tempest-VolumesListTestJSON-2113661308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:01:56 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4da66110-9671-4554-959a-247962f20919 tempest-VolumesListTestJSON-2113661308 None] Flow 'volume_create_manager' (60d709ad-cd16-42f1-9519-c4aa1871df6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:01:56 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4da66110-9671-4554-959a-247962f20919 tempest-VolumesListTestJSON-2113661308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (480f6713-e045-4573-938b-508cb1f9d566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:56 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4da66110-9671-4554-959a-247962f20919 tempest-VolumesListTestJSON-2113661308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (480f6713-e045-4573-938b-508cb1f9d566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:01:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-385029034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e6d85e5-cc8e-446a-addb-53995d9451e0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e3c1201c41644dc8b01e7e82e676bdf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:01:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:01:57Z,use_quota=True,user_id='3a638479e80944a3894c5b1b9318bae4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:57 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4da66110-9671-4554-959a-247962f20919 tempest-VolumesListTestJSON-2113661308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd38de22-1a66-4b91-bffc-1a53e9c58821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:57 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4da66110-9671-4554-959a-247962f20919 tempest-VolumesListTestJSON-2113661308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd38de22-1a66-4b91-bffc-1a53e9c58821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:57 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4da66110-9671-4554-959a-247962f20919 tempest-VolumesListTestJSON-2113661308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84f41238-f07a-49a4-9672-18b10902017a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:57 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4da66110-9671-4554-959a-247962f20919 tempest-VolumesListTestJSON-2113661308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84f41238-f07a-49a4-9672-18b10902017a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e6d85e5-cc8e-446a-addb-53995d9451e0', 'volume_name': 'volume-0e6d85e5-cc8e-446a-addb-53995d9451e0', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:57 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4da66110-9671-4554-959a-247962f20919 tempest-VolumesListTestJSON-2113661308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d322ee9b-548d-4aea-be72-fca125546af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:57 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4da66110-9671-4554-959a-247962f20919 tempest-VolumesListTestJSON-2113661308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d322ee9b-548d-4aea-be72-fca125546af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:57 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4da66110-9671-4554-959a-247962f20919 tempest-VolumesListTestJSON-2113661308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7e45542-dd81-4359-9a9c-a4cc43f5b51f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:57 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-4da66110-9671-4554-959a-247962f20919 tempest-VolumesListTestJSON-2113661308 None] Volume 0e6d85e5-cc8e-446a-addb-53995d9451e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e6d85e5-cc8e-446a-addb-53995d9451e0', 'volume_size': 1} Jul 30 17:01:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-4da66110-9671-4554-959a-247962f20919 tempest-VolumesListTestJSON-2113661308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:01:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-4da66110-9671-4554-959a-247962f20919 tempest-VolumesListTestJSON-2113661308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:01:57 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-4da66110-9671-4554-959a-247962f20919 tempest-VolumesListTestJSON-2113661308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:01:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-385029034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e6d85e5-cc8e-446a-addb-53995d9451e0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e3c1201c41644dc8b01e7e82e676bdf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:01:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:01:57Z,use_quota=True,user_id='3a638479e80944a3894c5b1b9318bae4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:01:57 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-4da66110-9671-4554-959a-247962f20919 tempest-VolumesListTestJSON-2113661308 None] Creating volume 0e6d85e5-cc8e-446a-addb-53995d9451e0 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:01:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-4da66110-9671-4554-959a-247962f20919 tempest-VolumesListTestJSON-2113661308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:01:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-4da66110-9671-4554-959a-247962f20919 tempest-VolumesListTestJSON-2113661308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:01:57 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-4da66110-9671-4554-959a-247962f20919 tempest-VolumesListTestJSON-2113661308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:01:57 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-4da66110-9671-4554-959a-247962f20919 tempest-VolumesListTestJSON-2113661308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:01:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-4da66110-9671-4554-959a-247962f20919 tempest-VolumesListTestJSON-2113661308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:01:57 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-4da66110-9671-4554-959a-247962f20919 tempest-VolumesListTestJSON-2113661308 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:01:57 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-4da66110-9671-4554-959a-247962f20919 tempest-VolumesListTestJSON-2113661308 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:01:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-4da66110-9671-4554-959a-247962f20919 tempest-VolumesListTestJSON-2113661308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0e6d85e5-cc8e-446a-addb-53995d9451e0 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:57 devstack sudo[102091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0e6d85e5-cc8e-446a-addb-53995d9451e0 1073741824 Jul 30 17:01:57 devstack sudo[102091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:57 devstack sudo[102091]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-4da66110-9671-4554-959a-247962f20919 tempest-VolumesListTestJSON-2113661308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0e6d85e5-cc8e-446a-addb-53995d9451e0 1073741824" returned: 0 in 0.552s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-4da66110-9671-4554-959a-247962f20919 tempest-VolumesListTestJSON-2113661308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0e6d85e5-cc8e-446a-addb-53995d9451e0 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:57 devstack sudo[102097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0e6d85e5-cc8e-446a-addb-53995d9451e0 Jul 30 17:01:57 devstack sudo[102097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:57 devstack sudo[102097]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-4da66110-9671-4554-959a-247962f20919 tempest-VolumesListTestJSON-2113661308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0e6d85e5-cc8e-446a-addb-53995d9451e0" returned: 0 in 0.284s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:57 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-4da66110-9671-4554-959a-247962f20919 tempest-VolumesListTestJSON-2113661308 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:01:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-4da66110-9671-4554-959a-247962f20919 tempest-VolumesListTestJSON-2113661308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:01:57 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4da66110-9671-4554-959a-247962f20919 tempest-VolumesListTestJSON-2113661308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7e45542-dd81-4359-9a9c-a4cc43f5b51f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e6d85e5-cc8e-446a-addb-53995d9451e0', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:57 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4da66110-9671-4554-959a-247962f20919 tempest-VolumesListTestJSON-2113661308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e00327f-6e6e-4040-b25e-5d97c506e036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:57 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-4da66110-9671-4554-959a-247962f20919 tempest-VolumesListTestJSON-2113661308 None] Volume volume-0e6d85e5-cc8e-446a-addb-53995d9451e0 (0e6d85e5-cc8e-446a-addb-53995d9451e0): created successfully Jul 30 17:01:57 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4da66110-9671-4554-959a-247962f20919 tempest-VolumesListTestJSON-2113661308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e00327f-6e6e-4040-b25e-5d97c506e036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:58 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4da66110-9671-4554-959a-247962f20919 tempest-VolumesListTestJSON-2113661308 None] Flow 'volume_create_manager' (60d709ad-cd16-42f1-9519-c4aa1871df6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:01:58 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-4da66110-9671-4554-959a-247962f20919 tempest-VolumesListTestJSON-2113661308 None] Created volume successfully. Jul 30 17:02:01 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-92b1ad46-3a33-4d70-ae26-2b3b3723d1e3 tempest-VolumesListTestJSON-2113661308 None] Acquiring lock "cinder-0e6d85e5-cc8e-446a-addb-53995d9451e0-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:02:01 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-92b1ad46-3a33-4d70-ae26-2b3b3723d1e3 tempest-VolumesListTestJSON-2113661308 None] Lock "cinder-0e6d85e5-cc8e-446a-addb-53995d9451e0-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:02:01 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-92b1ad46-3a33-4d70-ae26-2b3b3723d1e3 tempest-VolumesListTestJSON-2113661308 None] Acquiring lock "cinder-quobyte-0e6d85e5-cc8e-446a-addb-53995d9451e0" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:02:01 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-92b1ad46-3a33-4d70-ae26-2b3b3723d1e3 tempest-VolumesListTestJSON-2113661308 None] Lock "cinder-quobyte-0e6d85e5-cc8e-446a-addb-53995d9451e0" acquired by "delete_volume" :: waited 0.017s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:02:01 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5201b2a-13c3-4ac0-ae42-8c1fc9f8f582]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:02:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-92b1ad46-3a33-4d70-ae26-2b3b3723d1e3 tempest-VolumesListTestJSON-2113661308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0e6d85e5-cc8e-446a-addb-53995d9451e0 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:01 devstack sudo[102101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0e6d85e5-cc8e-446a-addb-53995d9451e0 Jul 30 17:02:01 devstack sudo[102101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:01 devstack sudo[102101]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-92b1ad46-3a33-4d70-ae26-2b3b3723d1e3 tempest-VolumesListTestJSON-2113661308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0e6d85e5-cc8e-446a-addb-53995d9451e0" returned: 0 in 0.430s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-92b1ad46-3a33-4d70-ae26-2b3b3723d1e3 tempest-VolumesListTestJSON-2113661308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0e6d85e5-cc8e-446a-addb-53995d9451e0 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:01 devstack sudo[102106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0e6d85e5-cc8e-446a-addb-53995d9451e0 Jul 30 17:02:01 devstack sudo[102106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:02 devstack sudo[102106]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-92b1ad46-3a33-4d70-ae26-2b3b3723d1e3 tempest-VolumesListTestJSON-2113661308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0e6d85e5-cc8e-446a-addb-53995d9451e0" returned: 0 in 0.268s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:02 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-92b1ad46-3a33-4d70-ae26-2b3b3723d1e3 tempest-VolumesListTestJSON-2113661308 None] Lock "cinder-quobyte-0e6d85e5-cc8e-446a-addb-53995d9451e0" released by "delete_volume" :: held 0.762s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:02:02 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-92b1ad46-3a33-4d70-ae26-2b3b3723d1e3 tempest-VolumesListTestJSON-2113661308 None] Created reservations ['719bcd4b-cb2a-4e0e-92a0-14342dd1421b', '0b94e84f-1347-423b-acdd-b48f94bbd8a6', '4e2924c7-04af-45c5-86d5-fd0f95b511d7', 'd75bad66-e89e-4c7e-b7f8-a1e0ce70ae01'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:02:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-92b1ad46-3a33-4d70-ae26-2b3b3723d1e3 tempest-VolumesListTestJSON-2113661308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-92b1ad46-3a33-4d70-ae26-2b3b3723d1e3 tempest-VolumesListTestJSON-2113661308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:02 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-92b1ad46-3a33-4d70-ae26-2b3b3723d1e3 tempest-VolumesListTestJSON-2113661308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:02:02 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-92b1ad46-3a33-4d70-ae26-2b3b3723d1e3 tempest-VolumesListTestJSON-2113661308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:02:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-92b1ad46-3a33-4d70-ae26-2b3b3723d1e3 tempest-VolumesListTestJSON-2113661308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-92b1ad46-3a33-4d70-ae26-2b3b3723d1e3 tempest-VolumesListTestJSON-2113661308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:02 devstack sudo[102109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:02:02 devstack sudo[102109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:02 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-fa6f69a2-7659-47bc-8eed-03989eea9089 tempest-VolumesListTestJSON-2113661308 None] Acquiring lock "cinder-ba05f27d-7bbc-4450-b596-5191af25125d-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:02:02 devstack sudo[102109]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-92b1ad46-3a33-4d70-ae26-2b3b3723d1e3 tempest-VolumesListTestJSON-2113661308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.324s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:02 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-92b1ad46-3a33-4d70-ae26-2b3b3723d1e3 tempest-VolumesListTestJSON-2113661308 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:02:02 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-92b1ad46-3a33-4d70-ae26-2b3b3723d1e3 tempest-VolumesListTestJSON-2113661308 None] Deleted volume successfully. Jul 30 17:02:02 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-fa6f69a2-7659-47bc-8eed-03989eea9089 tempest-VolumesListTestJSON-2113661308 None] Lock "cinder-ba05f27d-7bbc-4450-b596-5191af25125d-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:02:02 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-92b1ad46-3a33-4d70-ae26-2b3b3723d1e3 tempest-VolumesListTestJSON-2113661308 None] Lock "cinder-0e6d85e5-cc8e-446a-addb-53995d9451e0-delete_volume" released by "delete_volume" :: held 1.352s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:02:02 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-fa6f69a2-7659-47bc-8eed-03989eea9089 tempest-VolumesListTestJSON-2113661308 None] Acquiring lock "cinder-quobyte-ba05f27d-7bbc-4450-b596-5191af25125d" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:02:02 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-fa6f69a2-7659-47bc-8eed-03989eea9089 tempest-VolumesListTestJSON-2113661308 None] Lock "cinder-quobyte-ba05f27d-7bbc-4450-b596-5191af25125d" acquired by "delete_volume" :: waited 0.025s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:02:02 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[76196a4d-837e-4932-901e-9ccd22b45762]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:02:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fa6f69a2-7659-47bc-8eed-03989eea9089 tempest-VolumesListTestJSON-2113661308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-ba05f27d-7bbc-4450-b596-5191af25125d {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:02 devstack sudo[102112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-ba05f27d-7bbc-4450-b596-5191af25125d Jul 30 17:02:02 devstack sudo[102112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:03 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-105dacdf-2a4d-44b5-92b8-afe523ce0f13 tempest-VolumeImageDependencyTests-1233841286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:02:03 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-105dacdf-2a4d-44b5-92b8-afe523ce0f13 tempest-VolumeImageDependencyTests-1233841286 None] Flow 'volume_create_manager' (64336c4e-687b-4908-a9e1-4193c062f32b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:02:03 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-105dacdf-2a4d-44b5-92b8-afe523ce0f13 tempest-VolumeImageDependencyTests-1233841286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49821944-7e19-4dbf-9306-9f31761f6a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:03 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-105dacdf-2a4d-44b5-92b8-afe523ce0f13 tempest-VolumeImageDependencyTests-1233841286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49821944-7e19-4dbf-9306-9f31761f6a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:02:03Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9211858c-00de-4454-b1de-a54da7c0ccb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddb3b4da04b44fecabca5efa2c70dabb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:02:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:02:03Z,use_quota=True,user_id='a48f55ad210a4089bb718a1ebf42f6c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:03 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-105dacdf-2a4d-44b5-92b8-afe523ce0f13 tempest-VolumeImageDependencyTests-1233841286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1868e5d6-bf1e-429d-bdf0-b064e9f1972a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:03 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-105dacdf-2a4d-44b5-92b8-afe523ce0f13 tempest-VolumeImageDependencyTests-1233841286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1868e5d6-bf1e-429d-bdf0-b064e9f1972a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:03 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-105dacdf-2a4d-44b5-92b8-afe523ce0f13 tempest-VolumeImageDependencyTests-1233841286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0089dc72-28f5-471c-b367-aac091b07959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:03 devstack cinder-volume[88568]: DEBUG cinder.image.glance [None req-105dacdf-2a4d-44b5-92b8-afe523ce0f13 tempest-VolumeImageDependencyTests-1233841286 None] Creating Keystone auth plugin from conf {{(pid=88568) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 30 17:02:03 devstack sudo[102112]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fa6f69a2-7659-47bc-8eed-03989eea9089 tempest-VolumesListTestJSON-2113661308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-ba05f27d-7bbc-4450-b596-5191af25125d" returned: 0 in 0.422s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fa6f69a2-7659-47bc-8eed-03989eea9089 tempest-VolumesListTestJSON-2113661308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-ba05f27d-7bbc-4450-b596-5191af25125d {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:03 devstack sudo[102117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-ba05f27d-7bbc-4450-b596-5191af25125d Jul 30 17:02:03 devstack sudo[102117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:03 devstack sudo[102117]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fa6f69a2-7659-47bc-8eed-03989eea9089 tempest-VolumesListTestJSON-2113661308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-ba05f27d-7bbc-4450-b596-5191af25125d" returned: 0 in 0.289s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:03 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-fa6f69a2-7659-47bc-8eed-03989eea9089 tempest-VolumesListTestJSON-2113661308 None] Lock "cinder-quobyte-ba05f27d-7bbc-4450-b596-5191af25125d" released by "delete_volume" :: held 0.777s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:02:03 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-fa6f69a2-7659-47bc-8eed-03989eea9089 tempest-VolumesListTestJSON-2113661308 None] Created reservations ['472ff16d-c481-4146-91b3-c62738a9638f', '3c658dba-7252-4e12-a8cf-8fda555f060e', '0749b450-b265-4f1f-999d-afc8e17b4010', 'b5f1a3d5-abf2-46b4-8277-a0b73f1c128f'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:02:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-fa6f69a2-7659-47bc-8eed-03989eea9089 tempest-VolumesListTestJSON-2113661308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-fa6f69a2-7659-47bc-8eed-03989eea9089 tempest-VolumesListTestJSON-2113661308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:03 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-fa6f69a2-7659-47bc-8eed-03989eea9089 tempest-VolumesListTestJSON-2113661308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:02:03 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-fa6f69a2-7659-47bc-8eed-03989eea9089 tempest-VolumesListTestJSON-2113661308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:02:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-fa6f69a2-7659-47bc-8eed-03989eea9089 tempest-VolumesListTestJSON-2113661308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fa6f69a2-7659-47bc-8eed-03989eea9089 tempest-VolumesListTestJSON-2113661308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:03 devstack sudo[102120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:02:03 devstack sudo[102120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:03 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-105dacdf-2a4d-44b5-92b8-afe523ce0f13 tempest-VolumeImageDependencyTests-1233841286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0089dc72-28f5-471c-b367-aac091b07959) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9211858c-00de-4454-b1de-a54da7c0ccb3', 'volume_name': 'volume-9211858c-00de-4454-b1de-a54da7c0ccb3', 'volume_size': 1, 'image_id': '465739ee-a714-4e5a-a68b-83e5ecd36df5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/465739ee-a714-4e5a-a68b-83e5ecd36df5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3b0c885fd4506bd0a5c7197ccb12442b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ddb3b4da04b44fecabca5efa2c70dabb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '423d26b8495a62a00d74157872e06c7f48fc20c6c1c7eaabbe8d00ab72ec916507ad1a1df818b66677d09086ad15fb44de335bfb23d2d67a584add171e86a857', 'id': '465739ee-a714-4e5a-a68b-83e5ecd36df5', 'created_at': datetime.datetime(2026, 7, 30, 15, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 15, 2, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/465739ee-a714-4e5a-a68b-83e5ecd36df5/file', 'properties': {}}, 'image_service': }' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:03 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-105dacdf-2a4d-44b5-92b8-afe523ce0f13 tempest-VolumeImageDependencyTests-1233841286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (824b90d5-3652-4cd3-aaa2-f6e834a4dd5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:03 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-105dacdf-2a4d-44b5-92b8-afe523ce0f13 tempest-VolumeImageDependencyTests-1233841286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (824b90d5-3652-4cd3-aaa2-f6e834a4dd5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:03 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-105dacdf-2a4d-44b5-92b8-afe523ce0f13 tempest-VolumeImageDependencyTests-1233841286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07e427d8-8165-4e3e-a941-078262aab049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:03 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-105dacdf-2a4d-44b5-92b8-afe523ce0f13 tempest-VolumeImageDependencyTests-1233841286 None] Volume 9211858c-00de-4454-b1de-a54da7c0ccb3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9211858c-00de-4454-b1de-a54da7c0ccb3', 'volume_size': 1, 'image_id': '465739ee-a714-4e5a-a68b-83e5ecd36df5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/465739ee-a714-4e5a-a68b-83e5ecd36df5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3b0c885fd4506bd0a5c7197ccb12442b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ddb3b4da04b44fecabca5efa2c70dabb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '423d26b8495a62a00d74157872e06c7f48fc20c6c1c7eaabbe8d00ab72ec916507ad1a1df818b66677d09086ad15fb44de335bfb23d2d67a584add171e86a857', 'id': '465739ee-a714-4e5a-a68b-83e5ecd36df5', 'created_at': datetime.datetime(2026, 7, 30, 15, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 15, 2, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/465739ee-a714-4e5a-a68b-83e5ecd36df5/file', 'properties': {}}, 'image_service': } Jul 30 17:02:03 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-105dacdf-2a4d-44b5-92b8-afe523ce0f13 tempest-VolumeImageDependencyTests-1233841286 None] Trying to clone 9211858c-00de-4454-b1de-a54da7c0ccb3 from image 465739ee-a714-4e5a-a68b-83e5ecd36df5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/465739ee-a714-4e5a-a68b-83e5ecd36df5', 'metadata': {}}]). {{(pid=88568) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 30 17:02:03 devstack cinder-volume[88568]: DEBUG cinder.image.image_utils [None req-105dacdf-2a4d-44b5-92b8-afe523ce0f13 tempest-VolumeImageDependencyTests-1233841286 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_465739ee-a714-4e5a-a68b-83e5ecd36df5__q1dy2phdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88568) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 30 17:02:03 devstack cinder-volume[88568]: INFO cinder.image.image_utils [None req-105dacdf-2a4d-44b5-92b8-afe523ce0f13 tempest-VolumeImageDependencyTests-1233841286 None] Image download 0.00 MB at 0.00 MB/s Jul 30 17:02:04 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-64e86d25-7b46-4dbd-a924-11fbdbc81941 tempest-VolumesListTestJSON-2113661308 None] Acquiring lock "cinder-855b3b63-8756-4d73-bbe4-889bbfba28f0-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:02:04 devstack sudo[102120]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:04 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-64e86d25-7b46-4dbd-a924-11fbdbc81941 tempest-VolumesListTestJSON-2113661308 None] Lock "cinder-855b3b63-8756-4d73-bbe4-889bbfba28f0-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:02:04 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c869803-d40d-4d70-bd73-0ceb212ebc08]: (4, 'raw') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:02:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-105dacdf-2a4d-44b5-92b8-afe523ce0f13 tempest-VolumeImageDependencyTests-1233841286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_465739ee-a714-4e5a-a68b-83e5ecd36df5__q1dy2phdevstack@QuobyteHD {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fa6f69a2-7659-47bc-8eed-03989eea9089 tempest-VolumesListTestJSON-2113661308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.305s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:04 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-fa6f69a2-7659-47bc-8eed-03989eea9089 tempest-VolumesListTestJSON-2113661308 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:02:04 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-fa6f69a2-7659-47bc-8eed-03989eea9089 tempest-VolumesListTestJSON-2113661308 None] Deleted volume successfully. Jul 30 17:02:04 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-fa6f69a2-7659-47bc-8eed-03989eea9089 tempest-VolumesListTestJSON-2113661308 None] Lock "cinder-ba05f27d-7bbc-4450-b596-5191af25125d-delete_volume" released by "delete_volume" :: held 1.380s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:02:04 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-64e86d25-7b46-4dbd-a924-11fbdbc81941 tempest-VolumesListTestJSON-2113661308 None] Acquiring lock "cinder-quobyte-855b3b63-8756-4d73-bbe4-889bbfba28f0" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:02:04 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-64e86d25-7b46-4dbd-a924-11fbdbc81941 tempest-VolumesListTestJSON-2113661308 None] Lock "cinder-quobyte-855b3b63-8756-4d73-bbe4-889bbfba28f0" acquired by "delete_volume" :: waited 0.019s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:02:04 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[86965be0-62dc-4828-a218-241cdee5ca07]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:02:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-64e86d25-7b46-4dbd-a924-11fbdbc81941 tempest-VolumesListTestJSON-2113661308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-855b3b63-8756-4d73-bbe4-889bbfba28f0 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:04 devstack sudo[102123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_465739ee-a714-4e5a-a68b-83e5ecd36df5__q1dy2phdevstack@QuobyteHD Jul 30 17:02:04 devstack sudo[102123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:04 devstack sudo[102125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-855b3b63-8756-4d73-bbe4-889bbfba28f0 Jul 30 17:02:04 devstack sudo[102125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:04 devstack sudo[102123]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-105dacdf-2a4d-44b5-92b8-afe523ce0f13 tempest-VolumeImageDependencyTests-1233841286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_465739ee-a714-4e5a-a68b-83e5ecd36df5__q1dy2phdevstack@QuobyteHD" returned: 0 in 0.366s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-105dacdf-2a4d-44b5-92b8-afe523ce0f13 tempest-VolumeImageDependencyTests-1233841286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_465739ee-a714-4e5a-a68b-83e5ecd36df5__q1dy2phdevstack@QuobyteHD {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:04 devstack sudo[102129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_465739ee-a714-4e5a-a68b-83e5ecd36df5__q1dy2phdevstack@QuobyteHD Jul 30 17:02:04 devstack sudo[102129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:04 devstack sudo[102125]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-64e86d25-7b46-4dbd-a924-11fbdbc81941 tempest-VolumesListTestJSON-2113661308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-855b3b63-8756-4d73-bbe4-889bbfba28f0" returned: 0 in 0.470s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-64e86d25-7b46-4dbd-a924-11fbdbc81941 tempest-VolumesListTestJSON-2113661308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-855b3b63-8756-4d73-bbe4-889bbfba28f0 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:04 devstack sudo[102134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-855b3b63-8756-4d73-bbe4-889bbfba28f0 Jul 30 17:02:04 devstack sudo[102134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:04 devstack sudo[102129]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-105dacdf-2a4d-44b5-92b8-afe523ce0f13 tempest-VolumeImageDependencyTests-1233841286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_465739ee-a714-4e5a-a68b-83e5ecd36df5__q1dy2phdevstack@QuobyteHD" returned: 1 in 0.367s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-105dacdf-2a4d-44b5-92b8-afe523ce0f13 tempest-VolumeImageDependencyTests-1233841286 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_465739ee-a714-4e5a-a68b-83e5ecd36df5__q1dy2phdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 17:02:04 devstack cinder-volume[88568]: DEBUG cinder.image.image_utils [None req-105dacdf-2a4d-44b5-92b8-afe523ce0f13 tempest-VolumeImageDependencyTests-1233841286 None] Temporary image 465739ee-a714-4e5a-a68b-83e5ecd36df5 is fetched for user a48f55ad210a4089bb718a1ebf42f6c1. {{(pid=88568) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 30 17:02:04 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[443c37e2-315a-4474-bfb8-c35d78b72341]: (4, 'raw') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:02:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-105dacdf-2a4d-44b5-92b8-afe523ce0f13 tempest-VolumeImageDependencyTests-1233841286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_465739ee-a714-4e5a-a68b-83e5ecd36df5__q1dy2phdevstack@QuobyteHD {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:05 devstack sudo[102140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_465739ee-a714-4e5a-a68b-83e5ecd36df5__q1dy2phdevstack@QuobyteHD Jul 30 17:02:05 devstack sudo[102140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:05 devstack sudo[102134]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:05 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-64e86d25-7b46-4dbd-a924-11fbdbc81941 tempest-VolumesListTestJSON-2113661308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-855b3b63-8756-4d73-bbe4-889bbfba28f0" returned: 0 in 0.361s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:05 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-64e86d25-7b46-4dbd-a924-11fbdbc81941 tempest-VolumesListTestJSON-2113661308 None] Lock "cinder-quobyte-855b3b63-8756-4d73-bbe4-889bbfba28f0" released by "delete_volume" :: held 0.884s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:02:05 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-64e86d25-7b46-4dbd-a924-11fbdbc81941 tempest-VolumesListTestJSON-2113661308 None] Created reservations ['99356aab-6538-4e9f-b6da-94246999bd76', 'c662cefc-1ccf-4a29-91ad-3f9a92b41842', '4ef93798-87a6-4e96-8e3a-3d3d43511f72', '4a0d37b7-e69b-485a-a811-584a4e2bb6ca'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:02:05 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-64e86d25-7b46-4dbd-a924-11fbdbc81941 tempest-VolumesListTestJSON-2113661308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:05 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-64e86d25-7b46-4dbd-a924-11fbdbc81941 tempest-VolumesListTestJSON-2113661308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:05 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-64e86d25-7b46-4dbd-a924-11fbdbc81941 tempest-VolumesListTestJSON-2113661308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:02:05 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-64e86d25-7b46-4dbd-a924-11fbdbc81941 tempest-VolumesListTestJSON-2113661308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:02:05 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-64e86d25-7b46-4dbd-a924-11fbdbc81941 tempest-VolumesListTestJSON-2113661308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:05 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-64e86d25-7b46-4dbd-a924-11fbdbc81941 tempest-VolumesListTestJSON-2113661308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:05 devstack sudo[102143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:02:05 devstack sudo[102143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:05 devstack sudo[102140]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:05 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-105dacdf-2a4d-44b5-92b8-afe523ce0f13 tempest-VolumeImageDependencyTests-1233841286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_465739ee-a714-4e5a-a68b-83e5ecd36df5__q1dy2phdevstack@QuobyteHD" returned: 0 in 0.413s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:05 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-105dacdf-2a4d-44b5-92b8-afe523ce0f13 tempest-VolumeImageDependencyTests-1233841286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_465739ee-a714-4e5a-a68b-83e5ecd36df5__q1dy2phdevstack@QuobyteHD {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:05 devstack sudo[102147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_465739ee-a714-4e5a-a68b-83e5ecd36df5__q1dy2phdevstack@QuobyteHD Jul 30 17:02:05 devstack sudo[102147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:05 devstack sudo[102143]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:05 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-64e86d25-7b46-4dbd-a924-11fbdbc81941 tempest-VolumesListTestJSON-2113661308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.259s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:05 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-64e86d25-7b46-4dbd-a924-11fbdbc81941 tempest-VolumesListTestJSON-2113661308 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:02:05 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-64e86d25-7b46-4dbd-a924-11fbdbc81941 tempest-VolumesListTestJSON-2113661308 None] Deleted volume successfully. Jul 30 17:02:05 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-64e86d25-7b46-4dbd-a924-11fbdbc81941 tempest-VolumesListTestJSON-2113661308 None] Lock "cinder-855b3b63-8756-4d73-bbe4-889bbfba28f0-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:02:05 devstack sudo[102147]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:05 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-105dacdf-2a4d-44b5-92b8-afe523ce0f13 tempest-VolumeImageDependencyTests-1233841286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_465739ee-a714-4e5a-a68b-83e5ecd36df5__q1dy2phdevstack@QuobyteHD" returned: 1 in 0.381s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:05 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-105dacdf-2a4d-44b5-92b8-afe523ce0f13 tempest-VolumeImageDependencyTests-1233841286 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_465739ee-a714-4e5a-a68b-83e5ecd36df5__q1dy2phdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 17:02:05 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-105dacdf-2a4d-44b5-92b8-afe523ce0f13 tempest-VolumeImageDependencyTests-1233841286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:05 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-105dacdf-2a4d-44b5-92b8-afe523ce0f13 tempest-VolumeImageDependencyTests-1233841286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:05 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-105dacdf-2a4d-44b5-92b8-afe523ce0f13 tempest-VolumeImageDependencyTests-1233841286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:02:03Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9211858c-00de-4454-b1de-a54da7c0ccb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddb3b4da04b44fecabca5efa2c70dabb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:02:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:02:03Z,use_quota=True,user_id='a48f55ad210a4089bb718a1ebf42f6c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:02:05 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-105dacdf-2a4d-44b5-92b8-afe523ce0f13 tempest-VolumeImageDependencyTests-1233841286 None] Creating volume 9211858c-00de-4454-b1de-a54da7c0ccb3 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:02:05 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-105dacdf-2a4d-44b5-92b8-afe523ce0f13 tempest-VolumeImageDependencyTests-1233841286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:05 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-105dacdf-2a4d-44b5-92b8-afe523ce0f13 tempest-VolumeImageDependencyTests-1233841286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:05 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-105dacdf-2a4d-44b5-92b8-afe523ce0f13 tempest-VolumeImageDependencyTests-1233841286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:02:05 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-105dacdf-2a4d-44b5-92b8-afe523ce0f13 tempest-VolumeImageDependencyTests-1233841286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:02:05 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-105dacdf-2a4d-44b5-92b8-afe523ce0f13 tempest-VolumeImageDependencyTests-1233841286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:05 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-105dacdf-2a4d-44b5-92b8-afe523ce0f13 tempest-VolumeImageDependencyTests-1233841286 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:02:05 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-105dacdf-2a4d-44b5-92b8-afe523ce0f13 tempest-VolumeImageDependencyTests-1233841286 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:02:05 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-105dacdf-2a4d-44b5-92b8-afe523ce0f13 tempest-VolumeImageDependencyTests-1233841286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9211858c-00de-4454-b1de-a54da7c0ccb3 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:05 devstack sudo[102153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9211858c-00de-4454-b1de-a54da7c0ccb3 1073741824 Jul 30 17:02:05 devstack sudo[102153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:05 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa58adb0-569a-42db-ab3e-ef2bcf3b777d tempest-VolumesMetadataTest-1864091350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:02:05 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-aa58adb0-569a-42db-ab3e-ef2bcf3b777d tempest-VolumesMetadataTest-1864091350 None] Flow 'volume_create_manager' (579e9fbb-699c-48b1-9ce7-25b446b9255d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:02:05 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-aa58adb0-569a-42db-ab3e-ef2bcf3b777d tempest-VolumesMetadataTest-1864091350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e81adb1-71ae-4af1-b13d-ccebbbe47db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:05 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-aa58adb0-569a-42db-ab3e-ef2bcf3b777d tempest-VolumesMetadataTest-1864091350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e81adb1-71ae-4af1-b13d-ccebbbe47db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:02:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1913076154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02082db1-c4a5-4313-944f-66d5b9aa9d8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b62f2fd5f8424dd0aa0af75918a4510d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:02:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:02:06Z,use_quota=True,user_id='e1b08d9454194dfca3964da7ea8619c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:05 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-aa58adb0-569a-42db-ab3e-ef2bcf3b777d tempest-VolumesMetadataTest-1864091350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81bf9234-af7a-4614-8144-77ee8aff264d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:05 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-aa58adb0-569a-42db-ab3e-ef2bcf3b777d tempest-VolumesMetadataTest-1864091350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81bf9234-af7a-4614-8144-77ee8aff264d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:05 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-aa58adb0-569a-42db-ab3e-ef2bcf3b777d tempest-VolumesMetadataTest-1864091350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83869274-dfdb-4746-88c1-8ebcf7696618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:05 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-aa58adb0-569a-42db-ab3e-ef2bcf3b777d tempest-VolumesMetadataTest-1864091350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83869274-dfdb-4746-88c1-8ebcf7696618) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02082db1-c4a5-4313-944f-66d5b9aa9d8a', 'volume_name': 'volume-02082db1-c4a5-4313-944f-66d5b9aa9d8a', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:05 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-aa58adb0-569a-42db-ab3e-ef2bcf3b777d tempest-VolumesMetadataTest-1864091350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a6e988d-8e95-42ba-a10c-ffbf4d6987f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:05 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-aa58adb0-569a-42db-ab3e-ef2bcf3b777d tempest-VolumesMetadataTest-1864091350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a6e988d-8e95-42ba-a10c-ffbf4d6987f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:05 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-aa58adb0-569a-42db-ab3e-ef2bcf3b777d tempest-VolumesMetadataTest-1864091350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b006b717-aa84-4ad0-a5b2-f51c1b5bec5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:05 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-aa58adb0-569a-42db-ab3e-ef2bcf3b777d tempest-VolumesMetadataTest-1864091350 None] Volume 02082db1-c4a5-4313-944f-66d5b9aa9d8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02082db1-c4a5-4313-944f-66d5b9aa9d8a', 'volume_size': 1} Jul 30 17:02:05 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-aa58adb0-569a-42db-ab3e-ef2bcf3b777d tempest-VolumesMetadataTest-1864091350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:06 devstack sudo[102153]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-105dacdf-2a4d-44b5-92b8-afe523ce0f13 tempest-VolumeImageDependencyTests-1233841286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9211858c-00de-4454-b1de-a54da7c0ccb3 1073741824" returned: 0 in 0.455s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-105dacdf-2a4d-44b5-92b8-afe523ce0f13 tempest-VolumeImageDependencyTests-1233841286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9211858c-00de-4454-b1de-a54da7c0ccb3 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:06 devstack sudo[102158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9211858c-00de-4454-b1de-a54da7c0ccb3 Jul 30 17:02:06 devstack sudo[102158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:06 devstack sudo[102158]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-105dacdf-2a4d-44b5-92b8-afe523ce0f13 tempest-VolumeImageDependencyTests-1233841286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9211858c-00de-4454-b1de-a54da7c0ccb3" returned: 0 in 0.249s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:06 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-105dacdf-2a4d-44b5-92b8-afe523ce0f13 tempest-VolumeImageDependencyTests-1233841286 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:02:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-105dacdf-2a4d-44b5-92b8-afe523ce0f13 tempest-VolumeImageDependencyTests-1233841286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-aa58adb0-569a-42db-ab3e-ef2bcf3b777d tempest-VolumesMetadataTest-1864091350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.599s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:06 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-aa58adb0-569a-42db-ab3e-ef2bcf3b777d tempest-VolumesMetadataTest-1864091350 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:02:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1913076154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02082db1-c4a5-4313-944f-66d5b9aa9d8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b62f2fd5f8424dd0aa0af75918a4510d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:02:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:02:06Z,use_quota=True,user_id='e1b08d9454194dfca3964da7ea8619c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:02:06 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-aa58adb0-569a-42db-ab3e-ef2bcf3b777d tempest-VolumesMetadataTest-1864091350 None] Creating volume 02082db1-c4a5-4313-944f-66d5b9aa9d8a {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:02:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-aa58adb0-569a-42db-ab3e-ef2bcf3b777d tempest-VolumesMetadataTest-1864091350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-aa58adb0-569a-42db-ab3e-ef2bcf3b777d tempest-VolumesMetadataTest-1864091350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:06 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-aa58adb0-569a-42db-ab3e-ef2bcf3b777d tempest-VolumesMetadataTest-1864091350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:02:06 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-aa58adb0-569a-42db-ab3e-ef2bcf3b777d tempest-VolumesMetadataTest-1864091350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:02:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-aa58adb0-569a-42db-ab3e-ef2bcf3b777d tempest-VolumesMetadataTest-1864091350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:06 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-aa58adb0-569a-42db-ab3e-ef2bcf3b777d tempest-VolumesMetadataTest-1864091350 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:02:06 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-aa58adb0-569a-42db-ab3e-ef2bcf3b777d tempest-VolumesMetadataTest-1864091350 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:02:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-aa58adb0-569a-42db-ab3e-ef2bcf3b777d tempest-VolumesMetadataTest-1864091350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02082db1-c4a5-4313-944f-66d5b9aa9d8a 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:06 devstack sudo[102161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02082db1-c4a5-4313-944f-66d5b9aa9d8a 1073741824 Jul 30 17:02:06 devstack sudo[102161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:06 devstack cinder-volume[88568]: DEBUG cinder.volume.volume_utils [None req-105dacdf-2a4d-44b5-92b8-afe523ce0f13 tempest-VolumeImageDependencyTests-1233841286 None] Attempting download of 465739ee-a714-4e5a-a68b-83e5ecd36df5 ((None, [{'url': 'file:///opt/stack/data/glance/images/465739ee-a714-4e5a-a68b-83e5ecd36df5', 'metadata': {}}])) to volume 9211858c-00de-4454-b1de-a54da7c0ccb3. {{(pid=88568) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 30 17:02:06 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b60cef-542a-402b-9126-181e33f9ee7a]: (4, 'raw') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:02:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-105dacdf-2a4d-44b5-92b8-afe523ce0f13 tempest-VolumeImageDependencyTests-1233841286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_465739ee-a714-4e5a-a68b-83e5ecd36df5_v_nh2h10 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:06 devstack sudo[102163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_465739ee-a714-4e5a-a68b-83e5ecd36df5_v_nh2h10 Jul 30 17:02:06 devstack sudo[102163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:06 devstack sudo[102163]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-105dacdf-2a4d-44b5-92b8-afe523ce0f13 tempest-VolumeImageDependencyTests-1233841286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_465739ee-a714-4e5a-a68b-83e5ecd36df5_v_nh2h10" returned: 0 in 0.357s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-105dacdf-2a4d-44b5-92b8-afe523ce0f13 tempest-VolumeImageDependencyTests-1233841286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_465739ee-a714-4e5a-a68b-83e5ecd36df5_v_nh2h10 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:07 devstack sudo[102161]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:07 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-aa58adb0-569a-42db-ab3e-ef2bcf3b777d tempest-VolumesMetadataTest-1864091350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02082db1-c4a5-4313-944f-66d5b9aa9d8a 1073741824" returned: 0 in 0.529s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:07 devstack sudo[102171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_465739ee-a714-4e5a-a68b-83e5ecd36df5_v_nh2h10 Jul 30 17:02:07 devstack sudo[102171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:07 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-aa58adb0-569a-42db-ab3e-ef2bcf3b777d tempest-VolumesMetadataTest-1864091350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02082db1-c4a5-4313-944f-66d5b9aa9d8a {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:07 devstack sudo[102173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02082db1-c4a5-4313-944f-66d5b9aa9d8a Jul 30 17:02:07 devstack sudo[102173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:07 devstack sudo[102171]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:07 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-105dacdf-2a4d-44b5-92b8-afe523ce0f13 tempest-VolumeImageDependencyTests-1233841286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_465739ee-a714-4e5a-a68b-83e5ecd36df5_v_nh2h10" returned: 1 in 0.362s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:07 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-105dacdf-2a4d-44b5-92b8-afe523ce0f13 tempest-VolumeImageDependencyTests-1233841286 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_465739ee-a714-4e5a-a68b-83e5ecd36df5_v_nh2h10' failed. Not Retrying. {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 17:02:07 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[24760534-1810-4931-871c-57925b3e15f2]: (4, 'raw') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:02:07 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-105dacdf-2a4d-44b5-92b8-afe523ce0f13 tempest-VolumeImageDependencyTests-1233841286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_465739ee-a714-4e5a-a68b-83e5ecd36df5__q1dy2phdevstack@QuobyteHD {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:07 devstack sudo[102173]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:07 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-aa58adb0-569a-42db-ab3e-ef2bcf3b777d tempest-VolumesMetadataTest-1864091350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02082db1-c4a5-4313-944f-66d5b9aa9d8a" returned: 0 in 0.267s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:07 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-aa58adb0-569a-42db-ab3e-ef2bcf3b777d tempest-VolumesMetadataTest-1864091350 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:02:07 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-aa58adb0-569a-42db-ab3e-ef2bcf3b777d tempest-VolumesMetadataTest-1864091350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:07 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-aa58adb0-569a-42db-ab3e-ef2bcf3b777d tempest-VolumesMetadataTest-1864091350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b006b717-aa84-4ad0-a5b2-f51c1b5bec5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02082db1-c4a5-4313-944f-66d5b9aa9d8a', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:07 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-aa58adb0-569a-42db-ab3e-ef2bcf3b777d tempest-VolumesMetadataTest-1864091350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1dbefe8-6ba8-4a7d-be23-6aa0658d5f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:07 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-aa58adb0-569a-42db-ab3e-ef2bcf3b777d tempest-VolumesMetadataTest-1864091350 None] Volume volume-02082db1-c4a5-4313-944f-66d5b9aa9d8a (02082db1-c4a5-4313-944f-66d5b9aa9d8a): created successfully Jul 30 17:02:07 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-aa58adb0-569a-42db-ab3e-ef2bcf3b777d tempest-VolumesMetadataTest-1864091350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1dbefe8-6ba8-4a7d-be23-6aa0658d5f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:07 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-aa58adb0-569a-42db-ab3e-ef2bcf3b777d tempest-VolumesMetadataTest-1864091350 None] Flow 'volume_create_manager' (579e9fbb-699c-48b1-9ce7-25b446b9255d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:02:07 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-aa58adb0-569a-42db-ab3e-ef2bcf3b777d tempest-VolumesMetadataTest-1864091350 None] Created volume successfully. Jul 30 17:02:07 devstack sudo[102178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_465739ee-a714-4e5a-a68b-83e5ecd36df5__q1dy2phdevstack@QuobyteHD Jul 30 17:02:07 devstack sudo[102178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:07 devstack sudo[102178]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:07 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-105dacdf-2a4d-44b5-92b8-afe523ce0f13 tempest-VolumeImageDependencyTests-1233841286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_465739ee-a714-4e5a-a68b-83e5ecd36df5__q1dy2phdevstack@QuobyteHD" returned: 0 in 0.365s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:07 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-105dacdf-2a4d-44b5-92b8-afe523ce0f13 tempest-VolumeImageDependencyTests-1233841286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_465739ee-a714-4e5a-a68b-83e5ecd36df5__q1dy2phdevstack@QuobyteHD {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:07 devstack sudo[102182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_465739ee-a714-4e5a-a68b-83e5ecd36df5__q1dy2phdevstack@QuobyteHD Jul 30 17:02:07 devstack sudo[102182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:08 devstack sudo[102182]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:08 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-105dacdf-2a4d-44b5-92b8-afe523ce0f13 tempest-VolumeImageDependencyTests-1233841286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_465739ee-a714-4e5a-a68b-83e5ecd36df5__q1dy2phdevstack@QuobyteHD" returned: 1 in 0.363s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:08 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-105dacdf-2a4d-44b5-92b8-afe523ce0f13 tempest-VolumeImageDependencyTests-1233841286 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_465739ee-a714-4e5a-a68b-83e5ecd36df5__q1dy2phdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 17:02:08 devstack cinder-volume[88568]: DEBUG cinder.image.image_utils [None req-105dacdf-2a4d-44b5-92b8-afe523ce0f13 tempest-VolumeImageDependencyTests-1233841286 None] 465739ee-a714-4e5a-a68b-83e5ecd36df5 was raw, converting to qcow2 {{(pid=88568) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 30 17:02:08 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-105dacdf-2a4d-44b5-92b8-afe523ce0f13 tempest-VolumeImageDependencyTests-1233841286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_465739ee-a714-4e5a-a68b-83e5ecd36df5__q1dy2phdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9211858c-00de-4454-b1de-a54da7c0ccb3 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:08 devstack sudo[102187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_465739ee-a714-4e5a-a68b-83e5ecd36df5__q1dy2phdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9211858c-00de-4454-b1de-a54da7c0ccb3 Jul 30 17:02:08 devstack sudo[102187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:08 devstack sudo[102187]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:08 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-105dacdf-2a4d-44b5-92b8-afe523ce0f13 tempest-VolumeImageDependencyTests-1233841286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_465739ee-a714-4e5a-a68b-83e5ecd36df5__q1dy2phdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9211858c-00de-4454-b1de-a54da7c0ccb3" returned: 0 in 0.551s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:08 devstack cinder-volume[88568]: DEBUG cinder.image.image_utils [None req-105dacdf-2a4d-44b5-92b8-afe523ce0f13 tempest-VolumeImageDependencyTests-1233841286 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_465739ee-a714-4e5a-a68b-83e5ecd36df5__q1dy2phdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9211858c-00de-4454-b1de-a54da7c0ccb3 {{(pid=88568) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 17:02:08 devstack cinder-volume[88568]: INFO cinder.image.image_utils [None req-105dacdf-2a4d-44b5-92b8-afe523ce0f13 tempest-VolumeImageDependencyTests-1233841286 None] Converted 0.00 MB image at 0.00 MB/s Jul 30 17:02:08 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-105dacdf-2a4d-44b5-92b8-afe523ce0f13 tempest-VolumeImageDependencyTests-1233841286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9211858c-00de-4454-b1de-a54da7c0ccb3 1G {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:08 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-86fe81fb-92ca-4399-80eb-8ddbeb0a7893 tempest-VolumesMetadataTest-1864091350 None] Acquiring lock "cinder-02082db1-c4a5-4313-944f-66d5b9aa9d8a-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:02:08 devstack sudo[102192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9211858c-00de-4454-b1de-a54da7c0ccb3 1G Jul 30 17:02:08 devstack sudo[102192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:08 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-86fe81fb-92ca-4399-80eb-8ddbeb0a7893 tempest-VolumesMetadataTest-1864091350 None] Lock "cinder-02082db1-c4a5-4313-944f-66d5b9aa9d8a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:02:08 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-86fe81fb-92ca-4399-80eb-8ddbeb0a7893 tempest-VolumesMetadataTest-1864091350 None] Acquiring lock "cinder-quobyte-02082db1-c4a5-4313-944f-66d5b9aa9d8a" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:02:08 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-86fe81fb-92ca-4399-80eb-8ddbeb0a7893 tempest-VolumesMetadataTest-1864091350 None] Lock "cinder-quobyte-02082db1-c4a5-4313-944f-66d5b9aa9d8a" acquired by "delete_volume" :: waited 0.022s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:02:08 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[32aa8904-e0b3-4f11-b118-36182c17abe0]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:02:08 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-86fe81fb-92ca-4399-80eb-8ddbeb0a7893 tempest-VolumesMetadataTest-1864091350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02082db1-c4a5-4313-944f-66d5b9aa9d8a {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:08 devstack sudo[102194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02082db1-c4a5-4313-944f-66d5b9aa9d8a Jul 30 17:02:08 devstack sudo[102194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:08 devstack sudo[102192]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:08 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-105dacdf-2a4d-44b5-92b8-afe523ce0f13 tempest-VolumeImageDependencyTests-1233841286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9211858c-00de-4454-b1de-a54da7c0ccb3 1G" returned: 0 in 0.377s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:08 devstack cinder-volume[88568]: DEBUG cinder.volume.volume_utils [None req-105dacdf-2a4d-44b5-92b8-afe523ce0f13 tempest-VolumeImageDependencyTests-1233841286 None] Downloaded image 465739ee-a714-4e5a-a68b-83e5ecd36df5 ((None, [{'url': 'file:///opt/stack/data/glance/images/465739ee-a714-4e5a-a68b-83e5ecd36df5', 'metadata': {}}])) to volume 9211858c-00de-4454-b1de-a54da7c0ccb3 successfully. {{(pid=88568) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 30 17:02:08 devstack cinder-volume[88568]: DEBUG cinder.image.image_utils [None req-105dacdf-2a4d-44b5-92b8-afe523ce0f13 tempest-VolumeImageDependencyTests-1233841286 None] Temporary image 465739ee-a714-4e5a-a68b-83e5ecd36df5 for user a48f55ad210a4089bb718a1ebf42f6c1 is deleted. {{(pid=88568) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 30 17:02:08 devstack cinder-volume[88568]: DEBUG cinder.volume.volume_utils [None req-105dacdf-2a4d-44b5-92b8-afe523ce0f13 tempest-VolumeImageDependencyTests-1233841286 None] Marking volume 9211858c-00de-4454-b1de-a54da7c0ccb3 as bootable. {{(pid=88568) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 30 17:02:09 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-105dacdf-2a4d-44b5-92b8-afe523ce0f13 tempest-VolumeImageDependencyTests-1233841286 None] Copying metadata from image 465739ee-a714-4e5a-a68b-83e5ecd36df5 to 9211858c-00de-4454-b1de-a54da7c0ccb3. {{(pid=88568) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 30 17:02:09 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-105dacdf-2a4d-44b5-92b8-afe523ce0f13 tempest-VolumeImageDependencyTests-1233841286 None] Creating volume glance metadata for volume 9211858c-00de-4454-b1de-a54da7c0ccb3 backed by image 465739ee-a714-4e5a-a68b-83e5ecd36df5 with: {'image_id': '465739ee-a714-4e5a-a68b-83e5ecd36df5', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '3b0c885fd4506bd0a5c7197ccb12442b', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88568) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 30 17:02:09 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-105dacdf-2a4d-44b5-92b8-afe523ce0f13 tempest-VolumeImageDependencyTests-1233841286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07e427d8-8165-4e3e-a941-078262aab049) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9211858c-00de-4454-b1de-a54da7c0ccb3', 'volume_size': 1, 'image_id': '465739ee-a714-4e5a-a68b-83e5ecd36df5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/465739ee-a714-4e5a-a68b-83e5ecd36df5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3b0c885fd4506bd0a5c7197ccb12442b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ddb3b4da04b44fecabca5efa2c70dabb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '423d26b8495a62a00d74157872e06c7f48fc20c6c1c7eaabbe8d00ab72ec916507ad1a1df818b66677d09086ad15fb44de335bfb23d2d67a584add171e86a857', 'id': '465739ee-a714-4e5a-a68b-83e5ecd36df5', 'created_at': datetime.datetime(2026, 7, 30, 15, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 15, 2, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/465739ee-a714-4e5a-a68b-83e5ecd36df5/file', 'properties': {}}, 'image_service': }' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:09 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-105dacdf-2a4d-44b5-92b8-afe523ce0f13 tempest-VolumeImageDependencyTests-1233841286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e107b99e-7f28-4210-be75-a58bcf7e85ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:09 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-105dacdf-2a4d-44b5-92b8-afe523ce0f13 tempest-VolumeImageDependencyTests-1233841286 None] Volume volume-9211858c-00de-4454-b1de-a54da7c0ccb3 (9211858c-00de-4454-b1de-a54da7c0ccb3): created successfully Jul 30 17:02:09 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-105dacdf-2a4d-44b5-92b8-afe523ce0f13 tempest-VolumeImageDependencyTests-1233841286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e107b99e-7f28-4210-be75-a58bcf7e85ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:09 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-105dacdf-2a4d-44b5-92b8-afe523ce0f13 tempest-VolumeImageDependencyTests-1233841286 None] Flow 'volume_create_manager' (64336c4e-687b-4908-a9e1-4193c062f32b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:02:09 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-105dacdf-2a4d-44b5-92b8-afe523ce0f13 tempest-VolumeImageDependencyTests-1233841286 None] Created volume successfully. Jul 30 17:02:09 devstack sudo[102194]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:09 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-86fe81fb-92ca-4399-80eb-8ddbeb0a7893 tempest-VolumesMetadataTest-1864091350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02082db1-c4a5-4313-944f-66d5b9aa9d8a" returned: 0 in 0.394s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:09 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-86fe81fb-92ca-4399-80eb-8ddbeb0a7893 tempest-VolumesMetadataTest-1864091350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02082db1-c4a5-4313-944f-66d5b9aa9d8a {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:09 devstack sudo[102202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02082db1-c4a5-4313-944f-66d5b9aa9d8a Jul 30 17:02:09 devstack sudo[102202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:09 devstack sudo[102202]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:09 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-86fe81fb-92ca-4399-80eb-8ddbeb0a7893 tempest-VolumesMetadataTest-1864091350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02082db1-c4a5-4313-944f-66d5b9aa9d8a" returned: 0 in 0.250s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:09 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-231117a3-122f-4089-b793-f74c04b0a253 tempest-VolumesSnapshotListTestJSON-1001216880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:02:09 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-231117a3-122f-4089-b793-f74c04b0a253 tempest-VolumesSnapshotListTestJSON-1001216880 None] Flow 'volume_create_manager' (08f93455-0137-4798-9268-ba7ae9d44f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:02:09 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-231117a3-122f-4089-b793-f74c04b0a253 tempest-VolumesSnapshotListTestJSON-1001216880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3c065be-532c-4e1e-935f-e5191a60fb10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:09 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-86fe81fb-92ca-4399-80eb-8ddbeb0a7893 tempest-VolumesMetadataTest-1864091350 None] Lock "cinder-quobyte-02082db1-c4a5-4313-944f-66d5b9aa9d8a" released by "delete_volume" :: held 0.725s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:02:09 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-231117a3-122f-4089-b793-f74c04b0a253 tempest-VolumesSnapshotListTestJSON-1001216880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3c065be-532c-4e1e-935f-e5191a60fb10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:02:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-390147171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4326973-e0b3-4417-b247-9b8966b384c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bedd6f53f9d145a2b255bc4f38e7a999',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:02:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:02:09Z,use_quota=True,user_id='213264e641cf4c69bf0eca27c594fce1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:09 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-231117a3-122f-4089-b793-f74c04b0a253 tempest-VolumesSnapshotListTestJSON-1001216880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8eaef54-702a-42cc-8810-54e672e6b0e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:09 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-231117a3-122f-4089-b793-f74c04b0a253 tempest-VolumesSnapshotListTestJSON-1001216880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8eaef54-702a-42cc-8810-54e672e6b0e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:09 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-231117a3-122f-4089-b793-f74c04b0a253 tempest-VolumesSnapshotListTestJSON-1001216880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc328823-830e-4592-a235-c71b583666eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:09 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-231117a3-122f-4089-b793-f74c04b0a253 tempest-VolumesSnapshotListTestJSON-1001216880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc328823-830e-4592-a235-c71b583666eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4326973-e0b3-4417-b247-9b8966b384c6', 'volume_name': 'volume-d4326973-e0b3-4417-b247-9b8966b384c6', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:09 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-231117a3-122f-4089-b793-f74c04b0a253 tempest-VolumesSnapshotListTestJSON-1001216880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (913568e5-12a4-4e08-818d-5275fa0d6561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:09 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-231117a3-122f-4089-b793-f74c04b0a253 tempest-VolumesSnapshotListTestJSON-1001216880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (913568e5-12a4-4e08-818d-5275fa0d6561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:09 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-231117a3-122f-4089-b793-f74c04b0a253 tempest-VolumesSnapshotListTestJSON-1001216880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dc0f734-2ad1-478a-b2d6-f6d38d15e1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:09 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-231117a3-122f-4089-b793-f74c04b0a253 tempest-VolumesSnapshotListTestJSON-1001216880 None] Volume d4326973-e0b3-4417-b247-9b8966b384c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4326973-e0b3-4417-b247-9b8966b384c6', 'volume_size': 1} Jul 30 17:02:09 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-231117a3-122f-4089-b793-f74c04b0a253 tempest-VolumesSnapshotListTestJSON-1001216880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:09 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-231117a3-122f-4089-b793-f74c04b0a253 tempest-VolumesSnapshotListTestJSON-1001216880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:09 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-231117a3-122f-4089-b793-f74c04b0a253 tempest-VolumesSnapshotListTestJSON-1001216880 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:02:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-390147171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4326973-e0b3-4417-b247-9b8966b384c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bedd6f53f9d145a2b255bc4f38e7a999',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:02:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:02:09Z,use_quota=True,user_id='213264e641cf4c69bf0eca27c594fce1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:02:09 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-231117a3-122f-4089-b793-f74c04b0a253 tempest-VolumesSnapshotListTestJSON-1001216880 None] Creating volume d4326973-e0b3-4417-b247-9b8966b384c6 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:02:09 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-231117a3-122f-4089-b793-f74c04b0a253 tempest-VolumesSnapshotListTestJSON-1001216880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:09 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-231117a3-122f-4089-b793-f74c04b0a253 tempest-VolumesSnapshotListTestJSON-1001216880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:09 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-231117a3-122f-4089-b793-f74c04b0a253 tempest-VolumesSnapshotListTestJSON-1001216880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:02:09 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-231117a3-122f-4089-b793-f74c04b0a253 tempest-VolumesSnapshotListTestJSON-1001216880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:02:09 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-231117a3-122f-4089-b793-f74c04b0a253 tempest-VolumesSnapshotListTestJSON-1001216880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:09 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-231117a3-122f-4089-b793-f74c04b0a253 tempest-VolumesSnapshotListTestJSON-1001216880 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:02:09 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-231117a3-122f-4089-b793-f74c04b0a253 tempest-VolumesSnapshotListTestJSON-1001216880 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:02:09 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-231117a3-122f-4089-b793-f74c04b0a253 tempest-VolumesSnapshotListTestJSON-1001216880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:09 devstack sudo[102205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6 1073741824 Jul 30 17:02:09 devstack sudo[102205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:09 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-86fe81fb-92ca-4399-80eb-8ddbeb0a7893 tempest-VolumesMetadataTest-1864091350 None] Created reservations ['099404af-68b1-40ca-ad81-79413a72c814', 'd9720651-bc91-496a-bf45-dbb7a541f03f', 'f320bd6c-da3d-40f1-bf7c-9110e0d0dec9', '3bc9fba8-87cb-4da9-a566-fcf8942869d9'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:02:09 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-d5ddce73-abea-4fac-be27-0f216fae7324 tempest-VolumeImageDependencyTests-1233841286 None] Acquiring lock "cinder-9211858c-00de-4454-b1de-a54da7c0ccb3-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:02:09 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-d5ddce73-abea-4fac-be27-0f216fae7324 tempest-VolumeImageDependencyTests-1233841286 None] Lock "cinder-9211858c-00de-4454-b1de-a54da7c0ccb3-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:02:09 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-86fe81fb-92ca-4399-80eb-8ddbeb0a7893 tempest-VolumesMetadataTest-1864091350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:09 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-86fe81fb-92ca-4399-80eb-8ddbeb0a7893 tempest-VolumesMetadataTest-1864091350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:09 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-86fe81fb-92ca-4399-80eb-8ddbeb0a7893 tempest-VolumesMetadataTest-1864091350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:02:09 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-86fe81fb-92ca-4399-80eb-8ddbeb0a7893 tempest-VolumesMetadataTest-1864091350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:02:09 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-86fe81fb-92ca-4399-80eb-8ddbeb0a7893 tempest-VolumesMetadataTest-1864091350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:09 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-86fe81fb-92ca-4399-80eb-8ddbeb0a7893 tempest-VolumesMetadataTest-1864091350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:09 devstack sudo[102207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:02:09 devstack sudo[102207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:09 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-d5ddce73-abea-4fac-be27-0f216fae7324 tempest-VolumeImageDependencyTests-1233841286 None] Acquiring lock "cinder-quobyte-9211858c-00de-4454-b1de-a54da7c0ccb3" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:02:09 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-d5ddce73-abea-4fac-be27-0f216fae7324 tempest-VolumeImageDependencyTests-1233841286 None] Lock "cinder-quobyte-9211858c-00de-4454-b1de-a54da7c0ccb3" acquired by "delete_volume" :: waited 0.024s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:02:09 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd67cbc-c953-48ec-b3f6-2d1104ec6589]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:02:09 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d5ddce73-abea-4fac-be27-0f216fae7324 tempest-VolumeImageDependencyTests-1233841286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9211858c-00de-4454-b1de-a54da7c0ccb3 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:09 devstack sudo[102211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9211858c-00de-4454-b1de-a54da7c0ccb3 Jul 30 17:02:09 devstack sudo[102211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:09 devstack sudo[102207]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:09 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-86fe81fb-92ca-4399-80eb-8ddbeb0a7893 tempest-VolumesMetadataTest-1864091350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.267s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:09 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-86fe81fb-92ca-4399-80eb-8ddbeb0a7893 tempest-VolumesMetadataTest-1864091350 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:02:09 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-86fe81fb-92ca-4399-80eb-8ddbeb0a7893 tempest-VolumesMetadataTest-1864091350 None] Deleted volume successfully. Jul 30 17:02:10 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-86fe81fb-92ca-4399-80eb-8ddbeb0a7893 tempest-VolumesMetadataTest-1864091350 None] Lock "cinder-02082db1-c4a5-4313-944f-66d5b9aa9d8a-delete_volume" released by "delete_volume" :: held 1.352s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:02:10 devstack sudo[102205]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:10 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-231117a3-122f-4089-b793-f74c04b0a253 tempest-VolumesSnapshotListTestJSON-1001216880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6 1073741824" returned: 0 in 0.591s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:10 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-231117a3-122f-4089-b793-f74c04b0a253 tempest-VolumesSnapshotListTestJSON-1001216880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:10 devstack sudo[102217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6 Jul 30 17:02:10 devstack sudo[102217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:10 devstack sudo[102211]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:10 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d5ddce73-abea-4fac-be27-0f216fae7324 tempest-VolumeImageDependencyTests-1233841286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9211858c-00de-4454-b1de-a54da7c0ccb3" returned: 0 in 0.454s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:10 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d5ddce73-abea-4fac-be27-0f216fae7324 tempest-VolumeImageDependencyTests-1233841286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9211858c-00de-4454-b1de-a54da7c0ccb3 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:10 devstack sudo[102221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9211858c-00de-4454-b1de-a54da7c0ccb3 Jul 30 17:02:10 devstack sudo[102221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:10 devstack sudo[102217]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:10 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-231117a3-122f-4089-b793-f74c04b0a253 tempest-VolumesSnapshotListTestJSON-1001216880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6" returned: 0 in 0.288s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:10 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-231117a3-122f-4089-b793-f74c04b0a253 tempest-VolumesSnapshotListTestJSON-1001216880 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:02:10 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-231117a3-122f-4089-b793-f74c04b0a253 tempest-VolumesSnapshotListTestJSON-1001216880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:10 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-231117a3-122f-4089-b793-f74c04b0a253 tempest-VolumesSnapshotListTestJSON-1001216880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dc0f734-2ad1-478a-b2d6-f6d38d15e1d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4326973-e0b3-4417-b247-9b8966b384c6', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:10 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-231117a3-122f-4089-b793-f74c04b0a253 tempest-VolumesSnapshotListTestJSON-1001216880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26e83fd4-286a-4496-a58c-e3ef7f5b50c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:10 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-231117a3-122f-4089-b793-f74c04b0a253 tempest-VolumesSnapshotListTestJSON-1001216880 None] Volume volume-d4326973-e0b3-4417-b247-9b8966b384c6 (d4326973-e0b3-4417-b247-9b8966b384c6): created successfully Jul 30 17:02:10 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-231117a3-122f-4089-b793-f74c04b0a253 tempest-VolumesSnapshotListTestJSON-1001216880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26e83fd4-286a-4496-a58c-e3ef7f5b50c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:10 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-231117a3-122f-4089-b793-f74c04b0a253 tempest-VolumesSnapshotListTestJSON-1001216880 None] Flow 'volume_create_manager' (08f93455-0137-4798-9268-ba7ae9d44f86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:02:10 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-231117a3-122f-4089-b793-f74c04b0a253 tempest-VolumesSnapshotListTestJSON-1001216880 None] Created volume successfully. Jul 30 17:02:10 devstack sudo[102221]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:10 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d5ddce73-abea-4fac-be27-0f216fae7324 tempest-VolumeImageDependencyTests-1233841286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9211858c-00de-4454-b1de-a54da7c0ccb3" returned: 0 in 0.264s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:10 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-d5ddce73-abea-4fac-be27-0f216fae7324 tempest-VolumeImageDependencyTests-1233841286 None] Lock "cinder-quobyte-9211858c-00de-4454-b1de-a54da7c0ccb3" released by "delete_volume" :: held 0.776s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:02:10 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-d5ddce73-abea-4fac-be27-0f216fae7324 tempest-VolumeImageDependencyTests-1233841286 None] Created reservations ['3b81ac84-aa65-43b2-ad0f-85b80b946ee1', '2012152e-7514-432f-b7b3-fc2cde927a6a', '292cd7e8-e146-4731-ac1b-a35343f232c0', '80451b04-2ea7-46fc-b793-283cc56c3b61'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:02:10 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-d5ddce73-abea-4fac-be27-0f216fae7324 tempest-VolumeImageDependencyTests-1233841286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:10 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-d5ddce73-abea-4fac-be27-0f216fae7324 tempest-VolumeImageDependencyTests-1233841286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:10 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-d5ddce73-abea-4fac-be27-0f216fae7324 tempest-VolumeImageDependencyTests-1233841286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:02:10 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-d5ddce73-abea-4fac-be27-0f216fae7324 tempest-VolumeImageDependencyTests-1233841286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:02:10 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-d5ddce73-abea-4fac-be27-0f216fae7324 tempest-VolumeImageDependencyTests-1233841286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:10 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d5ddce73-abea-4fac-be27-0f216fae7324 tempest-VolumeImageDependencyTests-1233841286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:10 devstack sudo[102225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:02:10 devstack sudo[102225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:10 devstack sudo[102225]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:10 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d5ddce73-abea-4fac-be27-0f216fae7324 tempest-VolumeImageDependencyTests-1233841286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.300s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:10 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-d5ddce73-abea-4fac-be27-0f216fae7324 tempest-VolumeImageDependencyTests-1233841286 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:02:10 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-d5ddce73-abea-4fac-be27-0f216fae7324 tempest-VolumeImageDependencyTests-1233841286 None] Deleted volume successfully. Jul 30 17:02:11 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-d5ddce73-abea-4fac-be27-0f216fae7324 tempest-VolumeImageDependencyTests-1233841286 None] Lock "cinder-9211858c-00de-4454-b1de-a54da7c0ccb3-delete_volume" released by "delete_volume" :: held 1.344s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:02:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-dfe86783-01c7-4228-b984-51c97aec8005 tempest-VolumesSnapshotListTestJSON-1001216880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-dfe86783-01c7-4228-b984-51c97aec8005 tempest-VolumesSnapshotListTestJSON-1001216880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:11 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-dfe86783-01c7-4228-b984-51c97aec8005 tempest-VolumesSnapshotListTestJSON-1001216880 None] Creating offline snapshot 67c18d67-f99b-4ded-a508-39bd6a08c55a of volume d4326973-e0b3-4417-b247-9b8966b384c6 {{(pid=88568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:02:11 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7eed102-78a2-4fbe-a974-7bc0f0f783e6]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:02:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-dfe86783-01c7-4228-b984-51c97aec8005 tempest-VolumesSnapshotListTestJSON-1001216880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:11 devstack sudo[102228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6 Jul 30 17:02:11 devstack sudo[102228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:12 devstack sudo[102228]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-dfe86783-01c7-4228-b984-51c97aec8005 tempest-VolumesSnapshotListTestJSON-1001216880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6" returned: 0 in 0.427s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-dfe86783-01c7-4228-b984-51c97aec8005 tempest-VolumesSnapshotListTestJSON-1001216880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.67c18d67-f99b-4ded-a508-39bd6a08c55a 1G {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:12 devstack sudo[102233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.67c18d67-f99b-4ded-a508-39bd6a08c55a 1G Jul 30 17:02:12 devstack sudo[102233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:12 devstack sudo[102233]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-dfe86783-01c7-4228-b984-51c97aec8005 tempest-VolumesSnapshotListTestJSON-1001216880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.67c18d67-f99b-4ded-a508-39bd6a08c55a 1G" returned: 0 in 0.474s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-dfe86783-01c7-4228-b984-51c97aec8005 tempest-VolumesSnapshotListTestJSON-1001216880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4326973-e0b3-4417-b247-9b8966b384c6 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.67c18d67-f99b-4ded-a508-39bd6a08c55a {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:12 devstack sudo[102241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4326973-e0b3-4417-b247-9b8966b384c6 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.67c18d67-f99b-4ded-a508-39bd6a08c55a Jul 30 17:02:12 devstack sudo[102241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:13 devstack sudo[102241]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-dfe86783-01c7-4228-b984-51c97aec8005 tempest-VolumesSnapshotListTestJSON-1001216880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4326973-e0b3-4417-b247-9b8966b384c6 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.67c18d67-f99b-4ded-a508-39bd6a08c55a" returned: 0 in 0.341s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:13 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-dfe86783-01c7-4228-b984-51c97aec8005 tempest-VolumesSnapshotListTestJSON-1001216880 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.67c18d67-f99b-4ded-a508-39bd6a08c55a is being set with open permissions: ugo+rw Jul 30 17:02:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-dfe86783-01c7-4228-b984-51c97aec8005 tempest-VolumesSnapshotListTestJSON-1001216880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.67c18d67-f99b-4ded-a508-39bd6a08c55a {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:13 devstack sudo[102247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.67c18d67-f99b-4ded-a508-39bd6a08c55a Jul 30 17:02:13 devstack sudo[102247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:13 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a9b4697-517d-4ddb-8378-1a13594ae6ac tempest-VolumesCloneNegativeTest-659334463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:02:13 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4a9b4697-517d-4ddb-8378-1a13594ae6ac tempest-VolumesCloneNegativeTest-659334463 None] Flow 'volume_create_manager' (307c4205-cadf-455d-8512-a30adff6edc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:02:13 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4a9b4697-517d-4ddb-8378-1a13594ae6ac tempest-VolumesCloneNegativeTest-659334463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58b2a95b-239e-4d81-b7a8-25f523b7b9c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:13 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4a9b4697-517d-4ddb-8378-1a13594ae6ac tempest-VolumesCloneNegativeTest-659334463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58b2a95b-239e-4d81-b7a8-25f523b7b9c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:02:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-606447234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d18dc6db-3037-4cd9-a27f-aa779a7a8126,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe755ad8ec7a49609207cf6c15f66f59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:02:13Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:02:13Z,use_quota=True,user_id='dd7e32c819114dfa957ccdf835359ae8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:13 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4a9b4697-517d-4ddb-8378-1a13594ae6ac tempest-VolumesCloneNegativeTest-659334463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9457fe4c-cabf-4d16-af7b-582e0f42b717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:13 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4a9b4697-517d-4ddb-8378-1a13594ae6ac tempest-VolumesCloneNegativeTest-659334463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9457fe4c-cabf-4d16-af7b-582e0f42b717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:13 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4a9b4697-517d-4ddb-8378-1a13594ae6ac tempest-VolumesCloneNegativeTest-659334463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e0323c7-7802-43fc-a4ef-f7beb064f4f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:13 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4a9b4697-517d-4ddb-8378-1a13594ae6ac tempest-VolumesCloneNegativeTest-659334463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e0323c7-7802-43fc-a4ef-f7beb064f4f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd18dc6db-3037-4cd9-a27f-aa779a7a8126', 'volume_name': 'volume-d18dc6db-3037-4cd9-a27f-aa779a7a8126', 'volume_size': 2}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:13 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4a9b4697-517d-4ddb-8378-1a13594ae6ac tempest-VolumesCloneNegativeTest-659334463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dc3fdb8-5de0-4171-85c1-3c7e7de45e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:13 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4a9b4697-517d-4ddb-8378-1a13594ae6ac tempest-VolumesCloneNegativeTest-659334463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dc3fdb8-5de0-4171-85c1-3c7e7de45e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:13 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4a9b4697-517d-4ddb-8378-1a13594ae6ac tempest-VolumesCloneNegativeTest-659334463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f19f226-7059-4296-b38e-85efff1bfc32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:13 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-4a9b4697-517d-4ddb-8378-1a13594ae6ac tempest-VolumesCloneNegativeTest-659334463 None] Volume d18dc6db-3037-4cd9-a27f-aa779a7a8126: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d18dc6db-3037-4cd9-a27f-aa779a7a8126', 'volume_size': 2} Jul 30 17:02:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-4a9b4697-517d-4ddb-8378-1a13594ae6ac tempest-VolumesCloneNegativeTest-659334463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:13 devstack sudo[102247]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-dfe86783-01c7-4228-b984-51c97aec8005 tempest-VolumesSnapshotListTestJSON-1001216880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.67c18d67-f99b-4ded-a508-39bd6a08c55a" returned: 0 in 0.276s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-dfe86783-01c7-4228-b984-51c97aec8005 tempest-VolumesSnapshotListTestJSON-1001216880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:13 devstack sudo[102250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.info Jul 30 17:02:13 devstack sudo[102250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:13 devstack sudo[102250]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-dfe86783-01c7-4228-b984-51c97aec8005 tempest-VolumesSnapshotListTestJSON-1001216880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.info" returned: 0 in 0.272s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:13 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-dfe86783-01c7-4228-b984-51c97aec8005 tempest-VolumesSnapshotListTestJSON-1001216880 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.info is being set with open permissions: ugo+rw Jul 30 17:02:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-dfe86783-01c7-4228-b984-51c97aec8005 tempest-VolumesSnapshotListTestJSON-1001216880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:13 devstack sudo[102253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.info Jul 30 17:02:13 devstack sudo[102253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:13 devstack sudo[102253]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-dfe86783-01c7-4228-b984-51c97aec8005 tempest-VolumesSnapshotListTestJSON-1001216880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.info" returned: 0 in 0.251s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-dfe86783-01c7-4228-b984-51c97aec8005 tempest-VolumesSnapshotListTestJSON-1001216880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.155s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-4a9b4697-517d-4ddb-8378-1a13594ae6ac tempest-VolumesCloneNegativeTest-659334463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.641s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:13 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-4a9b4697-517d-4ddb-8378-1a13594ae6ac tempest-VolumesCloneNegativeTest-659334463 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:02:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-606447234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d18dc6db-3037-4cd9-a27f-aa779a7a8126,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe755ad8ec7a49609207cf6c15f66f59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:02:13Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:02:13Z,use_quota=True,user_id='dd7e32c819114dfa957ccdf835359ae8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:02:13 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-4a9b4697-517d-4ddb-8378-1a13594ae6ac tempest-VolumesCloneNegativeTest-659334463 None] Creating volume d18dc6db-3037-4cd9-a27f-aa779a7a8126 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:02:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-4a9b4697-517d-4ddb-8378-1a13594ae6ac tempest-VolumesCloneNegativeTest-659334463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-4a9b4697-517d-4ddb-8378-1a13594ae6ac tempest-VolumesCloneNegativeTest-659334463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:13 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-4a9b4697-517d-4ddb-8378-1a13594ae6ac tempest-VolumesCloneNegativeTest-659334463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:02:13 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-4a9b4697-517d-4ddb-8378-1a13594ae6ac tempest-VolumesCloneNegativeTest-659334463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:02:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-4a9b4697-517d-4ddb-8378-1a13594ae6ac tempest-VolumesCloneNegativeTest-659334463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:13 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-4a9b4697-517d-4ddb-8378-1a13594ae6ac tempest-VolumesCloneNegativeTest-659334463 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:02:13 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-4a9b4697-517d-4ddb-8378-1a13594ae6ac tempest-VolumesCloneNegativeTest-659334463 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:02:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-4a9b4697-517d-4ddb-8378-1a13594ae6ac tempest-VolumesCloneNegativeTest-659334463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d18dc6db-3037-4cd9-a27f-aa779a7a8126 2147483648 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:13 devstack sudo[102256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d18dc6db-3037-4cd9-a27f-aa779a7a8126 2147483648 Jul 30 17:02:13 devstack sudo[102256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:13 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-dfe86783-01c7-4228-b984-51c97aec8005 tempest-VolumesSnapshotListTestJSON-1001216880 None] Create snapshot completed successfully Jul 30 17:02:14 devstack sudo[102256]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-4a9b4697-517d-4ddb-8378-1a13594ae6ac tempest-VolumesCloneNegativeTest-659334463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d18dc6db-3037-4cd9-a27f-aa779a7a8126 2147483648" returned: 0 in 0.458s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-4a9b4697-517d-4ddb-8378-1a13594ae6ac tempest-VolumesCloneNegativeTest-659334463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d18dc6db-3037-4cd9-a27f-aa779a7a8126 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:14 devstack sudo[102262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d18dc6db-3037-4cd9-a27f-aa779a7a8126 Jul 30 17:02:14 devstack sudo[102262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:14 devstack sudo[102262]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-4a9b4697-517d-4ddb-8378-1a13594ae6ac tempest-VolumesCloneNegativeTest-659334463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d18dc6db-3037-4cd9-a27f-aa779a7a8126" returned: 0 in 0.251s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:14 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-4a9b4697-517d-4ddb-8378-1a13594ae6ac tempest-VolumesCloneNegativeTest-659334463 None] <== create_volume: return (745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:02:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-4a9b4697-517d-4ddb-8378-1a13594ae6ac tempest-VolumesCloneNegativeTest-659334463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:14 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4a9b4697-517d-4ddb-8378-1a13594ae6ac tempest-VolumesCloneNegativeTest-659334463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f19f226-7059-4296-b38e-85efff1bfc32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d18dc6db-3037-4cd9-a27f-aa779a7a8126', 'volume_size': 2}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:14 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4a9b4697-517d-4ddb-8378-1a13594ae6ac tempest-VolumesCloneNegativeTest-659334463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d71d7413-7270-4ec3-8d1f-a6107a31749f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:14 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-4a9b4697-517d-4ddb-8378-1a13594ae6ac tempest-VolumesCloneNegativeTest-659334463 None] Volume volume-d18dc6db-3037-4cd9-a27f-aa779a7a8126 (d18dc6db-3037-4cd9-a27f-aa779a7a8126): created successfully Jul 30 17:02:14 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4a9b4697-517d-4ddb-8378-1a13594ae6ac tempest-VolumesCloneNegativeTest-659334463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d71d7413-7270-4ec3-8d1f-a6107a31749f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:14 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4a9b4697-517d-4ddb-8378-1a13594ae6ac tempest-VolumesCloneNegativeTest-659334463 None] Flow 'volume_create_manager' (307c4205-cadf-455d-8512-a30adff6edc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:02:14 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-4a9b4697-517d-4ddb-8378-1a13594ae6ac tempest-VolumesCloneNegativeTest-659334463 None] Created volume successfully. Jul 30 17:02:15 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-7e58a4fb-cb31-46f1-8917-eeef0f2536e6 tempest-VolumesSnapshotListTestJSON-1001216880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:15 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-7e58a4fb-cb31-46f1-8917-eeef0f2536e6 tempest-VolumesSnapshotListTestJSON-1001216880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:15 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-7e58a4fb-cb31-46f1-8917-eeef0f2536e6 tempest-VolumesSnapshotListTestJSON-1001216880 None] Creating offline snapshot 57bf7386-e8ee-497f-80ad-d67197f79ff2 of volume d4326973-e0b3-4417-b247-9b8966b384c6 {{(pid=88568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:02:15 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[931e34ba-eb3e-4a48-b266-84fec5576fd6]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:02:15 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7e58a4fb-cb31-46f1-8917-eeef0f2536e6 tempest-VolumesSnapshotListTestJSON-1001216880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.67c18d67-f99b-4ded-a508-39bd6a08c55a {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:15 devstack sudo[102266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.67c18d67-f99b-4ded-a508-39bd6a08c55a Jul 30 17:02:15 devstack sudo[102266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:15 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-573f568d-f423-4b9b-9f48-918168970037 tempest-VolumesCloneNegativeTest-659334463 None] Acquiring lock "cinder-d18dc6db-3037-4cd9-a27f-aa779a7a8126-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:02:15 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-573f568d-f423-4b9b-9f48-918168970037 tempest-VolumesCloneNegativeTest-659334463 None] Lock "cinder-d18dc6db-3037-4cd9-a27f-aa779a7a8126-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:02:15 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-573f568d-f423-4b9b-9f48-918168970037 tempest-VolumesCloneNegativeTest-659334463 None] Acquiring lock "cinder-quobyte-d18dc6db-3037-4cd9-a27f-aa779a7a8126" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:02:15 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-573f568d-f423-4b9b-9f48-918168970037 tempest-VolumesCloneNegativeTest-659334463 None] Lock "cinder-quobyte-d18dc6db-3037-4cd9-a27f-aa779a7a8126" acquired by "delete_volume" :: waited 0.017s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:02:15 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa06c71-a7ad-45a0-b5d2-d0c235d93ac7]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:02:15 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-573f568d-f423-4b9b-9f48-918168970037 tempest-VolumesCloneNegativeTest-659334463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d18dc6db-3037-4cd9-a27f-aa779a7a8126 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:15 devstack sudo[102266]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:15 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7e58a4fb-cb31-46f1-8917-eeef0f2536e6 tempest-VolumesSnapshotListTestJSON-1001216880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.67c18d67-f99b-4ded-a508-39bd6a08c55a" returned: 0 in 0.441s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:15 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-7e58a4fb-cb31-46f1-8917-eeef0f2536e6 tempest-VolumesSnapshotListTestJSON-1001216880 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4326973-e0b3-4417-b247-9b8966b384c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:02:15 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7e58a4fb-cb31-46f1-8917-eeef0f2536e6 tempest-VolumesSnapshotListTestJSON-1001216880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.67c18d67-f99b-4ded-a508-39bd6a08c55a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.57bf7386-e8ee-497f-80ad-d67197f79ff2 1G {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:15 devstack sudo[102272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.67c18d67-f99b-4ded-a508-39bd6a08c55a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.57bf7386-e8ee-497f-80ad-d67197f79ff2 1G Jul 30 17:02:15 devstack sudo[102272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:15 devstack sudo[102271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d18dc6db-3037-4cd9-a27f-aa779a7a8126 Jul 30 17:02:15 devstack sudo[102271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:16 devstack sudo[102271]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:16 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-573f568d-f423-4b9b-9f48-918168970037 tempest-VolumesCloneNegativeTest-659334463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d18dc6db-3037-4cd9-a27f-aa779a7a8126" returned: 0 in 0.415s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:16 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-573f568d-f423-4b9b-9f48-918168970037 tempest-VolumesCloneNegativeTest-659334463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d18dc6db-3037-4cd9-a27f-aa779a7a8126 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:16 devstack sudo[102282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d18dc6db-3037-4cd9-a27f-aa779a7a8126 Jul 30 17:02:16 devstack sudo[102282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:16 devstack sudo[102272]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:16 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7e58a4fb-cb31-46f1-8917-eeef0f2536e6 tempest-VolumesSnapshotListTestJSON-1001216880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.67c18d67-f99b-4ded-a508-39bd6a08c55a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.57bf7386-e8ee-497f-80ad-d67197f79ff2 1G" returned: 0 in 0.522s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:16 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7e58a4fb-cb31-46f1-8917-eeef0f2536e6 tempest-VolumesSnapshotListTestJSON-1001216880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4326973-e0b3-4417-b247-9b8966b384c6.67c18d67-f99b-4ded-a508-39bd6a08c55a -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.57bf7386-e8ee-497f-80ad-d67197f79ff2 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:16 devstack sudo[102285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4326973-e0b3-4417-b247-9b8966b384c6.67c18d67-f99b-4ded-a508-39bd6a08c55a -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.57bf7386-e8ee-497f-80ad-d67197f79ff2 Jul 30 17:02:16 devstack sudo[102285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:16 devstack sudo[102282]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:16 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-573f568d-f423-4b9b-9f48-918168970037 tempest-VolumesCloneNegativeTest-659334463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d18dc6db-3037-4cd9-a27f-aa779a7a8126" returned: 0 in 0.257s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:16 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-573f568d-f423-4b9b-9f48-918168970037 tempest-VolumesCloneNegativeTest-659334463 None] Lock "cinder-quobyte-d18dc6db-3037-4cd9-a27f-aa779a7a8126" released by "delete_volume" :: held 0.737s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:02:16 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-573f568d-f423-4b9b-9f48-918168970037 tempest-VolumesCloneNegativeTest-659334463 None] Created reservations ['4f6096d3-4ec9-46fc-9139-1bbe0bfa377f', '107f941b-fd2b-432f-b6e8-95fd34ed9e90', 'a15ae9b3-4297-4889-9bc3-a062f468e244', '3358fde1-38f6-4f05-9ab0-7814998573f3'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:02:16 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-573f568d-f423-4b9b-9f48-918168970037 tempest-VolumesCloneNegativeTest-659334463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:16 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-573f568d-f423-4b9b-9f48-918168970037 tempest-VolumesCloneNegativeTest-659334463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:16 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-573f568d-f423-4b9b-9f48-918168970037 tempest-VolumesCloneNegativeTest-659334463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:02:16 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-573f568d-f423-4b9b-9f48-918168970037 tempest-VolumesCloneNegativeTest-659334463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:02:16 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-573f568d-f423-4b9b-9f48-918168970037 tempest-VolumesCloneNegativeTest-659334463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:16 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-573f568d-f423-4b9b-9f48-918168970037 tempest-VolumesCloneNegativeTest-659334463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:16 devstack sudo[102291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:02:16 devstack sudo[102291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:16 devstack sudo[102285]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:16 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7e58a4fb-cb31-46f1-8917-eeef0f2536e6 tempest-VolumesSnapshotListTestJSON-1001216880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4326973-e0b3-4417-b247-9b8966b384c6.67c18d67-f99b-4ded-a508-39bd6a08c55a -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.57bf7386-e8ee-497f-80ad-d67197f79ff2" returned: 0 in 0.343s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:16 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-7e58a4fb-cb31-46f1-8917-eeef0f2536e6 tempest-VolumesSnapshotListTestJSON-1001216880 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.57bf7386-e8ee-497f-80ad-d67197f79ff2 is being set with open permissions: ugo+rw Jul 30 17:02:16 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7e58a4fb-cb31-46f1-8917-eeef0f2536e6 tempest-VolumesSnapshotListTestJSON-1001216880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.57bf7386-e8ee-497f-80ad-d67197f79ff2 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:16 devstack sudo[102293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.57bf7386-e8ee-497f-80ad-d67197f79ff2 Jul 30 17:02:16 devstack sudo[102293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:16 devstack sudo[102291]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:16 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-573f568d-f423-4b9b-9f48-918168970037 tempest-VolumesCloneNegativeTest-659334463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.304s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:16 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-573f568d-f423-4b9b-9f48-918168970037 tempest-VolumesCloneNegativeTest-659334463 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:02:16 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-573f568d-f423-4b9b-9f48-918168970037 tempest-VolumesCloneNegativeTest-659334463 None] Deleted volume successfully. Jul 30 17:02:16 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-573f568d-f423-4b9b-9f48-918168970037 tempest-VolumesCloneNegativeTest-659334463 None] Lock "cinder-d18dc6db-3037-4cd9-a27f-aa779a7a8126-delete_volume" released by "delete_volume" :: held 1.311s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:02:16 devstack sudo[102293]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:16 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7e58a4fb-cb31-46f1-8917-eeef0f2536e6 tempest-VolumesSnapshotListTestJSON-1001216880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.57bf7386-e8ee-497f-80ad-d67197f79ff2" returned: 0 in 0.375s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:16 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-7e58a4fb-cb31-46f1-8917-eeef0f2536e6 tempest-VolumesSnapshotListTestJSON-1001216880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.811s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:16 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-7e58a4fb-cb31-46f1-8917-eeef0f2536e6 tempest-VolumesSnapshotListTestJSON-1001216880 None] Create snapshot completed successfully Jul 30 17:02:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-fcb05107-888e-4874-bdb2-74430be40ad9 tempest-VolumesSnapshotListTestJSON-1001216880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-fcb05107-888e-4874-bdb2-74430be40ad9 tempest-VolumesSnapshotListTestJSON-1001216880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:17 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-fcb05107-888e-4874-bdb2-74430be40ad9 tempest-VolumesSnapshotListTestJSON-1001216880 None] Creating offline snapshot 2a8b4f68-da87-47ff-91c4-2d7fa5401bdc of volume d4326973-e0b3-4417-b247-9b8966b384c6 {{(pid=88568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:02:17 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a45512-37a2-4d1a-84c3-284ab0ba9f5d]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:02:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fcb05107-888e-4874-bdb2-74430be40ad9 tempest-VolumesSnapshotListTestJSON-1001216880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.57bf7386-e8ee-497f-80ad-d67197f79ff2 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:17 devstack sudo[102297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.57bf7386-e8ee-497f-80ad-d67197f79ff2 Jul 30 17:02:17 devstack sudo[102297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:17 devstack sudo[102297]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fcb05107-888e-4874-bdb2-74430be40ad9 tempest-VolumesSnapshotListTestJSON-1001216880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.57bf7386-e8ee-497f-80ad-d67197f79ff2" returned: 0 in 0.409s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:17 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-fcb05107-888e-4874-bdb2-74430be40ad9 tempest-VolumesSnapshotListTestJSON-1001216880 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4326973-e0b3-4417-b247-9b8966b384c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:02:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fcb05107-888e-4874-bdb2-74430be40ad9 tempest-VolumesSnapshotListTestJSON-1001216880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.57bf7386-e8ee-497f-80ad-d67197f79ff2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.2a8b4f68-da87-47ff-91c4-2d7fa5401bdc 1G {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:17 devstack sudo[102302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.57bf7386-e8ee-497f-80ad-d67197f79ff2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.2a8b4f68-da87-47ff-91c4-2d7fa5401bdc 1G Jul 30 17:02:17 devstack sudo[102302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:18 devstack sudo[102302]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fcb05107-888e-4874-bdb2-74430be40ad9 tempest-VolumesSnapshotListTestJSON-1001216880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.57bf7386-e8ee-497f-80ad-d67197f79ff2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.2a8b4f68-da87-47ff-91c4-2d7fa5401bdc 1G" returned: 0 in 0.570s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fcb05107-888e-4874-bdb2-74430be40ad9 tempest-VolumesSnapshotListTestJSON-1001216880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4326973-e0b3-4417-b247-9b8966b384c6.57bf7386-e8ee-497f-80ad-d67197f79ff2 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.2a8b4f68-da87-47ff-91c4-2d7fa5401bdc {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:18 devstack sudo[102308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4326973-e0b3-4417-b247-9b8966b384c6.57bf7386-e8ee-497f-80ad-d67197f79ff2 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.2a8b4f68-da87-47ff-91c4-2d7fa5401bdc Jul 30 17:02:18 devstack sudo[102308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:18 devstack sudo[102308]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fcb05107-888e-4874-bdb2-74430be40ad9 tempest-VolumesSnapshotListTestJSON-1001216880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4326973-e0b3-4417-b247-9b8966b384c6.57bf7386-e8ee-497f-80ad-d67197f79ff2 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.2a8b4f68-da87-47ff-91c4-2d7fa5401bdc" returned: 0 in 0.346s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:18 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-fcb05107-888e-4874-bdb2-74430be40ad9 tempest-VolumesSnapshotListTestJSON-1001216880 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.2a8b4f68-da87-47ff-91c4-2d7fa5401bdc is being set with open permissions: ugo+rw Jul 30 17:02:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fcb05107-888e-4874-bdb2-74430be40ad9 tempest-VolumesSnapshotListTestJSON-1001216880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.2a8b4f68-da87-47ff-91c4-2d7fa5401bdc {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:18 devstack sudo[102313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.2a8b4f68-da87-47ff-91c4-2d7fa5401bdc Jul 30 17:02:18 devstack sudo[102313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:19 devstack sudo[102313]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:19 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fcb05107-888e-4874-bdb2-74430be40ad9 tempest-VolumesSnapshotListTestJSON-1001216880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.2a8b4f68-da87-47ff-91c4-2d7fa5401bdc" returned: 0 in 0.246s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:19 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-fcb05107-888e-4874-bdb2-74430be40ad9 tempest-VolumesSnapshotListTestJSON-1001216880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.686s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:19 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-fcb05107-888e-4874-bdb2-74430be40ad9 tempest-VolumesSnapshotListTestJSON-1001216880 None] Create snapshot completed successfully Jul 30 17:02:20 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-274cc510-f883-4486-b748-a58ccd9f7641 tempest-VolumesSnapshotListTestJSON-1001216880 None] Acquiring lock "cinder-2a8b4f68-da87-47ff-91c4-2d7fa5401bdc-delete_snapshot" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:02:20 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-274cc510-f883-4486-b748-a58ccd9f7641 tempest-VolumesSnapshotListTestJSON-1001216880 None] Lock "cinder-2a8b4f68-da87-47ff-91c4-2d7fa5401bdc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:02:20 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-274cc510-f883-4486-b748-a58ccd9f7641 tempest-VolumesSnapshotListTestJSON-1001216880 None] Acquiring lock "cinder-quobyte-d4326973-e0b3-4417-b247-9b8966b384c6" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:02:20 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-274cc510-f883-4486-b748-a58ccd9f7641 tempest-VolumesSnapshotListTestJSON-1001216880 None] Lock "cinder-quobyte-d4326973-e0b3-4417-b247-9b8966b384c6" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:02:20 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-274cc510-f883-4486-b748-a58ccd9f7641 tempest-VolumesSnapshotListTestJSON-1001216880 None] Acquiring lock "cinder-quobyte-2a8b4f68-da87-47ff-91c4-2d7fa5401bdc" by "_delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:02:20 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-274cc510-f883-4486-b748-a58ccd9f7641 tempest-VolumesSnapshotListTestJSON-1001216880 None] Lock "cinder-quobyte-2a8b4f68-da87-47ff-91c4-2d7fa5401bdc" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:02:20 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-274cc510-f883-4486-b748-a58ccd9f7641 tempest-VolumesSnapshotListTestJSON-1001216880 None] Deleting offline snapshot 2a8b4f68-da87-47ff-91c4-2d7fa5401bdc of volume d4326973-e0b3-4417-b247-9b8966b384c6 {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:02:20 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-274cc510-f883-4486-b748-a58ccd9f7641 tempest-VolumesSnapshotListTestJSON-1001216880 None] snapshot_file for this snap is: volume-d4326973-e0b3-4417-b247-9b8966b384c6.2a8b4f68-da87-47ff-91c4-2d7fa5401bdc {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:02:20 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47af453-1255-4aa4-ab72-9c35ff21fa0c]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:02:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-274cc510-f883-4486-b748-a58ccd9f7641 tempest-VolumesSnapshotListTestJSON-1001216880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.2a8b4f68-da87-47ff-91c4-2d7fa5401bdc {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:20 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-a246c352-5ec8-40bd-b80f-aba9f101acf7 tempest-ProjectReaderTests-551527553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:02:20 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a246c352-5ec8-40bd-b80f-aba9f101acf7 tempest-ProjectReaderTests-551527553 None] Flow 'volume_create_manager' (f203960f-cd2f-4104-ae76-cc3897acc7a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:02:20 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a246c352-5ec8-40bd-b80f-aba9f101acf7 tempest-ProjectReaderTests-551527553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ed68973-8557-4d50-a9da-4765923f6841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:20 devstack sudo[102316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.2a8b4f68-da87-47ff-91c4-2d7fa5401bdc Jul 30 17:02:20 devstack sudo[102316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:20 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a246c352-5ec8-40bd-b80f-aba9f101acf7 tempest-ProjectReaderTests-551527553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ed68973-8557-4d50-a9da-4765923f6841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:02:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1136732285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aff3e3cf-3845-4ad5-aa0c-0c317a26f390,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebd22fd1262f492aa7bc578dd78ee192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:02:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:02:20Z,use_quota=True,user_id='7f8ee5198de54d4e90f3b3c050efc2a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:20 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a246c352-5ec8-40bd-b80f-aba9f101acf7 tempest-ProjectReaderTests-551527553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a973fc7-8d6a-4355-b8e1-19961fa04494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:20 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a246c352-5ec8-40bd-b80f-aba9f101acf7 tempest-ProjectReaderTests-551527553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a973fc7-8d6a-4355-b8e1-19961fa04494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:20 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a246c352-5ec8-40bd-b80f-aba9f101acf7 tempest-ProjectReaderTests-551527553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0123681e-a282-4e37-a69b-67bca91747bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:20 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a246c352-5ec8-40bd-b80f-aba9f101acf7 tempest-ProjectReaderTests-551527553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0123681e-a282-4e37-a69b-67bca91747bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aff3e3cf-3845-4ad5-aa0c-0c317a26f390', 'volume_name': 'volume-aff3e3cf-3845-4ad5-aa0c-0c317a26f390', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:20 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a246c352-5ec8-40bd-b80f-aba9f101acf7 tempest-ProjectReaderTests-551527553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e9f7673-d487-48c3-aebf-aa3de5cefc8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:20 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a246c352-5ec8-40bd-b80f-aba9f101acf7 tempest-ProjectReaderTests-551527553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e9f7673-d487-48c3-aebf-aa3de5cefc8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:20 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a246c352-5ec8-40bd-b80f-aba9f101acf7 tempest-ProjectReaderTests-551527553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f4cc5c9-49e6-45a9-abf4-0218c2738c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:20 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-a246c352-5ec8-40bd-b80f-aba9f101acf7 tempest-ProjectReaderTests-551527553 None] Volume aff3e3cf-3845-4ad5-aa0c-0c317a26f390: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aff3e3cf-3845-4ad5-aa0c-0c317a26f390', 'volume_size': 1} Jul 30 17:02:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a246c352-5ec8-40bd-b80f-aba9f101acf7 tempest-ProjectReaderTests-551527553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a246c352-5ec8-40bd-b80f-aba9f101acf7 tempest-ProjectReaderTests-551527553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:20 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-a246c352-5ec8-40bd-b80f-aba9f101acf7 tempest-ProjectReaderTests-551527553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:02:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1136732285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aff3e3cf-3845-4ad5-aa0c-0c317a26f390,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebd22fd1262f492aa7bc578dd78ee192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:02:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:02:20Z,use_quota=True,user_id='7f8ee5198de54d4e90f3b3c050efc2a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:02:20 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-a246c352-5ec8-40bd-b80f-aba9f101acf7 tempest-ProjectReaderTests-551527553 None] Creating volume aff3e3cf-3845-4ad5-aa0c-0c317a26f390 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:02:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a246c352-5ec8-40bd-b80f-aba9f101acf7 tempest-ProjectReaderTests-551527553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a246c352-5ec8-40bd-b80f-aba9f101acf7 tempest-ProjectReaderTests-551527553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:20 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-a246c352-5ec8-40bd-b80f-aba9f101acf7 tempest-ProjectReaderTests-551527553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:02:20 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-a246c352-5ec8-40bd-b80f-aba9f101acf7 tempest-ProjectReaderTests-551527553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:02:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a246c352-5ec8-40bd-b80f-aba9f101acf7 tempest-ProjectReaderTests-551527553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:20 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-a246c352-5ec8-40bd-b80f-aba9f101acf7 tempest-ProjectReaderTests-551527553 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:02:20 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-a246c352-5ec8-40bd-b80f-aba9f101acf7 tempest-ProjectReaderTests-551527553 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:02:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a246c352-5ec8-40bd-b80f-aba9f101acf7 tempest-ProjectReaderTests-551527553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-aff3e3cf-3845-4ad5-aa0c-0c317a26f390 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:20 devstack sudo[102318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-aff3e3cf-3845-4ad5-aa0c-0c317a26f390 1073741824 Jul 30 17:02:20 devstack sudo[102318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:20 devstack sudo[102316]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-274cc510-f883-4486-b748-a58ccd9f7641 tempest-VolumesSnapshotListTestJSON-1001216880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.2a8b4f68-da87-47ff-91c4-2d7fa5401bdc" returned: 0 in 0.439s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:20 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-274cc510-f883-4486-b748-a58ccd9f7641 tempest-VolumesSnapshotListTestJSON-1001216880 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4326973-e0b3-4417-b247-9b8966b384c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:02:20 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c058c0-105a-4081-967b-c7fe80d007bb]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:02:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-274cc510-f883-4486-b748-a58ccd9f7641 tempest-VolumesSnapshotListTestJSON-1001216880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.57bf7386-e8ee-497f-80ad-d67197f79ff2 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:21 devstack sudo[102325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.57bf7386-e8ee-497f-80ad-d67197f79ff2 Jul 30 17:02:21 devstack sudo[102325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:21 devstack sudo[102318]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:21 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a246c352-5ec8-40bd-b80f-aba9f101acf7 tempest-ProjectReaderTests-551527553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-aff3e3cf-3845-4ad5-aa0c-0c317a26f390 1073741824" returned: 0 in 0.534s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:21 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a246c352-5ec8-40bd-b80f-aba9f101acf7 tempest-ProjectReaderTests-551527553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-aff3e3cf-3845-4ad5-aa0c-0c317a26f390 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:21 devstack sudo[102329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-aff3e3cf-3845-4ad5-aa0c-0c317a26f390 Jul 30 17:02:21 devstack sudo[102329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:21 devstack sudo[102325]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:21 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-274cc510-f883-4486-b748-a58ccd9f7641 tempest-VolumesSnapshotListTestJSON-1001216880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.57bf7386-e8ee-497f-80ad-d67197f79ff2" returned: 0 in 0.392s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:21 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-274cc510-f883-4486-b748-a58ccd9f7641 tempest-VolumesSnapshotListTestJSON-1001216880 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4326973-e0b3-4417-b247-9b8966b384c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:02:21 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-274cc510-f883-4486-b748-a58ccd9f7641 tempest-VolumesSnapshotListTestJSON-1001216880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.2a8b4f68-da87-47ff-91c4-2d7fa5401bdc {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:21 devstack sudo[102334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.2a8b4f68-da87-47ff-91c4-2d7fa5401bdc Jul 30 17:02:21 devstack sudo[102334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:21 devstack sudo[102329]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:21 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a246c352-5ec8-40bd-b80f-aba9f101acf7 tempest-ProjectReaderTests-551527553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-aff3e3cf-3845-4ad5-aa0c-0c317a26f390" returned: 0 in 0.271s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:21 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-a246c352-5ec8-40bd-b80f-aba9f101acf7 tempest-ProjectReaderTests-551527553 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:02:21 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a246c352-5ec8-40bd-b80f-aba9f101acf7 tempest-ProjectReaderTests-551527553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:21 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a246c352-5ec8-40bd-b80f-aba9f101acf7 tempest-ProjectReaderTests-551527553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f4cc5c9-49e6-45a9-abf4-0218c2738c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aff3e3cf-3845-4ad5-aa0c-0c317a26f390', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:21 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a246c352-5ec8-40bd-b80f-aba9f101acf7 tempest-ProjectReaderTests-551527553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa600fad-5307-4182-b1a4-e77026b6b6d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:21 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-a246c352-5ec8-40bd-b80f-aba9f101acf7 tempest-ProjectReaderTests-551527553 None] Volume volume-aff3e3cf-3845-4ad5-aa0c-0c317a26f390 (aff3e3cf-3845-4ad5-aa0c-0c317a26f390): created successfully Jul 30 17:02:21 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a246c352-5ec8-40bd-b80f-aba9f101acf7 tempest-ProjectReaderTests-551527553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa600fad-5307-4182-b1a4-e77026b6b6d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:21 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a246c352-5ec8-40bd-b80f-aba9f101acf7 tempest-ProjectReaderTests-551527553 None] Flow 'volume_create_manager' (f203960f-cd2f-4104-ae76-cc3897acc7a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:02:21 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-a246c352-5ec8-40bd-b80f-aba9f101acf7 tempest-ProjectReaderTests-551527553 None] Created volume successfully. Jul 30 17:02:21 devstack sudo[102334]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:21 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-274cc510-f883-4486-b748-a58ccd9f7641 tempest-VolumesSnapshotListTestJSON-1001216880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.2a8b4f68-da87-47ff-91c4-2d7fa5401bdc" returned: 0 in 0.466s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:21 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-274cc510-f883-4486-b748-a58ccd9f7641 tempest-VolumesSnapshotListTestJSON-1001216880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.2a8b4f68-da87-47ff-91c4-2d7fa5401bdc {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:21 devstack sudo[102341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.2a8b4f68-da87-47ff-91c4-2d7fa5401bdc Jul 30 17:02:21 devstack sudo[102341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:22 devstack sudo[102341]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:22 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-274cc510-f883-4486-b748-a58ccd9f7641 tempest-VolumesSnapshotListTestJSON-1001216880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.2a8b4f68-da87-47ff-91c4-2d7fa5401bdc" returned: 0 in 0.274s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:22 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-274cc510-f883-4486-b748-a58ccd9f7641 tempest-VolumesSnapshotListTestJSON-1001216880 None] Lock "cinder-quobyte-2a8b4f68-da87-47ff-91c4-2d7fa5401bdc" released by "_delete_snapshot" :: held 1.676s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:02:22 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-274cc510-f883-4486-b748-a58ccd9f7641 tempest-VolumesSnapshotListTestJSON-1001216880 None] Lock "cinder-quobyte-d4326973-e0b3-4417-b247-9b8966b384c6" released by "delete_snapshot" :: held 1.701s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:02:22 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-274cc510-f883-4486-b748-a58ccd9f7641 tempest-VolumesSnapshotListTestJSON-1001216880 None] Created reservations ['46c34c1f-b0cf-4c09-8aba-7a2b5737a084', '8e358206-eb30-4cfb-9e4e-6fafe1f790fc', '91e1eff1-e441-4347-9bf8-0b9e15e6f4e1', '10204642-ea64-4470-b025-1d03b1aec89b'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:02:22 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-274cc510-f883-4486-b748-a58ccd9f7641 tempest-VolumesSnapshotListTestJSON-1001216880 None] Delete snapshot completed successfully. Jul 30 17:02:22 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-274cc510-f883-4486-b748-a58ccd9f7641 tempest-VolumesSnapshotListTestJSON-1001216880 None] Lock "cinder-2a8b4f68-da87-47ff-91c4-2d7fa5401bdc-delete_snapshot" released by "delete_snapshot" :: held 1.849s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:02:22 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-50eb42bf-be83-4b1d-9577-704d92e69ffe tempest-VolumesSnapshotListTestJSON-1001216880 None] Acquiring lock "cinder-57bf7386-e8ee-497f-80ad-d67197f79ff2-delete_snapshot" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:02:22 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-50eb42bf-be83-4b1d-9577-704d92e69ffe tempest-VolumesSnapshotListTestJSON-1001216880 None] Lock "cinder-57bf7386-e8ee-497f-80ad-d67197f79ff2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:02:22 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-50eb42bf-be83-4b1d-9577-704d92e69ffe tempest-VolumesSnapshotListTestJSON-1001216880 None] Acquiring lock "cinder-quobyte-d4326973-e0b3-4417-b247-9b8966b384c6" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:02:22 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-50eb42bf-be83-4b1d-9577-704d92e69ffe tempest-VolumesSnapshotListTestJSON-1001216880 None] Lock "cinder-quobyte-d4326973-e0b3-4417-b247-9b8966b384c6" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:02:22 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-50eb42bf-be83-4b1d-9577-704d92e69ffe tempest-VolumesSnapshotListTestJSON-1001216880 None] Acquiring lock "cinder-quobyte-57bf7386-e8ee-497f-80ad-d67197f79ff2" by "_delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:02:22 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-50eb42bf-be83-4b1d-9577-704d92e69ffe tempest-VolumesSnapshotListTestJSON-1001216880 None] Lock "cinder-quobyte-57bf7386-e8ee-497f-80ad-d67197f79ff2" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:02:22 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-50eb42bf-be83-4b1d-9577-704d92e69ffe tempest-VolumesSnapshotListTestJSON-1001216880 None] Deleting offline snapshot 57bf7386-e8ee-497f-80ad-d67197f79ff2 of volume d4326973-e0b3-4417-b247-9b8966b384c6 {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:02:22 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-50eb42bf-be83-4b1d-9577-704d92e69ffe tempest-VolumesSnapshotListTestJSON-1001216880 None] snapshot_file for this snap is: volume-d4326973-e0b3-4417-b247-9b8966b384c6.57bf7386-e8ee-497f-80ad-d67197f79ff2 {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:02:22 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[2efd4600-5fad-4175-9446-e4b054a06af7]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:02:22 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-50eb42bf-be83-4b1d-9577-704d92e69ffe tempest-VolumesSnapshotListTestJSON-1001216880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.57bf7386-e8ee-497f-80ad-d67197f79ff2 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:22 devstack sudo[102344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.57bf7386-e8ee-497f-80ad-d67197f79ff2 Jul 30 17:02:22 devstack sudo[102344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:22 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-578128f9-502a-45dc-b854-7bcd2794caad tempest-ProjectReaderTests-551527553 None] Acquiring lock "cinder-aff3e3cf-3845-4ad5-aa0c-0c317a26f390-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:02:22 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-578128f9-502a-45dc-b854-7bcd2794caad tempest-ProjectReaderTests-551527553 None] Lock "cinder-aff3e3cf-3845-4ad5-aa0c-0c317a26f390-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:02:22 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-578128f9-502a-45dc-b854-7bcd2794caad tempest-ProjectReaderTests-551527553 None] Acquiring lock "cinder-quobyte-aff3e3cf-3845-4ad5-aa0c-0c317a26f390" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:02:22 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-578128f9-502a-45dc-b854-7bcd2794caad tempest-ProjectReaderTests-551527553 None] Lock "cinder-quobyte-aff3e3cf-3845-4ad5-aa0c-0c317a26f390" acquired by "delete_volume" :: waited 0.020s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:02:22 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[86cc4c21-5e37-45f0-bdee-7f7d15e6443b]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:02:22 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-578128f9-502a-45dc-b854-7bcd2794caad tempest-ProjectReaderTests-551527553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-aff3e3cf-3845-4ad5-aa0c-0c317a26f390 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:23 devstack sudo[102344]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:23 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-50eb42bf-be83-4b1d-9577-704d92e69ffe tempest-VolumesSnapshotListTestJSON-1001216880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.57bf7386-e8ee-497f-80ad-d67197f79ff2" returned: 0 in 0.431s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:23 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-50eb42bf-be83-4b1d-9577-704d92e69ffe tempest-VolumesSnapshotListTestJSON-1001216880 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4326973-e0b3-4417-b247-9b8966b384c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:02:23 devstack sudo[102346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-aff3e3cf-3845-4ad5-aa0c-0c317a26f390 Jul 30 17:02:23 devstack sudo[102346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:23 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc57b62-21ae-4b58-aa5b-86c06fb7677c]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:02:23 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-50eb42bf-be83-4b1d-9577-704d92e69ffe tempest-VolumesSnapshotListTestJSON-1001216880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.67c18d67-f99b-4ded-a508-39bd6a08c55a {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:23 devstack sudo[102351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.67c18d67-f99b-4ded-a508-39bd6a08c55a Jul 30 17:02:23 devstack sudo[102351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:23 devstack sudo[102346]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:23 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-578128f9-502a-45dc-b854-7bcd2794caad tempest-ProjectReaderTests-551527553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-aff3e3cf-3845-4ad5-aa0c-0c317a26f390" returned: 0 in 0.403s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:23 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-578128f9-502a-45dc-b854-7bcd2794caad tempest-ProjectReaderTests-551527553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-aff3e3cf-3845-4ad5-aa0c-0c317a26f390 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:23 devstack sudo[102357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-aff3e3cf-3845-4ad5-aa0c-0c317a26f390 Jul 30 17:02:23 devstack sudo[102357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:23 devstack sudo[102351]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:23 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-50eb42bf-be83-4b1d-9577-704d92e69ffe tempest-VolumesSnapshotListTestJSON-1001216880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.67c18d67-f99b-4ded-a508-39bd6a08c55a" returned: 0 in 0.426s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:23 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-50eb42bf-be83-4b1d-9577-704d92e69ffe tempest-VolumesSnapshotListTestJSON-1001216880 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4326973-e0b3-4417-b247-9b8966b384c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:02:23 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-50eb42bf-be83-4b1d-9577-704d92e69ffe tempest-VolumesSnapshotListTestJSON-1001216880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.57bf7386-e8ee-497f-80ad-d67197f79ff2 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:23 devstack sudo[102362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.57bf7386-e8ee-497f-80ad-d67197f79ff2 Jul 30 17:02:23 devstack sudo[102362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:23 devstack sudo[102357]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:23 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-578128f9-502a-45dc-b854-7bcd2794caad tempest-ProjectReaderTests-551527553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-aff3e3cf-3845-4ad5-aa0c-0c317a26f390" returned: 0 in 0.279s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:23 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-578128f9-502a-45dc-b854-7bcd2794caad tempest-ProjectReaderTests-551527553 None] Lock "cinder-quobyte-aff3e3cf-3845-4ad5-aa0c-0c317a26f390" released by "delete_volume" :: held 0.729s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:02:23 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-578128f9-502a-45dc-b854-7bcd2794caad tempest-ProjectReaderTests-551527553 None] Created reservations ['b9602e8f-19b2-4397-b262-9af4444d25f1', '8c66c669-d538-4873-9a6d-609d2539f287', '9ef97489-6653-4ef2-a602-28f5ef4bc917', '5bb8cefb-e4cb-4181-8292-21b50901b8f7'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:02:23 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-578128f9-502a-45dc-b854-7bcd2794caad tempest-ProjectReaderTests-551527553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:23 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-578128f9-502a-45dc-b854-7bcd2794caad tempest-ProjectReaderTests-551527553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:23 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-578128f9-502a-45dc-b854-7bcd2794caad tempest-ProjectReaderTests-551527553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:02:23 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-578128f9-502a-45dc-b854-7bcd2794caad tempest-ProjectReaderTests-551527553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:02:23 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-578128f9-502a-45dc-b854-7bcd2794caad tempest-ProjectReaderTests-551527553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:23 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-578128f9-502a-45dc-b854-7bcd2794caad tempest-ProjectReaderTests-551527553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:23 devstack sudo[102367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:02:23 devstack sudo[102367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:23 devstack sudo[102362]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:23 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-50eb42bf-be83-4b1d-9577-704d92e69ffe tempest-VolumesSnapshotListTestJSON-1001216880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.57bf7386-e8ee-497f-80ad-d67197f79ff2" returned: 0 in 0.454s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-50eb42bf-be83-4b1d-9577-704d92e69ffe tempest-VolumesSnapshotListTestJSON-1001216880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.57bf7386-e8ee-497f-80ad-d67197f79ff2 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:24 devstack sudo[102370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.57bf7386-e8ee-497f-80ad-d67197f79ff2 Jul 30 17:02:24 devstack sudo[102370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:24 devstack sudo[102367]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-578128f9-502a-45dc-b854-7bcd2794caad tempest-ProjectReaderTests-551527553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.283s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:24 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-578128f9-502a-45dc-b854-7bcd2794caad tempest-ProjectReaderTests-551527553 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:02:24 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-578128f9-502a-45dc-b854-7bcd2794caad tempest-ProjectReaderTests-551527553 None] Deleted volume successfully. Jul 30 17:02:24 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-578128f9-502a-45dc-b854-7bcd2794caad tempest-ProjectReaderTests-551527553 None] Lock "cinder-aff3e3cf-3845-4ad5-aa0c-0c317a26f390-delete_volume" released by "delete_volume" :: held 1.239s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:02:24 devstack sudo[102370]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-50eb42bf-be83-4b1d-9577-704d92e69ffe tempest-VolumesSnapshotListTestJSON-1001216880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.57bf7386-e8ee-497f-80ad-d67197f79ff2" returned: 0 in 0.344s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:24 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-50eb42bf-be83-4b1d-9577-704d92e69ffe tempest-VolumesSnapshotListTestJSON-1001216880 None] Lock "cinder-quobyte-57bf7386-e8ee-497f-80ad-d67197f79ff2" released by "_delete_snapshot" :: held 1.834s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:02:24 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-50eb42bf-be83-4b1d-9577-704d92e69ffe tempest-VolumesSnapshotListTestJSON-1001216880 None] Lock "cinder-quobyte-d4326973-e0b3-4417-b247-9b8966b384c6" released by "delete_snapshot" :: held 1.874s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:02:24 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-50eb42bf-be83-4b1d-9577-704d92e69ffe tempest-VolumesSnapshotListTestJSON-1001216880 None] Created reservations ['a79b8ec7-5258-4978-83db-3695b30d265d', '6cdd0c9e-df28-4951-8fdd-eb1063615390', '78afcfc4-0547-41ca-b391-10c65a0fe882', '5c34e1be-0e95-4422-b51d-2c9c2b810bdd'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:02:24 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-50eb42bf-be83-4b1d-9577-704d92e69ffe tempest-VolumesSnapshotListTestJSON-1001216880 None] Delete snapshot completed successfully. Jul 30 17:02:24 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-50eb42bf-be83-4b1d-9577-704d92e69ffe tempest-VolumesSnapshotListTestJSON-1001216880 None] Lock "cinder-57bf7386-e8ee-497f-80ad-d67197f79ff2-delete_snapshot" released by "delete_snapshot" :: held 2.129s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:02:24 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-71f80cad-d73b-4494-a60f-0d7c41df6684 tempest-VolumesSnapshotListTestJSON-1001216880 None] Acquiring lock "cinder-67c18d67-f99b-4ded-a508-39bd6a08c55a-delete_snapshot" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:02:24 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-71f80cad-d73b-4494-a60f-0d7c41df6684 tempest-VolumesSnapshotListTestJSON-1001216880 None] Lock "cinder-67c18d67-f99b-4ded-a508-39bd6a08c55a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:02:24 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-71f80cad-d73b-4494-a60f-0d7c41df6684 tempest-VolumesSnapshotListTestJSON-1001216880 None] Acquiring lock "cinder-quobyte-d4326973-e0b3-4417-b247-9b8966b384c6" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:02:24 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-8832c882-5db4-497a-a45a-b22e6460b1d8 tempest-ProjectReaderTests-551527553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:02:24 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8832c882-5db4-497a-a45a-b22e6460b1d8 tempest-ProjectReaderTests-551527553 None] Flow 'volume_create_manager' (fb665de2-f57c-4ab8-b02c-a839f46ae07b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:02:24 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8832c882-5db4-497a-a45a-b22e6460b1d8 tempest-ProjectReaderTests-551527553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc98f8ab-eb56-4029-acc2-39a001c3c0ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:24 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8832c882-5db4-497a-a45a-b22e6460b1d8 tempest-ProjectReaderTests-551527553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc98f8ab-eb56-4029-acc2-39a001c3c0ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:02:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1118009881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e649d41b-de95-434a-a219-e033883469e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebd22fd1262f492aa7bc578dd78ee192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:02:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:02:25Z,use_quota=True,user_id='7f8ee5198de54d4e90f3b3c050efc2a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:24 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8832c882-5db4-497a-a45a-b22e6460b1d8 tempest-ProjectReaderTests-551527553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5eb35e9f-903c-4ba6-a0af-fdd4c3184b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:24 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8832c882-5db4-497a-a45a-b22e6460b1d8 tempest-ProjectReaderTests-551527553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5eb35e9f-903c-4ba6-a0af-fdd4c3184b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:24 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8832c882-5db4-497a-a45a-b22e6460b1d8 tempest-ProjectReaderTests-551527553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8e87bec-92f2-4abc-8c99-4d1304c17295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:24 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8832c882-5db4-497a-a45a-b22e6460b1d8 tempest-ProjectReaderTests-551527553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8e87bec-92f2-4abc-8c99-4d1304c17295) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e649d41b-de95-434a-a219-e033883469e3', 'volume_name': 'volume-e649d41b-de95-434a-a219-e033883469e3', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:24 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8832c882-5db4-497a-a45a-b22e6460b1d8 tempest-ProjectReaderTests-551527553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79b80a86-d99f-4e7b-beef-183a65b7af91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:24 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8832c882-5db4-497a-a45a-b22e6460b1d8 tempest-ProjectReaderTests-551527553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79b80a86-d99f-4e7b-beef-183a65b7af91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:24 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8832c882-5db4-497a-a45a-b22e6460b1d8 tempest-ProjectReaderTests-551527553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a783771c-e48b-4580-a42e-8c305e79bea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:24 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-8832c882-5db4-497a-a45a-b22e6460b1d8 tempest-ProjectReaderTests-551527553 None] Volume e649d41b-de95-434a-a219-e033883469e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e649d41b-de95-434a-a219-e033883469e3', 'volume_size': 1} Jul 30 17:02:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-8832c882-5db4-497a-a45a-b22e6460b1d8 tempest-ProjectReaderTests-551527553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-8832c882-5db4-497a-a45a-b22e6460b1d8 tempest-ProjectReaderTests-551527553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:24 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-8832c882-5db4-497a-a45a-b22e6460b1d8 tempest-ProjectReaderTests-551527553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:02:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1118009881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e649d41b-de95-434a-a219-e033883469e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebd22fd1262f492aa7bc578dd78ee192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:02:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:02:25Z,use_quota=True,user_id='7f8ee5198de54d4e90f3b3c050efc2a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:02:24 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-8832c882-5db4-497a-a45a-b22e6460b1d8 tempest-ProjectReaderTests-551527553 None] Creating volume e649d41b-de95-434a-a219-e033883469e3 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:02:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-8832c882-5db4-497a-a45a-b22e6460b1d8 tempest-ProjectReaderTests-551527553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-8832c882-5db4-497a-a45a-b22e6460b1d8 tempest-ProjectReaderTests-551527553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:24 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-8832c882-5db4-497a-a45a-b22e6460b1d8 tempest-ProjectReaderTests-551527553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:02:24 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-8832c882-5db4-497a-a45a-b22e6460b1d8 tempest-ProjectReaderTests-551527553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:02:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-8832c882-5db4-497a-a45a-b22e6460b1d8 tempest-ProjectReaderTests-551527553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:24 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-8832c882-5db4-497a-a45a-b22e6460b1d8 tempest-ProjectReaderTests-551527553 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:02:24 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-8832c882-5db4-497a-a45a-b22e6460b1d8 tempest-ProjectReaderTests-551527553 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:02:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8832c882-5db4-497a-a45a-b22e6460b1d8 tempest-ProjectReaderTests-551527553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e649d41b-de95-434a-a219-e033883469e3 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:24 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-71f80cad-d73b-4494-a60f-0d7c41df6684 tempest-VolumesSnapshotListTestJSON-1001216880 None] Lock "cinder-quobyte-d4326973-e0b3-4417-b247-9b8966b384c6" acquired by "delete_snapshot" :: waited 0.115s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:02:24 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-71f80cad-d73b-4494-a60f-0d7c41df6684 tempest-VolumesSnapshotListTestJSON-1001216880 None] Acquiring lock "cinder-quobyte-67c18d67-f99b-4ded-a508-39bd6a08c55a" by "_delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:02:24 devstack sudo[102375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e649d41b-de95-434a-a219-e033883469e3 1073741824 Jul 30 17:02:24 devstack sudo[102375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:24 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-71f80cad-d73b-4494-a60f-0d7c41df6684 tempest-VolumesSnapshotListTestJSON-1001216880 None] Lock "cinder-quobyte-67c18d67-f99b-4ded-a508-39bd6a08c55a" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:02:24 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-71f80cad-d73b-4494-a60f-0d7c41df6684 tempest-VolumesSnapshotListTestJSON-1001216880 None] Deleting offline snapshot 67c18d67-f99b-4ded-a508-39bd6a08c55a of volume d4326973-e0b3-4417-b247-9b8966b384c6 {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:02:24 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-71f80cad-d73b-4494-a60f-0d7c41df6684 tempest-VolumesSnapshotListTestJSON-1001216880 None] snapshot_file for this snap is: volume-d4326973-e0b3-4417-b247-9b8966b384c6.67c18d67-f99b-4ded-a508-39bd6a08c55a {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:02:24 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ced95a-f9a8-4547-bd53-88e41a24c8d5]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:02:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-71f80cad-d73b-4494-a60f-0d7c41df6684 tempest-VolumesSnapshotListTestJSON-1001216880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.67c18d67-f99b-4ded-a508-39bd6a08c55a {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:25 devstack sudo[102377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.67c18d67-f99b-4ded-a508-39bd6a08c55a Jul 30 17:02:25 devstack sudo[102377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:25 devstack sudo[102375]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:25 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8832c882-5db4-497a-a45a-b22e6460b1d8 tempest-ProjectReaderTests-551527553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e649d41b-de95-434a-a219-e033883469e3 1073741824" returned: 0 in 0.516s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:25 devstack sudo[102377]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:25 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-71f80cad-d73b-4494-a60f-0d7c41df6684 tempest-VolumesSnapshotListTestJSON-1001216880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.67c18d67-f99b-4ded-a508-39bd6a08c55a" returned: 0 in 0.457s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:25 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-71f80cad-d73b-4494-a60f-0d7c41df6684 tempest-VolumesSnapshotListTestJSON-1001216880 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4326973-e0b3-4417-b247-9b8966b384c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:02:25 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bbbf57c-fded-4c1a-87e2-5aac9ebbfda4]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:02:25 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-71f80cad-d73b-4494-a60f-0d7c41df6684 tempest-VolumesSnapshotListTestJSON-1001216880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:25 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8832c882-5db4-497a-a45a-b22e6460b1d8 tempest-ProjectReaderTests-551527553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e649d41b-de95-434a-a219-e033883469e3 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:25 devstack sudo[102388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e649d41b-de95-434a-a219-e033883469e3 Jul 30 17:02:25 devstack sudo[102388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:25 devstack sudo[102387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6 Jul 30 17:02:25 devstack sudo[102387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:25 devstack sudo[102388]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:25 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8832c882-5db4-497a-a45a-b22e6460b1d8 tempest-ProjectReaderTests-551527553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e649d41b-de95-434a-a219-e033883469e3" returned: 0 in 0.322s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:25 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-8832c882-5db4-497a-a45a-b22e6460b1d8 tempest-ProjectReaderTests-551527553 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:02:25 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-8832c882-5db4-497a-a45a-b22e6460b1d8 tempest-ProjectReaderTests-551527553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:25 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8832c882-5db4-497a-a45a-b22e6460b1d8 tempest-ProjectReaderTests-551527553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a783771c-e48b-4580-a42e-8c305e79bea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e649d41b-de95-434a-a219-e033883469e3', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:25 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8832c882-5db4-497a-a45a-b22e6460b1d8 tempest-ProjectReaderTests-551527553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bf68a65-a3ff-4ba9-8983-f718d90894e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:25 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-8832c882-5db4-497a-a45a-b22e6460b1d8 tempest-ProjectReaderTests-551527553 None] Volume volume-e649d41b-de95-434a-a219-e033883469e3 (e649d41b-de95-434a-a219-e033883469e3): created successfully Jul 30 17:02:25 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8832c882-5db4-497a-a45a-b22e6460b1d8 tempest-ProjectReaderTests-551527553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bf68a65-a3ff-4ba9-8983-f718d90894e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:25 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8832c882-5db4-497a-a45a-b22e6460b1d8 tempest-ProjectReaderTests-551527553 None] Flow 'volume_create_manager' (fb665de2-f57c-4ab8-b02c-a839f46ae07b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:02:25 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-8832c882-5db4-497a-a45a-b22e6460b1d8 tempest-ProjectReaderTests-551527553 None] Created volume successfully. Jul 30 17:02:25 devstack sudo[102387]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-71f80cad-d73b-4494-a60f-0d7c41df6684 tempest-VolumesSnapshotListTestJSON-1001216880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6" returned: 0 in 0.524s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-71f80cad-d73b-4494-a60f-0d7c41df6684 tempest-VolumesSnapshotListTestJSON-1001216880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.67c18d67-f99b-4ded-a508-39bd6a08c55a {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:26 devstack sudo[102395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.67c18d67-f99b-4ded-a508-39bd6a08c55a Jul 30 17:02:26 devstack sudo[102395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:26 devstack sudo[102395]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-71f80cad-d73b-4494-a60f-0d7c41df6684 tempest-VolumesSnapshotListTestJSON-1001216880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.67c18d67-f99b-4ded-a508-39bd6a08c55a" returned: 0 in 0.423s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-71f80cad-d73b-4494-a60f-0d7c41df6684 tempest-VolumesSnapshotListTestJSON-1001216880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.67c18d67-f99b-4ded-a508-39bd6a08c55a {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:26 devstack sudo[102401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.67c18d67-f99b-4ded-a508-39bd6a08c55a Jul 30 17:02:26 devstack sudo[102401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:26 devstack sudo[102401]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-71f80cad-d73b-4494-a60f-0d7c41df6684 tempest-VolumesSnapshotListTestJSON-1001216880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6.67c18d67-f99b-4ded-a508-39bd6a08c55a" returned: 0 in 0.337s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:26 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-71f80cad-d73b-4494-a60f-0d7c41df6684 tempest-VolumesSnapshotListTestJSON-1001216880 None] Lock "cinder-quobyte-67c18d67-f99b-4ded-a508-39bd6a08c55a" released by "_delete_snapshot" :: held 1.904s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:02:26 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-71f80cad-d73b-4494-a60f-0d7c41df6684 tempest-VolumesSnapshotListTestJSON-1001216880 None] Lock "cinder-quobyte-d4326973-e0b3-4417-b247-9b8966b384c6" released by "delete_snapshot" :: held 1.939s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:02:26 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-8da826e1-5536-4b95-a6f0-43de80834a64 tempest-ProjectReaderTests-551527553 None] Acquiring lock "cinder-e649d41b-de95-434a-a219-e033883469e3-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:02:26 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-8da826e1-5536-4b95-a6f0-43de80834a64 tempest-ProjectReaderTests-551527553 None] Lock "cinder-e649d41b-de95-434a-a219-e033883469e3-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:02:26 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-71f80cad-d73b-4494-a60f-0d7c41df6684 tempest-VolumesSnapshotListTestJSON-1001216880 None] Created reservations ['01fd383b-13ae-4267-8b73-316428d98a27', '2bec194b-f184-4d7f-bcc0-e379ea2dcb8a', '4195d104-91f9-482a-a34a-64bbfe386223', 'cfbd49ad-114b-4800-8595-4fff45b87067'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:02:26 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-8da826e1-5536-4b95-a6f0-43de80834a64 tempest-ProjectReaderTests-551527553 None] Acquiring lock "cinder-quobyte-e649d41b-de95-434a-a219-e033883469e3" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:02:27 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-8da826e1-5536-4b95-a6f0-43de80834a64 tempest-ProjectReaderTests-551527553 None] Lock "cinder-quobyte-e649d41b-de95-434a-a219-e033883469e3" acquired by "delete_volume" :: waited 0.021s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:02:27 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc53b71-25bf-44c0-95d9-05cb4ee3a2a4]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:02:27 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8da826e1-5536-4b95-a6f0-43de80834a64 tempest-ProjectReaderTests-551527553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e649d41b-de95-434a-a219-e033883469e3 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:27 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-71f80cad-d73b-4494-a60f-0d7c41df6684 tempest-VolumesSnapshotListTestJSON-1001216880 None] Delete snapshot completed successfully. Jul 30 17:02:27 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-71f80cad-d73b-4494-a60f-0d7c41df6684 tempest-VolumesSnapshotListTestJSON-1001216880 None] Lock "cinder-67c18d67-f99b-4ded-a508-39bd6a08c55a-delete_snapshot" released by "delete_snapshot" :: held 2.344s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:02:27 devstack sudo[102404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e649d41b-de95-434a-a219-e033883469e3 Jul 30 17:02:27 devstack sudo[102404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:27 devstack sudo[102404]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:27 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8da826e1-5536-4b95-a6f0-43de80834a64 tempest-ProjectReaderTests-551527553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e649d41b-de95-434a-a219-e033883469e3" returned: 0 in 0.425s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:27 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8da826e1-5536-4b95-a6f0-43de80834a64 tempest-ProjectReaderTests-551527553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e649d41b-de95-434a-a219-e033883469e3 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:27 devstack sudo[102409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e649d41b-de95-434a-a219-e033883469e3 Jul 30 17:02:27 devstack sudo[102409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:27 devstack sudo[102409]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:27 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8da826e1-5536-4b95-a6f0-43de80834a64 tempest-ProjectReaderTests-551527553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e649d41b-de95-434a-a219-e033883469e3" returned: 0 in 0.268s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:27 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-8da826e1-5536-4b95-a6f0-43de80834a64 tempest-ProjectReaderTests-551527553 None] Lock "cinder-quobyte-e649d41b-de95-434a-a219-e033883469e3" released by "delete_volume" :: held 0.754s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:02:27 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-8da826e1-5536-4b95-a6f0-43de80834a64 tempest-ProjectReaderTests-551527553 None] Created reservations ['07f21a81-bb7a-4c82-9ed8-67dbd022c3df', '85846d65-f080-4b2e-9735-f620ae3f9cf2', 'db9cedbd-6087-4caf-bb9f-f568565ae239', 'c9ae46a8-3cca-423a-bda1-b751f5233bd4'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:02:27 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-8da826e1-5536-4b95-a6f0-43de80834a64 tempest-ProjectReaderTests-551527553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:27 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-8da826e1-5536-4b95-a6f0-43de80834a64 tempest-ProjectReaderTests-551527553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:27 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-8da826e1-5536-4b95-a6f0-43de80834a64 tempest-ProjectReaderTests-551527553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:02:27 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-8da826e1-5536-4b95-a6f0-43de80834a64 tempest-ProjectReaderTests-551527553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:02:27 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-8da826e1-5536-4b95-a6f0-43de80834a64 tempest-ProjectReaderTests-551527553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:27 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8da826e1-5536-4b95-a6f0-43de80834a64 tempest-ProjectReaderTests-551527553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:27 devstack sudo[102412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:02:27 devstack sudo[102412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:28 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-4d0aa06f-2d6e-4c1e-b517-2889775b413b tempest-VolumesSnapshotListTestJSON-1001216880 None] Acquiring lock "cinder-d4326973-e0b3-4417-b247-9b8966b384c6-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:02:28 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-4d0aa06f-2d6e-4c1e-b517-2889775b413b tempest-VolumesSnapshotListTestJSON-1001216880 None] Lock "cinder-d4326973-e0b3-4417-b247-9b8966b384c6-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:02:28 devstack sudo[102412]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8da826e1-5536-4b95-a6f0-43de80834a64 tempest-ProjectReaderTests-551527553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.311s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:28 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-8da826e1-5536-4b95-a6f0-43de80834a64 tempest-ProjectReaderTests-551527553 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:02:28 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-8da826e1-5536-4b95-a6f0-43de80834a64 tempest-ProjectReaderTests-551527553 None] Deleted volume successfully. Jul 30 17:02:28 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-4d0aa06f-2d6e-4c1e-b517-2889775b413b tempest-VolumesSnapshotListTestJSON-1001216880 None] Acquiring lock "cinder-quobyte-d4326973-e0b3-4417-b247-9b8966b384c6" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:02:28 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-8da826e1-5536-4b95-a6f0-43de80834a64 tempest-ProjectReaderTests-551527553 None] Lock "cinder-e649d41b-de95-434a-a219-e033883469e3-delete_volume" released by "delete_volume" :: held 1.327s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:02:28 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-4d0aa06f-2d6e-4c1e-b517-2889775b413b tempest-VolumesSnapshotListTestJSON-1001216880 None] Lock "cinder-quobyte-d4326973-e0b3-4417-b247-9b8966b384c6" acquired by "delete_volume" :: waited 0.016s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:02:28 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf90f716-0372-4814-9b09-dad5d14acd19]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:02:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-4d0aa06f-2d6e-4c1e-b517-2889775b413b tempest-VolumesSnapshotListTestJSON-1001216880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:28 devstack sudo[102415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6 Jul 30 17:02:28 devstack sudo[102415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:28 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-0780e00b-02d4-4960-913f-f4134e4102ca tempest-ProjectReaderTests-551527553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:02:28 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-0780e00b-02d4-4960-913f-f4134e4102ca tempest-ProjectReaderTests-551527553 None] Flow 'volume_create_manager' (6ad9499b-a1a5-4d3d-9251-9875cf7be67f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:02:28 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-0780e00b-02d4-4960-913f-f4134e4102ca tempest-ProjectReaderTests-551527553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b343f77f-4a55-44a4-94e1-45a9e53d5b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:28 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-0780e00b-02d4-4960-913f-f4134e4102ca tempest-ProjectReaderTests-551527553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b343f77f-4a55-44a4-94e1-45a9e53d5b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:02:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-815044524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=467ee052-23dd-40d4-998c-e2afa1695388,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebd22fd1262f492aa7bc578dd78ee192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:02:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:02:29Z,use_quota=True,user_id='7f8ee5198de54d4e90f3b3c050efc2a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:28 devstack sudo[102415]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:28 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-0780e00b-02d4-4960-913f-f4134e4102ca tempest-ProjectReaderTests-551527553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (058979a6-8fa5-4d5f-87ba-f0048108d438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:28 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-0780e00b-02d4-4960-913f-f4134e4102ca tempest-ProjectReaderTests-551527553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (058979a6-8fa5-4d5f-87ba-f0048108d438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:28 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-0780e00b-02d4-4960-913f-f4134e4102ca tempest-ProjectReaderTests-551527553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89f77c21-55f1-492a-b060-0b2ad7764a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:28 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-0780e00b-02d4-4960-913f-f4134e4102ca tempest-ProjectReaderTests-551527553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89f77c21-55f1-492a-b060-0b2ad7764a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '467ee052-23dd-40d4-998c-e2afa1695388', 'volume_name': 'volume-467ee052-23dd-40d4-998c-e2afa1695388', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:28 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-0780e00b-02d4-4960-913f-f4134e4102ca tempest-ProjectReaderTests-551527553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60c11617-3098-4c06-a826-8380f442305d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:28 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-0780e00b-02d4-4960-913f-f4134e4102ca tempest-ProjectReaderTests-551527553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60c11617-3098-4c06-a826-8380f442305d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:28 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-0780e00b-02d4-4960-913f-f4134e4102ca tempest-ProjectReaderTests-551527553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdf8376d-969f-4330-b3f4-d3344fab9e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:28 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-0780e00b-02d4-4960-913f-f4134e4102ca tempest-ProjectReaderTests-551527553 None] Volume 467ee052-23dd-40d4-998c-e2afa1695388: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-467ee052-23dd-40d4-998c-e2afa1695388', 'volume_size': 1} Jul 30 17:02:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-0780e00b-02d4-4960-913f-f4134e4102ca tempest-ProjectReaderTests-551527553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-0780e00b-02d4-4960-913f-f4134e4102ca tempest-ProjectReaderTests-551527553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:28 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-0780e00b-02d4-4960-913f-f4134e4102ca tempest-ProjectReaderTests-551527553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:02:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-815044524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=467ee052-23dd-40d4-998c-e2afa1695388,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebd22fd1262f492aa7bc578dd78ee192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:02:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:02:29Z,use_quota=True,user_id='7f8ee5198de54d4e90f3b3c050efc2a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:02:28 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-0780e00b-02d4-4960-913f-f4134e4102ca tempest-ProjectReaderTests-551527553 None] Creating volume 467ee052-23dd-40d4-998c-e2afa1695388 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:02:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-0780e00b-02d4-4960-913f-f4134e4102ca tempest-ProjectReaderTests-551527553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-0780e00b-02d4-4960-913f-f4134e4102ca tempest-ProjectReaderTests-551527553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:28 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-0780e00b-02d4-4960-913f-f4134e4102ca tempest-ProjectReaderTests-551527553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:02:28 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-0780e00b-02d4-4960-913f-f4134e4102ca tempest-ProjectReaderTests-551527553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:02:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-0780e00b-02d4-4960-913f-f4134e4102ca tempest-ProjectReaderTests-551527553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:28 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-0780e00b-02d4-4960-913f-f4134e4102ca tempest-ProjectReaderTests-551527553 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:02:28 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-0780e00b-02d4-4960-913f-f4134e4102ca tempest-ProjectReaderTests-551527553 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:02:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0780e00b-02d4-4960-913f-f4134e4102ca tempest-ProjectReaderTests-551527553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-467ee052-23dd-40d4-998c-e2afa1695388 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-4d0aa06f-2d6e-4c1e-b517-2889775b413b tempest-VolumesSnapshotListTestJSON-1001216880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6" returned: 0 in 0.589s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-4d0aa06f-2d6e-4c1e-b517-2889775b413b tempest-VolumesSnapshotListTestJSON-1001216880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:28 devstack sudo[102421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-467ee052-23dd-40d4-998c-e2afa1695388 1073741824 Jul 30 17:02:28 devstack sudo[102421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:28 devstack sudo[102422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6 Jul 30 17:02:28 devstack sudo[102422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:29 devstack sudo[102422]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-4d0aa06f-2d6e-4c1e-b517-2889775b413b tempest-VolumesSnapshotListTestJSON-1001216880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d4326973-e0b3-4417-b247-9b8966b384c6" returned: 0 in 0.283s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:29 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-4d0aa06f-2d6e-4c1e-b517-2889775b413b tempest-VolumesSnapshotListTestJSON-1001216880 None] Lock "cinder-quobyte-d4326973-e0b3-4417-b247-9b8966b384c6" released by "delete_volume" :: held 0.948s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:02:29 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-4d0aa06f-2d6e-4c1e-b517-2889775b413b tempest-VolumesSnapshotListTestJSON-1001216880 None] Created reservations ['beb36d16-72e3-4c12-815a-8783a20ab460', '0edfa1f0-4237-46bc-92e8-c287c30b4b60', '2a6047f2-eb2f-42d2-852d-8c3a6e832d41', '85cf9eaa-bb16-402c-9885-cc49d6bf98ee'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:02:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-4d0aa06f-2d6e-4c1e-b517-2889775b413b tempest-VolumesSnapshotListTestJSON-1001216880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-4d0aa06f-2d6e-4c1e-b517-2889775b413b tempest-VolumesSnapshotListTestJSON-1001216880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:29 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-4d0aa06f-2d6e-4c1e-b517-2889775b413b tempest-VolumesSnapshotListTestJSON-1001216880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:02:29 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-4d0aa06f-2d6e-4c1e-b517-2889775b413b tempest-VolumesSnapshotListTestJSON-1001216880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:02:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-4d0aa06f-2d6e-4c1e-b517-2889775b413b tempest-VolumesSnapshotListTestJSON-1001216880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-4d0aa06f-2d6e-4c1e-b517-2889775b413b tempest-VolumesSnapshotListTestJSON-1001216880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:29 devstack sudo[102430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:02:29 devstack sudo[102430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:29 devstack sudo[102421]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0780e00b-02d4-4960-913f-f4134e4102ca tempest-ProjectReaderTests-551527553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-467ee052-23dd-40d4-998c-e2afa1695388 1073741824" returned: 0 in 0.556s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0780e00b-02d4-4960-913f-f4134e4102ca tempest-ProjectReaderTests-551527553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-467ee052-23dd-40d4-998c-e2afa1695388 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:29 devstack sudo[102432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-467ee052-23dd-40d4-998c-e2afa1695388 Jul 30 17:02:29 devstack sudo[102432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:29 devstack sudo[102430]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-4d0aa06f-2d6e-4c1e-b517-2889775b413b tempest-VolumesSnapshotListTestJSON-1001216880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.355s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:29 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-4d0aa06f-2d6e-4c1e-b517-2889775b413b tempest-VolumesSnapshotListTestJSON-1001216880 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:02:29 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-4d0aa06f-2d6e-4c1e-b517-2889775b413b tempest-VolumesSnapshotListTestJSON-1001216880 None] Deleted volume successfully. Jul 30 17:02:29 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-4d0aa06f-2d6e-4c1e-b517-2889775b413b tempest-VolumesSnapshotListTestJSON-1001216880 None] Lock "cinder-d4326973-e0b3-4417-b247-9b8966b384c6-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:02:29 devstack sudo[102432]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0780e00b-02d4-4960-913f-f4134e4102ca tempest-ProjectReaderTests-551527553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-467ee052-23dd-40d4-998c-e2afa1695388" returned: 0 in 0.322s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:29 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-0780e00b-02d4-4960-913f-f4134e4102ca tempest-ProjectReaderTests-551527553 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:02:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-0780e00b-02d4-4960-913f-f4134e4102ca tempest-ProjectReaderTests-551527553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:29 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-0780e00b-02d4-4960-913f-f4134e4102ca tempest-ProjectReaderTests-551527553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdf8376d-969f-4330-b3f4-d3344fab9e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-467ee052-23dd-40d4-998c-e2afa1695388', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:29 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-0780e00b-02d4-4960-913f-f4134e4102ca tempest-ProjectReaderTests-551527553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10644bac-98a9-41c8-bf8b-0151dd1f6fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:29 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-0780e00b-02d4-4960-913f-f4134e4102ca tempest-ProjectReaderTests-551527553 None] Volume volume-467ee052-23dd-40d4-998c-e2afa1695388 (467ee052-23dd-40d4-998c-e2afa1695388): created successfully Jul 30 17:02:29 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-0780e00b-02d4-4960-913f-f4134e4102ca tempest-ProjectReaderTests-551527553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10644bac-98a9-41c8-bf8b-0151dd1f6fb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:29 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-0780e00b-02d4-4960-913f-f4134e4102ca tempest-ProjectReaderTests-551527553 None] Flow 'volume_create_manager' (6ad9499b-a1a5-4d3d-9251-9875cf7be67f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:02:29 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-0780e00b-02d4-4960-913f-f4134e4102ca tempest-ProjectReaderTests-551527553 None] Created volume successfully. Jul 30 17:02:30 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-32a6b495-4e7c-4c0e-bcce-973bf9f2b890 tempest-ProjectReaderTests-551527553 None] Acquiring lock "cinder-467ee052-23dd-40d4-998c-e2afa1695388-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:02:30 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-32a6b495-4e7c-4c0e-bcce-973bf9f2b890 tempest-ProjectReaderTests-551527553 None] Lock "cinder-467ee052-23dd-40d4-998c-e2afa1695388-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:02:30 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-32a6b495-4e7c-4c0e-bcce-973bf9f2b890 tempest-ProjectReaderTests-551527553 None] Acquiring lock "cinder-quobyte-467ee052-23dd-40d4-998c-e2afa1695388" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:02:30 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-32a6b495-4e7c-4c0e-bcce-973bf9f2b890 tempest-ProjectReaderTests-551527553 None] Lock "cinder-quobyte-467ee052-23dd-40d4-998c-e2afa1695388" acquired by "delete_volume" :: waited 0.021s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:02:30 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f944e72-0b73-4252-9301-6063fa46c017]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:02:30 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-32a6b495-4e7c-4c0e-bcce-973bf9f2b890 tempest-ProjectReaderTests-551527553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-467ee052-23dd-40d4-998c-e2afa1695388 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:31 devstack sudo[102436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-467ee052-23dd-40d4-998c-e2afa1695388 Jul 30 17:02:31 devstack sudo[102436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:31 devstack sudo[102436]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:31 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-32a6b495-4e7c-4c0e-bcce-973bf9f2b890 tempest-ProjectReaderTests-551527553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-467ee052-23dd-40d4-998c-e2afa1695388" returned: 0 in 0.437s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:31 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-32a6b495-4e7c-4c0e-bcce-973bf9f2b890 tempest-ProjectReaderTests-551527553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-467ee052-23dd-40d4-998c-e2afa1695388 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:31 devstack sudo[102441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-467ee052-23dd-40d4-998c-e2afa1695388 Jul 30 17:02:31 devstack sudo[102441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:31 devstack sudo[102441]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:31 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-32a6b495-4e7c-4c0e-bcce-973bf9f2b890 tempest-ProjectReaderTests-551527553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-467ee052-23dd-40d4-998c-e2afa1695388" returned: 0 in 0.280s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:31 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-32a6b495-4e7c-4c0e-bcce-973bf9f2b890 tempest-ProjectReaderTests-551527553 None] Lock "cinder-quobyte-467ee052-23dd-40d4-998c-e2afa1695388" released by "delete_volume" :: held 0.769s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:02:31 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-32a6b495-4e7c-4c0e-bcce-973bf9f2b890 tempest-ProjectReaderTests-551527553 None] Created reservations ['928b7890-b435-4e86-9739-299d52b9ffb3', 'd75e1b58-72fe-4f16-a138-c1dd97143aa8', '4fa7e6fd-d257-4273-b7c5-f28f7453149d', 'a1bbb2e1-7575-4490-a273-186bbcc956bf'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:02:31 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-32a6b495-4e7c-4c0e-bcce-973bf9f2b890 tempest-ProjectReaderTests-551527553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:31 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-32a6b495-4e7c-4c0e-bcce-973bf9f2b890 tempest-ProjectReaderTests-551527553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:31 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-32a6b495-4e7c-4c0e-bcce-973bf9f2b890 tempest-ProjectReaderTests-551527553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:02:31 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-32a6b495-4e7c-4c0e-bcce-973bf9f2b890 tempest-ProjectReaderTests-551527553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:02:31 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-32a6b495-4e7c-4c0e-bcce-973bf9f2b890 tempest-ProjectReaderTests-551527553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:31 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-32a6b495-4e7c-4c0e-bcce-973bf9f2b890 tempest-ProjectReaderTests-551527553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:31 devstack sudo[102444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:02:31 devstack sudo[102444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:32 devstack sudo[102444]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:32 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-32a6b495-4e7c-4c0e-bcce-973bf9f2b890 tempest-ProjectReaderTests-551527553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.298s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:32 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-32a6b495-4e7c-4c0e-bcce-973bf9f2b890 tempest-ProjectReaderTests-551527553 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:02:32 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-32a6b495-4e7c-4c0e-bcce-973bf9f2b890 tempest-ProjectReaderTests-551527553 None] Deleted volume successfully. Jul 30 17:02:32 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-32a6b495-4e7c-4c0e-bcce-973bf9f2b890 tempest-ProjectReaderTests-551527553 None] Lock "cinder-467ee052-23dd-40d4-998c-e2afa1695388-delete_volume" released by "delete_volume" :: held 1.314s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:02:32 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-e915cc9a-530e-4aa5-a1f1-780a35dd271d tempest-ProjectReaderTests-551527553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:02:32 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e915cc9a-530e-4aa5-a1f1-780a35dd271d tempest-ProjectReaderTests-551527553 None] Flow 'volume_create_manager' (1759864b-a580-4408-bbab-22f15b9bcd4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:02:32 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e915cc9a-530e-4aa5-a1f1-780a35dd271d tempest-ProjectReaderTests-551527553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceba864a-5a46-4349-a8fc-a88aab5c0598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:32 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e915cc9a-530e-4aa5-a1f1-780a35dd271d tempest-ProjectReaderTests-551527553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceba864a-5a46-4349-a8fc-a88aab5c0598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:02:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1823023768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f68d844-e258-4887-a036-88b558ff3b99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebd22fd1262f492aa7bc578dd78ee192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:02:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:02:33Z,use_quota=True,user_id='7f8ee5198de54d4e90f3b3c050efc2a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:32 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e915cc9a-530e-4aa5-a1f1-780a35dd271d tempest-ProjectReaderTests-551527553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4516f046-7642-4d35-81c1-9799c432d7ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:32 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e915cc9a-530e-4aa5-a1f1-780a35dd271d tempest-ProjectReaderTests-551527553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4516f046-7642-4d35-81c1-9799c432d7ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:32 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e915cc9a-530e-4aa5-a1f1-780a35dd271d tempest-ProjectReaderTests-551527553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad86bace-53ce-453c-979d-014a38e1a356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:32 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e915cc9a-530e-4aa5-a1f1-780a35dd271d tempest-ProjectReaderTests-551527553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad86bace-53ce-453c-979d-014a38e1a356) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f68d844-e258-4887-a036-88b558ff3b99', 'volume_name': 'volume-9f68d844-e258-4887-a036-88b558ff3b99', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:32 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e915cc9a-530e-4aa5-a1f1-780a35dd271d tempest-ProjectReaderTests-551527553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8845b782-dc98-4482-a6af-611aea5dbedf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:32 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e915cc9a-530e-4aa5-a1f1-780a35dd271d tempest-ProjectReaderTests-551527553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8845b782-dc98-4482-a6af-611aea5dbedf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:32 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e915cc9a-530e-4aa5-a1f1-780a35dd271d tempest-ProjectReaderTests-551527553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86989a39-b1cf-425d-922d-1da7c7451095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:32 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-e915cc9a-530e-4aa5-a1f1-780a35dd271d tempest-ProjectReaderTests-551527553 None] Volume 9f68d844-e258-4887-a036-88b558ff3b99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f68d844-e258-4887-a036-88b558ff3b99', 'volume_size': 1} Jul 30 17:02:32 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-e915cc9a-530e-4aa5-a1f1-780a35dd271d tempest-ProjectReaderTests-551527553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:32 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-e915cc9a-530e-4aa5-a1f1-780a35dd271d tempest-ProjectReaderTests-551527553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:32 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-e915cc9a-530e-4aa5-a1f1-780a35dd271d tempest-ProjectReaderTests-551527553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:02:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1823023768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f68d844-e258-4887-a036-88b558ff3b99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebd22fd1262f492aa7bc578dd78ee192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:02:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:02:33Z,use_quota=True,user_id='7f8ee5198de54d4e90f3b3c050efc2a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:02:32 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-e915cc9a-530e-4aa5-a1f1-780a35dd271d tempest-ProjectReaderTests-551527553 None] Creating volume 9f68d844-e258-4887-a036-88b558ff3b99 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:02:32 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-e915cc9a-530e-4aa5-a1f1-780a35dd271d tempest-ProjectReaderTests-551527553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:32 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-e915cc9a-530e-4aa5-a1f1-780a35dd271d tempest-ProjectReaderTests-551527553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:32 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-e915cc9a-530e-4aa5-a1f1-780a35dd271d tempest-ProjectReaderTests-551527553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:02:32 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-e915cc9a-530e-4aa5-a1f1-780a35dd271d tempest-ProjectReaderTests-551527553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:02:32 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-e915cc9a-530e-4aa5-a1f1-780a35dd271d tempest-ProjectReaderTests-551527553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:32 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-e915cc9a-530e-4aa5-a1f1-780a35dd271d tempest-ProjectReaderTests-551527553 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:02:32 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-e915cc9a-530e-4aa5-a1f1-780a35dd271d tempest-ProjectReaderTests-551527553 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:02:32 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e915cc9a-530e-4aa5-a1f1-780a35dd271d tempest-ProjectReaderTests-551527553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9f68d844-e258-4887-a036-88b558ff3b99 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:32 devstack sudo[102447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9f68d844-e258-4887-a036-88b558ff3b99 1073741824 Jul 30 17:02:32 devstack sudo[102447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:33 devstack sudo[102447]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:33 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e915cc9a-530e-4aa5-a1f1-780a35dd271d tempest-ProjectReaderTests-551527553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9f68d844-e258-4887-a036-88b558ff3b99 1073741824" returned: 0 in 0.508s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:33 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e915cc9a-530e-4aa5-a1f1-780a35dd271d tempest-ProjectReaderTests-551527553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9f68d844-e258-4887-a036-88b558ff3b99 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:33 devstack sudo[102454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9f68d844-e258-4887-a036-88b558ff3b99 Jul 30 17:02:33 devstack sudo[102454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:33 devstack sudo[102454]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:33 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e915cc9a-530e-4aa5-a1f1-780a35dd271d tempest-ProjectReaderTests-551527553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9f68d844-e258-4887-a036-88b558ff3b99" returned: 0 in 0.311s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:33 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-e915cc9a-530e-4aa5-a1f1-780a35dd271d tempest-ProjectReaderTests-551527553 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:02:33 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-e915cc9a-530e-4aa5-a1f1-780a35dd271d tempest-ProjectReaderTests-551527553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:33 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e915cc9a-530e-4aa5-a1f1-780a35dd271d tempest-ProjectReaderTests-551527553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86989a39-b1cf-425d-922d-1da7c7451095) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f68d844-e258-4887-a036-88b558ff3b99', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:33 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e915cc9a-530e-4aa5-a1f1-780a35dd271d tempest-ProjectReaderTests-551527553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2738a6da-c3fc-44f3-9026-ad6952151943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:33 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-e915cc9a-530e-4aa5-a1f1-780a35dd271d tempest-ProjectReaderTests-551527553 None] Volume volume-9f68d844-e258-4887-a036-88b558ff3b99 (9f68d844-e258-4887-a036-88b558ff3b99): created successfully Jul 30 17:02:33 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e915cc9a-530e-4aa5-a1f1-780a35dd271d tempest-ProjectReaderTests-551527553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2738a6da-c3fc-44f3-9026-ad6952151943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:33 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e915cc9a-530e-4aa5-a1f1-780a35dd271d tempest-ProjectReaderTests-551527553 None] Flow 'volume_create_manager' (1759864b-a580-4408-bbab-22f15b9bcd4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:02:33 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-e915cc9a-530e-4aa5-a1f1-780a35dd271d tempest-ProjectReaderTests-551527553 None] Created volume successfully. Jul 30 17:02:34 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-749e1e67-0351-40d7-9c3c-5ad2befbc9a6 tempest-ProjectReaderTests-551527553 None] Acquiring lock "cinder-9f68d844-e258-4887-a036-88b558ff3b99-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:02:34 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-749e1e67-0351-40d7-9c3c-5ad2befbc9a6 tempest-ProjectReaderTests-551527553 None] Lock "cinder-9f68d844-e258-4887-a036-88b558ff3b99-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:02:34 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-749e1e67-0351-40d7-9c3c-5ad2befbc9a6 tempest-ProjectReaderTests-551527553 None] Acquiring lock "cinder-quobyte-9f68d844-e258-4887-a036-88b558ff3b99" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:02:34 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-749e1e67-0351-40d7-9c3c-5ad2befbc9a6 tempest-ProjectReaderTests-551527553 None] Lock "cinder-quobyte-9f68d844-e258-4887-a036-88b558ff3b99" acquired by "delete_volume" :: waited 0.016s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:02:34 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70f82c8-6ae0-430d-abfb-02f4ae69d8ed]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:02:34 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-749e1e67-0351-40d7-9c3c-5ad2befbc9a6 tempest-ProjectReaderTests-551527553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9f68d844-e258-4887-a036-88b558ff3b99 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:34 devstack sudo[102459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9f68d844-e258-4887-a036-88b558ff3b99 Jul 30 17:02:34 devstack sudo[102459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:35 devstack sudo[102459]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-749e1e67-0351-40d7-9c3c-5ad2befbc9a6 tempest-ProjectReaderTests-551527553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9f68d844-e258-4887-a036-88b558ff3b99" returned: 0 in 0.399s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-749e1e67-0351-40d7-9c3c-5ad2befbc9a6 tempest-ProjectReaderTests-551527553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9f68d844-e258-4887-a036-88b558ff3b99 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:35 devstack sudo[102464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9f68d844-e258-4887-a036-88b558ff3b99 Jul 30 17:02:35 devstack sudo[102464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:35 devstack sudo[102464]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-749e1e67-0351-40d7-9c3c-5ad2befbc9a6 tempest-ProjectReaderTests-551527553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9f68d844-e258-4887-a036-88b558ff3b99" returned: 0 in 0.268s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:35 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-749e1e67-0351-40d7-9c3c-5ad2befbc9a6 tempest-ProjectReaderTests-551527553 None] Lock "cinder-quobyte-9f68d844-e258-4887-a036-88b558ff3b99" released by "delete_volume" :: held 0.725s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:02:35 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-749e1e67-0351-40d7-9c3c-5ad2befbc9a6 tempest-ProjectReaderTests-551527553 None] Created reservations ['06e2f11c-e5fa-4c33-a029-63ea178771d4', 'a4282ac4-f599-4262-937a-8df396b162b4', '153d25df-ac27-49ac-8fb5-138d4dd32181', '31351f3c-9b52-4b10-85b7-5114577e37b6'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:02:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-749e1e67-0351-40d7-9c3c-5ad2befbc9a6 tempest-ProjectReaderTests-551527553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-749e1e67-0351-40d7-9c3c-5ad2befbc9a6 tempest-ProjectReaderTests-551527553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:35 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-749e1e67-0351-40d7-9c3c-5ad2befbc9a6 tempest-ProjectReaderTests-551527553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:02:35 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-749e1e67-0351-40d7-9c3c-5ad2befbc9a6 tempest-ProjectReaderTests-551527553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:02:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-749e1e67-0351-40d7-9c3c-5ad2befbc9a6 tempest-ProjectReaderTests-551527553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-749e1e67-0351-40d7-9c3c-5ad2befbc9a6 tempest-ProjectReaderTests-551527553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:35 devstack sudo[102467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:02:35 devstack sudo[102467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:36 devstack sudo[102467]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-749e1e67-0351-40d7-9c3c-5ad2befbc9a6 tempest-ProjectReaderTests-551527553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.409s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:36 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-749e1e67-0351-40d7-9c3c-5ad2befbc9a6 tempest-ProjectReaderTests-551527553 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:02:36 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-749e1e67-0351-40d7-9c3c-5ad2befbc9a6 tempest-ProjectReaderTests-551527553 None] Deleted volume successfully. Jul 30 17:02:36 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-749e1e67-0351-40d7-9c3c-5ad2befbc9a6 tempest-ProjectReaderTests-551527553 None] Lock "cinder-9f68d844-e258-4887-a036-88b558ff3b99-delete_volume" released by "delete_volume" :: held 1.485s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:02:45 devstack cinder-volume[88568]: DEBUG dbcounter [-] [88568] Writing DB stats cinder:SELECT=116,cinder:UPDATE=172,cinder:INSERT=53,cinder:DELETE=17 {{(pid=88568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 17:02:46 devstack cinder-volume[88568]: DEBUG dbcounter [-] [88568] Writing DB stats cinder:SELECT=125,cinder:UPDATE=155,cinder:INSERT=36,cinder:DELETE=10 {{(pid=88568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 17:02:47 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-4099f604-3eea-4962-84a1-073e6ae5c976 tempest-TestInstancesWithCinderVolumes-1055681914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:02:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4099f604-3eea-4962-84a1-073e6ae5c976 tempest-TestInstancesWithCinderVolumes-1055681914 None] Flow 'volume_create_manager' (39c99071-2347-46c0-b89f-fb2d760523c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:02:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4099f604-3eea-4962-84a1-073e6ae5c976 tempest-TestInstancesWithCinderVolumes-1055681914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa63dab0-c941-42ab-8d9e-9c6b6f27d068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4099f604-3eea-4962-84a1-073e6ae5c976 tempest-TestInstancesWithCinderVolumes-1055681914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa63dab0-c941-42ab-8d9e-9c6b6f27d068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:02:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1782871716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb15f1af-4b3a-4310-b4c5-3d5e8187be5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53af0c66c22f4afbbb9af7bf7dd3691b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:02:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:02:47Z,use_quota=True,user_id='e4b1eb99e4554a71aa038a63533fdb2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad348e29-0a9c-4cb3-b376-1764ee7f0cef),volume_type_id=ad348e29-0a9c-4cb3-b376-1764ee7f0cef)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4099f604-3eea-4962-84a1-073e6ae5c976 tempest-TestInstancesWithCinderVolumes-1055681914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41801c4f-dfa8-47ff-8996-519c82082071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4099f604-3eea-4962-84a1-073e6ae5c976 tempest-TestInstancesWithCinderVolumes-1055681914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41801c4f-dfa8-47ff-8996-519c82082071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4099f604-3eea-4962-84a1-073e6ae5c976 tempest-TestInstancesWithCinderVolumes-1055681914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7d8d096-a513-4376-a899-32ed97160a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4099f604-3eea-4962-84a1-073e6ae5c976 tempest-TestInstancesWithCinderVolumes-1055681914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7d8d096-a513-4376-a899-32ed97160a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb15f1af-4b3a-4310-b4c5-3d5e8187be5f', 'volume_name': 'volume-eb15f1af-4b3a-4310-b4c5-3d5e8187be5f', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4099f604-3eea-4962-84a1-073e6ae5c976 tempest-TestInstancesWithCinderVolumes-1055681914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de80fe18-5c90-439c-bddd-94a781285b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4099f604-3eea-4962-84a1-073e6ae5c976 tempest-TestInstancesWithCinderVolumes-1055681914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de80fe18-5c90-439c-bddd-94a781285b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4099f604-3eea-4962-84a1-073e6ae5c976 tempest-TestInstancesWithCinderVolumes-1055681914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94c37089-ac12-4ece-92d8-a38502dd2dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:47 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-4099f604-3eea-4962-84a1-073e6ae5c976 tempest-TestInstancesWithCinderVolumes-1055681914 None] Volume eb15f1af-4b3a-4310-b4c5-3d5e8187be5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb15f1af-4b3a-4310-b4c5-3d5e8187be5f', 'volume_size': 1} Jul 30 17:02:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-4099f604-3eea-4962-84a1-073e6ae5c976 tempest-TestInstancesWithCinderVolumes-1055681914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-4099f604-3eea-4962-84a1-073e6ae5c976 tempest-TestInstancesWithCinderVolumes-1055681914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:47 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-4099f604-3eea-4962-84a1-073e6ae5c976 tempest-TestInstancesWithCinderVolumes-1055681914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:02:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1782871716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb15f1af-4b3a-4310-b4c5-3d5e8187be5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53af0c66c22f4afbbb9af7bf7dd3691b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:02:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:02:47Z,use_quota=True,user_id='e4b1eb99e4554a71aa038a63533fdb2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad348e29-0a9c-4cb3-b376-1764ee7f0cef),volume_type_id=ad348e29-0a9c-4cb3-b376-1764ee7f0cef)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:02:47 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-4099f604-3eea-4962-84a1-073e6ae5c976 tempest-TestInstancesWithCinderVolumes-1055681914 None] Creating volume eb15f1af-4b3a-4310-b4c5-3d5e8187be5f {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:02:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-4099f604-3eea-4962-84a1-073e6ae5c976 tempest-TestInstancesWithCinderVolumes-1055681914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-4099f604-3eea-4962-84a1-073e6ae5c976 tempest-TestInstancesWithCinderVolumes-1055681914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:47 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-4099f604-3eea-4962-84a1-073e6ae5c976 tempest-TestInstancesWithCinderVolumes-1055681914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:02:47 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-4099f604-3eea-4962-84a1-073e6ae5c976 tempest-TestInstancesWithCinderVolumes-1055681914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:02:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-4099f604-3eea-4962-84a1-073e6ae5c976 tempest-TestInstancesWithCinderVolumes-1055681914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:47 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-4099f604-3eea-4962-84a1-073e6ae5c976 tempest-TestInstancesWithCinderVolumes-1055681914 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:02:47 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-4099f604-3eea-4962-84a1-073e6ae5c976 tempest-TestInstancesWithCinderVolumes-1055681914 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:02:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-4099f604-3eea-4962-84a1-073e6ae5c976 tempest-TestInstancesWithCinderVolumes-1055681914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-eb15f1af-4b3a-4310-b4c5-3d5e8187be5f 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:47 devstack sudo[102507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-eb15f1af-4b3a-4310-b4c5-3d5e8187be5f 1073741824 Jul 30 17:02:47 devstack sudo[102507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:48 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-59872074-a32e-4f45-997d-c640220fe02f tempest-TestInstancesWithCinderVolumes-1055681914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:02:48 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-59872074-a32e-4f45-997d-c640220fe02f tempest-TestInstancesWithCinderVolumes-1055681914 None] Flow 'volume_create_manager' (a409bfa9-864c-45ac-ba64-6d863d219561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:02:48 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-59872074-a32e-4f45-997d-c640220fe02f tempest-TestInstancesWithCinderVolumes-1055681914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aeccf1c-8655-4904-b36b-ff0a1137a139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:48 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-59872074-a32e-4f45-997d-c640220fe02f tempest-TestInstancesWithCinderVolumes-1055681914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aeccf1c-8655-4904-b36b-ff0a1137a139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:02:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-414426493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5af88b53-2057-4db6-a129-7b6094edc355,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53af0c66c22f4afbbb9af7bf7dd3691b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:02:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:02:48Z,use_quota=True,user_id='e4b1eb99e4554a71aa038a63533fdb2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8a3764f7-2ae0-4330-9b01-3b320030a64a),volume_type_id=8a3764f7-2ae0-4330-9b01-3b320030a64a)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:48 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-59872074-a32e-4f45-997d-c640220fe02f tempest-TestInstancesWithCinderVolumes-1055681914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (926ea5db-0d9d-480a-b49b-ab00f4e33926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:48 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-59872074-a32e-4f45-997d-c640220fe02f tempest-TestInstancesWithCinderVolumes-1055681914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (926ea5db-0d9d-480a-b49b-ab00f4e33926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:48 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-59872074-a32e-4f45-997d-c640220fe02f tempest-TestInstancesWithCinderVolumes-1055681914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f680158-613d-4251-b047-d0ad957d53e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:48 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-59872074-a32e-4f45-997d-c640220fe02f tempest-TestInstancesWithCinderVolumes-1055681914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f680158-613d-4251-b047-d0ad957d53e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5af88b53-2057-4db6-a129-7b6094edc355', 'volume_name': 'volume-5af88b53-2057-4db6-a129-7b6094edc355', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:48 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-59872074-a32e-4f45-997d-c640220fe02f tempest-TestInstancesWithCinderVolumes-1055681914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e96d2149-c2b7-43db-96de-158ca4a814d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:48 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-59872074-a32e-4f45-997d-c640220fe02f tempest-TestInstancesWithCinderVolumes-1055681914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e96d2149-c2b7-43db-96de-158ca4a814d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:48 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-59872074-a32e-4f45-997d-c640220fe02f tempest-TestInstancesWithCinderVolumes-1055681914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99e7d64b-1d33-4e2e-be3b-da0696d0b719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:48 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-59872074-a32e-4f45-997d-c640220fe02f tempest-TestInstancesWithCinderVolumes-1055681914 None] Volume 5af88b53-2057-4db6-a129-7b6094edc355: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5af88b53-2057-4db6-a129-7b6094edc355', 'volume_size': 1} Jul 30 17:02:48 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-59872074-a32e-4f45-997d-c640220fe02f tempest-TestInstancesWithCinderVolumes-1055681914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:48 devstack sudo[102507]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:48 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-4099f604-3eea-4962-84a1-073e6ae5c976 tempest-TestInstancesWithCinderVolumes-1055681914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-eb15f1af-4b3a-4310-b4c5-3d5e8187be5f 1073741824" returned: 0 in 0.671s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:48 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-4099f604-3eea-4962-84a1-073e6ae5c976 tempest-TestInstancesWithCinderVolumes-1055681914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-eb15f1af-4b3a-4310-b4c5-3d5e8187be5f {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:48 devstack sudo[102520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-eb15f1af-4b3a-4310-b4c5-3d5e8187be5f Jul 30 17:02:48 devstack sudo[102520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:48 devstack sudo[102520]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:48 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-4099f604-3eea-4962-84a1-073e6ae5c976 tempest-TestInstancesWithCinderVolumes-1055681914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-eb15f1af-4b3a-4310-b4c5-3d5e8187be5f" returned: 0 in 0.439s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:48 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-4099f604-3eea-4962-84a1-073e6ae5c976 tempest-TestInstancesWithCinderVolumes-1055681914 None] <== create_volume: return (1169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:02:48 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-4099f604-3eea-4962-84a1-073e6ae5c976 tempest-TestInstancesWithCinderVolumes-1055681914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.171s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:48 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-59872074-a32e-4f45-997d-c640220fe02f tempest-TestInstancesWithCinderVolumes-1055681914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.539s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:48 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-59872074-a32e-4f45-997d-c640220fe02f tempest-TestInstancesWithCinderVolumes-1055681914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:02:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-414426493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5af88b53-2057-4db6-a129-7b6094edc355,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53af0c66c22f4afbbb9af7bf7dd3691b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:02:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:02:48Z,use_quota=True,user_id='e4b1eb99e4554a71aa038a63533fdb2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8a3764f7-2ae0-4330-9b01-3b320030a64a),volume_type_id=8a3764f7-2ae0-4330-9b01-3b320030a64a)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:02:48 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-59872074-a32e-4f45-997d-c640220fe02f tempest-TestInstancesWithCinderVolumes-1055681914 None] Creating volume 5af88b53-2057-4db6-a129-7b6094edc355 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:02:48 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-59872074-a32e-4f45-997d-c640220fe02f tempest-TestInstancesWithCinderVolumes-1055681914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:48 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-59872074-a32e-4f45-997d-c640220fe02f tempest-TestInstancesWithCinderVolumes-1055681914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:48 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-59872074-a32e-4f45-997d-c640220fe02f tempest-TestInstancesWithCinderVolumes-1055681914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:02:48 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-59872074-a32e-4f45-997d-c640220fe02f tempest-TestInstancesWithCinderVolumes-1055681914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:02:48 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-59872074-a32e-4f45-997d-c640220fe02f tempest-TestInstancesWithCinderVolumes-1055681914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:48 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-59872074-a32e-4f45-997d-c640220fe02f tempest-TestInstancesWithCinderVolumes-1055681914 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:02:48 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-59872074-a32e-4f45-997d-c640220fe02f tempest-TestInstancesWithCinderVolumes-1055681914 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:02:48 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-59872074-a32e-4f45-997d-c640220fe02f tempest-TestInstancesWithCinderVolumes-1055681914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5af88b53-2057-4db6-a129-7b6094edc355 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:48 devstack sudo[102523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5af88b53-2057-4db6-a129-7b6094edc355 1073741824 Jul 30 17:02:48 devstack sudo[102523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:48 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4099f604-3eea-4962-84a1-073e6ae5c976 tempest-TestInstancesWithCinderVolumes-1055681914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94c37089-ac12-4ece-92d8-a38502dd2dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb15f1af-4b3a-4310-b4c5-3d5e8187be5f', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:48 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4099f604-3eea-4962-84a1-073e6ae5c976 tempest-TestInstancesWithCinderVolumes-1055681914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bbe2cc9-c55a-4c52-b5da-8e8b5ceb25c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:48 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-a80ed032-d725-45fe-976e-c23d964c6207 tempest-TestInstancesWithCinderVolumes-1055681914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:02:48 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a80ed032-d725-45fe-976e-c23d964c6207 tempest-TestInstancesWithCinderVolumes-1055681914 None] Flow 'volume_create_manager' (5b4781a2-19d9-48d0-833b-cdacf5428da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:02:48 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a80ed032-d725-45fe-976e-c23d964c6207 tempest-TestInstancesWithCinderVolumes-1055681914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca32ffb1-2cde-40ae-be0d-c94fc8d3278c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:48 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-4099f604-3eea-4962-84a1-073e6ae5c976 tempest-TestInstancesWithCinderVolumes-1055681914 None] Volume volume-eb15f1af-4b3a-4310-b4c5-3d5e8187be5f (eb15f1af-4b3a-4310-b4c5-3d5e8187be5f): created successfully Jul 30 17:02:48 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4099f604-3eea-4962-84a1-073e6ae5c976 tempest-TestInstancesWithCinderVolumes-1055681914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bbe2cc9-c55a-4c52-b5da-8e8b5ceb25c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:48 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4099f604-3eea-4962-84a1-073e6ae5c976 tempest-TestInstancesWithCinderVolumes-1055681914 None] Flow 'volume_create_manager' (39c99071-2347-46c0-b89f-fb2d760523c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:02:48 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a80ed032-d725-45fe-976e-c23d964c6207 tempest-TestInstancesWithCinderVolumes-1055681914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca32ffb1-2cde-40ae-be0d-c94fc8d3278c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:02:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2011337477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3ed928e-4587-4bb3-bfa2-d57572ce2e23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53af0c66c22f4afbbb9af7bf7dd3691b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:02:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:02:49Z,use_quota=True,user_id='e4b1eb99e4554a71aa038a63533fdb2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91cc1937-bf36-4d34-b1b8-b5fbe8a0c669),volume_type_id=91cc1937-bf36-4d34-b1b8-b5fbe8a0c669)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:48 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a80ed032-d725-45fe-976e-c23d964c6207 tempest-TestInstancesWithCinderVolumes-1055681914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f69db4cf-92c9-40d4-802e-50c9456f58a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:48 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a80ed032-d725-45fe-976e-c23d964c6207 tempest-TestInstancesWithCinderVolumes-1055681914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f69db4cf-92c9-40d4-802e-50c9456f58a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:48 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a80ed032-d725-45fe-976e-c23d964c6207 tempest-TestInstancesWithCinderVolumes-1055681914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebe4c51b-7a08-48fc-b34d-64992b1501d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:48 devstack cinder-volume[88568]: DEBUG cinder.image.glance [None req-a80ed032-d725-45fe-976e-c23d964c6207 tempest-TestInstancesWithCinderVolumes-1055681914 None] Creating Keystone auth plugin from conf {{(pid=88568) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 30 17:02:48 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-4099f604-3eea-4962-84a1-073e6ae5c976 tempest-TestInstancesWithCinderVolumes-1055681914 None] Created volume successfully. Jul 30 17:02:49 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a80ed032-d725-45fe-976e-c23d964c6207 tempest-TestInstancesWithCinderVolumes-1055681914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebe4c51b-7a08-48fc-b34d-64992b1501d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c3ed928e-4587-4bb3-bfa2-d57572ce2e23', 'volume_name': 'volume-c3ed928e-4587-4bb3-bfa2-d57572ce2e23', 'volume_size': 1, 'image_id': '98edfd5c-def9-4b9d-bc51-f36eb47cd9ba', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/98edfd5c-def9-4b9d-bc51-f36eb47cd9ba', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1358701673', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '53af0c66c22f4afbbb9af7bf7dd3691b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '98edfd5c-def9-4b9d-bc51-f36eb47cd9ba', 'created_at': datetime.datetime(2026, 7, 30, 15, 2, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 15, 2, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/98edfd5c-def9-4b9d-bc51-f36eb47cd9ba/file', 'properties': {}}, 'image_service': }' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:49 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a80ed032-d725-45fe-976e-c23d964c6207 tempest-TestInstancesWithCinderVolumes-1055681914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45474e8e-4a71-4a59-a449-878ff65c000a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:49 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a80ed032-d725-45fe-976e-c23d964c6207 tempest-TestInstancesWithCinderVolumes-1055681914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45474e8e-4a71-4a59-a449-878ff65c000a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:49 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a80ed032-d725-45fe-976e-c23d964c6207 tempest-TestInstancesWithCinderVolumes-1055681914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98fc1244-353c-4b49-82ee-71e8c4f63276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:49 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-a80ed032-d725-45fe-976e-c23d964c6207 tempest-TestInstancesWithCinderVolumes-1055681914 None] Volume c3ed928e-4587-4bb3-bfa2-d57572ce2e23: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c3ed928e-4587-4bb3-bfa2-d57572ce2e23', 'volume_size': 1, 'image_id': '98edfd5c-def9-4b9d-bc51-f36eb47cd9ba', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/98edfd5c-def9-4b9d-bc51-f36eb47cd9ba', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1358701673', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '53af0c66c22f4afbbb9af7bf7dd3691b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '98edfd5c-def9-4b9d-bc51-f36eb47cd9ba', 'created_at': datetime.datetime(2026, 7, 30, 15, 2, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 15, 2, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/98edfd5c-def9-4b9d-bc51-f36eb47cd9ba/file', 'properties': {}}, 'image_service': } Jul 30 17:02:49 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-a80ed032-d725-45fe-976e-c23d964c6207 tempest-TestInstancesWithCinderVolumes-1055681914 None] Trying to clone c3ed928e-4587-4bb3-bfa2-d57572ce2e23 from image 98edfd5c-def9-4b9d-bc51-f36eb47cd9ba at location (None, [{'url': 'file:///opt/stack/data/glance/images/98edfd5c-def9-4b9d-bc51-f36eb47cd9ba', 'metadata': {}}]). {{(pid=88568) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 30 17:02:49 devstack sudo[102523]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:49 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-59872074-a32e-4f45-997d-c640220fe02f tempest-TestInstancesWithCinderVolumes-1055681914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5af88b53-2057-4db6-a129-7b6094edc355 1073741824" returned: 0 in 0.623s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:49 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-59872074-a32e-4f45-997d-c640220fe02f tempest-TestInstancesWithCinderVolumes-1055681914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5af88b53-2057-4db6-a129-7b6094edc355 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:49 devstack sudo[102529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5af88b53-2057-4db6-a129-7b6094edc355 Jul 30 17:02:49 devstack sudo[102529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:49 devstack sudo[102529]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:49 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-59872074-a32e-4f45-997d-c640220fe02f tempest-TestInstancesWithCinderVolumes-1055681914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5af88b53-2057-4db6-a129-7b6094edc355" returned: 0 in 0.293s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:49 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-59872074-a32e-4f45-997d-c640220fe02f tempest-TestInstancesWithCinderVolumes-1055681914 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:02:49 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-59872074-a32e-4f45-997d-c640220fe02f tempest-TestInstancesWithCinderVolumes-1055681914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:49 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-59872074-a32e-4f45-997d-c640220fe02f tempest-TestInstancesWithCinderVolumes-1055681914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99e7d64b-1d33-4e2e-be3b-da0696d0b719) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5af88b53-2057-4db6-a129-7b6094edc355', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:49 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-59872074-a32e-4f45-997d-c640220fe02f tempest-TestInstancesWithCinderVolumes-1055681914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff95ce33-0e6c-4b5b-8c34-9bad6f6b63ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:49 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-59872074-a32e-4f45-997d-c640220fe02f tempest-TestInstancesWithCinderVolumes-1055681914 None] Volume volume-5af88b53-2057-4db6-a129-7b6094edc355 (5af88b53-2057-4db6-a129-7b6094edc355): created successfully Jul 30 17:02:49 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-59872074-a32e-4f45-997d-c640220fe02f tempest-TestInstancesWithCinderVolumes-1055681914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff95ce33-0e6c-4b5b-8c34-9bad6f6b63ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:49 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-59872074-a32e-4f45-997d-c640220fe02f tempest-TestInstancesWithCinderVolumes-1055681914 None] Flow 'volume_create_manager' (a409bfa9-864c-45ac-ba64-6d863d219561) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:02:49 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-59872074-a32e-4f45-997d-c640220fe02f tempest-TestInstancesWithCinderVolumes-1055681914 None] Created volume successfully. Jul 30 17:02:52 devstack cinder-volume[88568]: DEBUG oslo_service.periodic_task [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 17:02:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:52 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:02:52 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:02:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:52 devstack sudo[102532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:02:52 devstack sudo[102532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:52 devstack sudo[102532]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:52 devstack cinder-volume[88568]: DEBUG cinder.image.image_utils [None req-a80ed032-d725-45fe-976e-c23d964c6207 tempest-TestInstancesWithCinderVolumes-1055681914 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_98edfd5c-def9-4b9d-bc51-f36eb47cd9ba_6610fkyedevstack@QuobyteHD, size 20.69 MB, duration 3.58 sec {{(pid=88568) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 30 17:02:52 devstack cinder-volume[88568]: INFO cinder.image.image_utils [None req-a80ed032-d725-45fe-976e-c23d964c6207 tempest-TestInstancesWithCinderVolumes-1055681914 None] Image download 20.69 MB at 5.79 MB/s Jul 30 17:02:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.306s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:52 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:02:52 devstack cinder-volume[88568]: DEBUG oslo_service.periodic_task [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Running periodic task VolumeManager._thread_info {{(pid=88568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 17:02:52 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] thread count: 28 {{(pid=88568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 17:02:52 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] thread info: [<_MainThread(MainThread, started 127406866608256)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 17:02:52 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a2ec04-dde7-4bbf-8212-5e2bb0f87590]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:02:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a80ed032-d725-45fe-976e-c23d964c6207 tempest-TestInstancesWithCinderVolumes-1055681914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_98edfd5c-def9-4b9d-bc51-f36eb47cd9ba_6610fkyedevstack@QuobyteHD {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:53 devstack sudo[102535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_98edfd5c-def9-4b9d-bc51-f36eb47cd9ba_6610fkyedevstack@QuobyteHD Jul 30 17:02:53 devstack sudo[102535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:53 devstack sudo[102535]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:53 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a80ed032-d725-45fe-976e-c23d964c6207 tempest-TestInstancesWithCinderVolumes-1055681914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_98edfd5c-def9-4b9d-bc51-f36eb47cd9ba_6610fkyedevstack@QuobyteHD" returned: 0 in 0.370s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:53 devstack cinder-volume[88568]: DEBUG cinder.image.image_utils [None req-a80ed032-d725-45fe-976e-c23d964c6207 tempest-TestInstancesWithCinderVolumes-1055681914 None] Temporary image 98edfd5c-def9-4b9d-bc51-f36eb47cd9ba is fetched for user e4b1eb99e4554a71aa038a63533fdb2b. {{(pid=88568) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 30 17:02:53 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b1fcdc6-934b-44cd-841e-5e9c77ffd1b5]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:02:53 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a80ed032-d725-45fe-976e-c23d964c6207 tempest-TestInstancesWithCinderVolumes-1055681914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_98edfd5c-def9-4b9d-bc51-f36eb47cd9ba_6610fkyedevstack@QuobyteHD {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:53 devstack sudo[102541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_98edfd5c-def9-4b9d-bc51-f36eb47cd9ba_6610fkyedevstack@QuobyteHD Jul 30 17:02:53 devstack sudo[102541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:53 devstack sudo[102541]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:53 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a80ed032-d725-45fe-976e-c23d964c6207 tempest-TestInstancesWithCinderVolumes-1055681914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_98edfd5c-def9-4b9d-bc51-f36eb47cd9ba_6610fkyedevstack@QuobyteHD" returned: 0 in 0.379s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:53 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a80ed032-d725-45fe-976e-c23d964c6207 tempest-TestInstancesWithCinderVolumes-1055681914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:53 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a80ed032-d725-45fe-976e-c23d964c6207 tempest-TestInstancesWithCinderVolumes-1055681914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:53 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-a80ed032-d725-45fe-976e-c23d964c6207 tempest-TestInstancesWithCinderVolumes-1055681914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:02:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2011337477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3ed928e-4587-4bb3-bfa2-d57572ce2e23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53af0c66c22f4afbbb9af7bf7dd3691b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:02:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:02:49Z,use_quota=True,user_id='e4b1eb99e4554a71aa038a63533fdb2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91cc1937-bf36-4d34-b1b8-b5fbe8a0c669),volume_type_id=91cc1937-bf36-4d34-b1b8-b5fbe8a0c669)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:02:53 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-a80ed032-d725-45fe-976e-c23d964c6207 tempest-TestInstancesWithCinderVolumes-1055681914 None] Creating volume c3ed928e-4587-4bb3-bfa2-d57572ce2e23 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:02:53 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a80ed032-d725-45fe-976e-c23d964c6207 tempest-TestInstancesWithCinderVolumes-1055681914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:53 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a80ed032-d725-45fe-976e-c23d964c6207 tempest-TestInstancesWithCinderVolumes-1055681914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:53 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-a80ed032-d725-45fe-976e-c23d964c6207 tempest-TestInstancesWithCinderVolumes-1055681914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:02:53 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-a80ed032-d725-45fe-976e-c23d964c6207 tempest-TestInstancesWithCinderVolumes-1055681914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:02:53 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a80ed032-d725-45fe-976e-c23d964c6207 tempest-TestInstancesWithCinderVolumes-1055681914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:53 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-a80ed032-d725-45fe-976e-c23d964c6207 tempest-TestInstancesWithCinderVolumes-1055681914 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:02:53 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-a80ed032-d725-45fe-976e-c23d964c6207 tempest-TestInstancesWithCinderVolumes-1055681914 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:02:53 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a80ed032-d725-45fe-976e-c23d964c6207 tempest-TestInstancesWithCinderVolumes-1055681914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c3ed928e-4587-4bb3-bfa2-d57572ce2e23 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:53 devstack sudo[102546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c3ed928e-4587-4bb3-bfa2-d57572ce2e23 1073741824 Jul 30 17:02:53 devstack sudo[102546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:54 devstack sudo[102546]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a80ed032-d725-45fe-976e-c23d964c6207 tempest-TestInstancesWithCinderVolumes-1055681914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c3ed928e-4587-4bb3-bfa2-d57572ce2e23 1073741824" returned: 0 in 0.527s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a80ed032-d725-45fe-976e-c23d964c6207 tempest-TestInstancesWithCinderVolumes-1055681914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c3ed928e-4587-4bb3-bfa2-d57572ce2e23 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:54 devstack sudo[102552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c3ed928e-4587-4bb3-bfa2-d57572ce2e23 Jul 30 17:02:54 devstack sudo[102552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:54 devstack sudo[102552]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a80ed032-d725-45fe-976e-c23d964c6207 tempest-TestInstancesWithCinderVolumes-1055681914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c3ed928e-4587-4bb3-bfa2-d57572ce2e23" returned: 0 in 0.252s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:54 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-a80ed032-d725-45fe-976e-c23d964c6207 tempest-TestInstancesWithCinderVolumes-1055681914 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:02:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a80ed032-d725-45fe-976e-c23d964c6207 tempest-TestInstancesWithCinderVolumes-1055681914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:54 devstack cinder-volume[88568]: DEBUG cinder.volume.volume_utils [None req-a80ed032-d725-45fe-976e-c23d964c6207 tempest-TestInstancesWithCinderVolumes-1055681914 None] Attempting download of 98edfd5c-def9-4b9d-bc51-f36eb47cd9ba ((None, [{'url': 'file:///opt/stack/data/glance/images/98edfd5c-def9-4b9d-bc51-f36eb47cd9ba', 'metadata': {}}])) to volume c3ed928e-4587-4bb3-bfa2-d57572ce2e23. {{(pid=88568) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 30 17:02:54 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[5183cf72-d53c-48dd-b43a-b72c5b9bbc8e]: (4, 'raw') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:02:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a80ed032-d725-45fe-976e-c23d964c6207 tempest-TestInstancesWithCinderVolumes-1055681914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_98edfd5c-def9-4b9d-bc51-f36eb47cd9ba_gc_vqevn {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:54 devstack sudo[102555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_98edfd5c-def9-4b9d-bc51-f36eb47cd9ba_gc_vqevn Jul 30 17:02:54 devstack sudo[102555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:55 devstack sudo[102555]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a80ed032-d725-45fe-976e-c23d964c6207 tempest-TestInstancesWithCinderVolumes-1055681914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_98edfd5c-def9-4b9d-bc51-f36eb47cd9ba_gc_vqevn" returned: 0 in 0.363s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a80ed032-d725-45fe-976e-c23d964c6207 tempest-TestInstancesWithCinderVolumes-1055681914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_98edfd5c-def9-4b9d-bc51-f36eb47cd9ba_gc_vqevn {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:55 devstack sudo[102560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_98edfd5c-def9-4b9d-bc51-f36eb47cd9ba_gc_vqevn Jul 30 17:02:55 devstack sudo[102560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:55 devstack sudo[102560]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a80ed032-d725-45fe-976e-c23d964c6207 tempest-TestInstancesWithCinderVolumes-1055681914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_98edfd5c-def9-4b9d-bc51-f36eb47cd9ba_gc_vqevn" returned: 1 in 0.369s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a80ed032-d725-45fe-976e-c23d964c6207 tempest-TestInstancesWithCinderVolumes-1055681914 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_98edfd5c-def9-4b9d-bc51-f36eb47cd9ba_gc_vqevn' failed. Not Retrying. {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 17:02:55 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[03af6457-0d70-42f7-bbc1-7ee3e35da4b7]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:02:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a80ed032-d725-45fe-976e-c23d964c6207 tempest-TestInstancesWithCinderVolumes-1055681914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_98edfd5c-def9-4b9d-bc51-f36eb47cd9ba_6610fkyedevstack@QuobyteHD {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:55 devstack sudo[102564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_98edfd5c-def9-4b9d-bc51-f36eb47cd9ba_6610fkyedevstack@QuobyteHD Jul 30 17:02:55 devstack sudo[102564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:55 devstack sudo[102564]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a80ed032-d725-45fe-976e-c23d964c6207 tempest-TestInstancesWithCinderVolumes-1055681914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_98edfd5c-def9-4b9d-bc51-f36eb47cd9ba_6610fkyedevstack@QuobyteHD" returned: 0 in 0.341s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:55 devstack cinder-volume[88568]: DEBUG cinder.image.image_utils [None req-a80ed032-d725-45fe-976e-c23d964c6207 tempest-TestInstancesWithCinderVolumes-1055681914 None] 98edfd5c-def9-4b9d-bc51-f36eb47cd9ba was qcow2, converting to qcow2 {{(pid=88568) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 30 17:02:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a80ed032-d725-45fe-976e-c23d964c6207 tempest-TestInstancesWithCinderVolumes-1055681914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_98edfd5c-def9-4b9d-bc51-f36eb47cd9ba_6610fkyedevstack@QuobyteHD /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c3ed928e-4587-4bb3-bfa2-d57572ce2e23 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:55 devstack sudo[102569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_98edfd5c-def9-4b9d-bc51-f36eb47cd9ba_6610fkyedevstack@QuobyteHD /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c3ed928e-4587-4bb3-bfa2-d57572ce2e23 Jul 30 17:02:55 devstack sudo[102569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:57 devstack sudo[102569]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a80ed032-d725-45fe-976e-c23d964c6207 tempest-TestInstancesWithCinderVolumes-1055681914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_98edfd5c-def9-4b9d-bc51-f36eb47cd9ba_6610fkyedevstack@QuobyteHD /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c3ed928e-4587-4bb3-bfa2-d57572ce2e23" returned: 0 in 1.876s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:57 devstack cinder-volume[88568]: DEBUG cinder.image.image_utils [None req-a80ed032-d725-45fe-976e-c23d964c6207 tempest-TestInstancesWithCinderVolumes-1055681914 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_98edfd5c-def9-4b9d-bc51-f36eb47cd9ba_6610fkyedevstack@QuobyteHD, size 112.00 MB, duration 1.88 sec, destination /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c3ed928e-4587-4bb3-bfa2-d57572ce2e23 {{(pid=88568) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 17:02:57 devstack cinder-volume[88568]: INFO cinder.image.image_utils [None req-a80ed032-d725-45fe-976e-c23d964c6207 tempest-TestInstancesWithCinderVolumes-1055681914 None] Converted 112.00 MB image at 59.65 MB/s Jul 30 17:02:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a80ed032-d725-45fe-976e-c23d964c6207 tempest-TestInstancesWithCinderVolumes-1055681914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c3ed928e-4587-4bb3-bfa2-d57572ce2e23 1G {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:57 devstack sudo[102578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c3ed928e-4587-4bb3-bfa2-d57572ce2e23 1G Jul 30 17:02:57 devstack sudo[102578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:57 devstack sudo[102578]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a80ed032-d725-45fe-976e-c23d964c6207 tempest-TestInstancesWithCinderVolumes-1055681914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c3ed928e-4587-4bb3-bfa2-d57572ce2e23 1G" returned: 0 in 0.361s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:57 devstack cinder-volume[88568]: DEBUG cinder.volume.volume_utils [None req-a80ed032-d725-45fe-976e-c23d964c6207 tempest-TestInstancesWithCinderVolumes-1055681914 None] Downloaded image 98edfd5c-def9-4b9d-bc51-f36eb47cd9ba ((None, [{'url': 'file:///opt/stack/data/glance/images/98edfd5c-def9-4b9d-bc51-f36eb47cd9ba', 'metadata': {}}])) to volume c3ed928e-4587-4bb3-bfa2-d57572ce2e23 successfully. {{(pid=88568) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 30 17:02:57 devstack cinder-volume[88568]: DEBUG cinder.image.image_utils [None req-a80ed032-d725-45fe-976e-c23d964c6207 tempest-TestInstancesWithCinderVolumes-1055681914 None] Temporary image 98edfd5c-def9-4b9d-bc51-f36eb47cd9ba for user e4b1eb99e4554a71aa038a63533fdb2b is deleted. {{(pid=88568) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 30 17:02:57 devstack cinder-volume[88568]: DEBUG cinder.volume.volume_utils [None req-a80ed032-d725-45fe-976e-c23d964c6207 tempest-TestInstancesWithCinderVolumes-1055681914 None] Marking volume c3ed928e-4587-4bb3-bfa2-d57572ce2e23 as bootable. {{(pid=88568) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 30 17:02:58 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-a80ed032-d725-45fe-976e-c23d964c6207 tempest-TestInstancesWithCinderVolumes-1055681914 None] Copying metadata from image 98edfd5c-def9-4b9d-bc51-f36eb47cd9ba to c3ed928e-4587-4bb3-bfa2-d57572ce2e23. {{(pid=88568) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 30 17:02:58 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-a80ed032-d725-45fe-976e-c23d964c6207 tempest-TestInstancesWithCinderVolumes-1055681914 None] Creating volume glance metadata for volume c3ed928e-4587-4bb3-bfa2-d57572ce2e23 backed by image 98edfd5c-def9-4b9d-bc51-f36eb47cd9ba with: {'image_id': '98edfd5c-def9-4b9d-bc51-f36eb47cd9ba', 'image_name': 'tempest-scenario-img--1358701673', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88568) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 30 17:02:58 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a80ed032-d725-45fe-976e-c23d964c6207 tempest-TestInstancesWithCinderVolumes-1055681914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98fc1244-353c-4b49-82ee-71e8c4f63276) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3ed928e-4587-4bb3-bfa2-d57572ce2e23', 'volume_size': 1, 'image_id': '98edfd5c-def9-4b9d-bc51-f36eb47cd9ba', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/98edfd5c-def9-4b9d-bc51-f36eb47cd9ba', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1358701673', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '53af0c66c22f4afbbb9af7bf7dd3691b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '98edfd5c-def9-4b9d-bc51-f36eb47cd9ba', 'created_at': datetime.datetime(2026, 7, 30, 15, 2, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 15, 2, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/98edfd5c-def9-4b9d-bc51-f36eb47cd9ba/file', 'properties': {}}, 'image_service': }' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:58 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a80ed032-d725-45fe-976e-c23d964c6207 tempest-TestInstancesWithCinderVolumes-1055681914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecd69077-3670-40ce-91d3-05f80079ca6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:58 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-a80ed032-d725-45fe-976e-c23d964c6207 tempest-TestInstancesWithCinderVolumes-1055681914 None] Volume volume-c3ed928e-4587-4bb3-bfa2-d57572ce2e23 (c3ed928e-4587-4bb3-bfa2-d57572ce2e23): created successfully Jul 30 17:02:58 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a80ed032-d725-45fe-976e-c23d964c6207 tempest-TestInstancesWithCinderVolumes-1055681914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecd69077-3670-40ce-91d3-05f80079ca6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:58 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a80ed032-d725-45fe-976e-c23d964c6207 tempest-TestInstancesWithCinderVolumes-1055681914 None] Flow 'volume_create_manager' (5b4781a2-19d9-48d0-833b-cdacf5428da9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:02:58 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-a80ed032-d725-45fe-976e-c23d964c6207 tempest-TestInstancesWithCinderVolumes-1055681914 None] Created volume successfully. Jul 30 17:03:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-bd33bb18-9bc4-435e-bd19-74f385aef9e8 req-8dab3c0c-70bc-4771-abf6-1b80fea7b232 tempest-TestInstancesWithCinderVolumes-1055681914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:03:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-bd33bb18-9bc4-435e-bd19-74f385aef9e8 req-8dab3c0c-70bc-4771-abf6-1b80fea7b232 tempest-TestInstancesWithCinderVolumes-1055681914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:03:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-bd33bb18-9bc4-435e-bd19-74f385aef9e8 req-8dab3c0c-70bc-4771-abf6-1b80fea7b232 tempest-TestInstancesWithCinderVolumes-1055681914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:03:01 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [req-bd33bb18-9bc4-435e-bd19-74f385aef9e8 req-8dab3c0c-70bc-4771-abf6-1b80fea7b232 tempest-TestInstancesWithCinderVolumes-1055681914 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924', 'name': 'volume-c3ed928e-4587-4bb3-bfa2-d57572ce2e23', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ec264b6b-822a-44c2-be29-d7c65ce4124d', 'enforce_multipath': True} {{(pid=88568) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 17:03:01 devstack cinder-volume[88568]: INFO cinder.volume.manager [req-bd33bb18-9bc4-435e-bd19-74f385aef9e8 req-8dab3c0c-70bc-4771-abf6-1b80fea7b232 tempest-TestInstancesWithCinderVolumes-1055681914 None] attachment_update completed successfully. Jul 30 17:03:11 devstack cinder-volume[88568]: DEBUG dbcounter [-] [88568] Writing DB stats cinder:UPDATE=15,cinder:SELECT=16,cinder:INSERT=7,cinder:DELETE=1 {{(pid=88568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 17:03:11 devstack cinder-volume[88568]: DEBUG dbcounter [-] [88568] Writing DB stats cinder:SELECT=21,cinder:UPDATE=10,cinder:DELETE=2,cinder:INSERT=5 {{(pid=88568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 17:03:27 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-e025cda9-f8b1-44d1-a4a4-cd984e542cdc tempest-TestServerVolumeAttachScenarioOldVersion-1477530148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:03:27 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e025cda9-f8b1-44d1-a4a4-cd984e542cdc tempest-TestServerVolumeAttachScenarioOldVersion-1477530148 None] Flow 'volume_create_manager' (1ef74f38-4c8f-47da-ad4c-8b7b57bfc354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:03:27 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e025cda9-f8b1-44d1-a4a4-cd984e542cdc tempest-TestServerVolumeAttachScenarioOldVersion-1477530148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af67646b-01f8-424f-81c7-cfb2f2cf58e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:27 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e025cda9-f8b1-44d1-a4a4-cd984e542cdc tempest-TestServerVolumeAttachScenarioOldVersion-1477530148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af67646b-01f8-424f-81c7-cfb2f2cf58e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:03:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-895239517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=650f3f8b-75e9-47ef-9f20-180bc515574b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bbd926f89544437aec3de3558c4502d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:03:28Z,use_quota=True,user_id='8ed7579981284548b150ec3bcc279bcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:28 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e025cda9-f8b1-44d1-a4a4-cd984e542cdc tempest-TestServerVolumeAttachScenarioOldVersion-1477530148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d6f5d8c-3ccb-459f-a672-8104d3daedab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:28 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e025cda9-f8b1-44d1-a4a4-cd984e542cdc tempest-TestServerVolumeAttachScenarioOldVersion-1477530148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d6f5d8c-3ccb-459f-a672-8104d3daedab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:28 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e025cda9-f8b1-44d1-a4a4-cd984e542cdc tempest-TestServerVolumeAttachScenarioOldVersion-1477530148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d51fe31e-3d90-4100-a07f-0b4fb5b0c5db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:28 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e025cda9-f8b1-44d1-a4a4-cd984e542cdc tempest-TestServerVolumeAttachScenarioOldVersion-1477530148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d51fe31e-3d90-4100-a07f-0b4fb5b0c5db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '650f3f8b-75e9-47ef-9f20-180bc515574b', 'volume_name': 'volume-650f3f8b-75e9-47ef-9f20-180bc515574b', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:28 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e025cda9-f8b1-44d1-a4a4-cd984e542cdc tempest-TestServerVolumeAttachScenarioOldVersion-1477530148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43d10a7e-0b8d-44b0-9e93-43b12b5f7891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:28 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e025cda9-f8b1-44d1-a4a4-cd984e542cdc tempest-TestServerVolumeAttachScenarioOldVersion-1477530148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43d10a7e-0b8d-44b0-9e93-43b12b5f7891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:28 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e025cda9-f8b1-44d1-a4a4-cd984e542cdc tempest-TestServerVolumeAttachScenarioOldVersion-1477530148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a7b7104-52d2-4803-b11d-f98c3a932803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:28 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-e025cda9-f8b1-44d1-a4a4-cd984e542cdc tempest-TestServerVolumeAttachScenarioOldVersion-1477530148 None] Volume 650f3f8b-75e9-47ef-9f20-180bc515574b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-650f3f8b-75e9-47ef-9f20-180bc515574b', 'volume_size': 1} Jul 30 17:03:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-e025cda9-f8b1-44d1-a4a4-cd984e542cdc tempest-TestServerVolumeAttachScenarioOldVersion-1477530148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:03:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-e025cda9-f8b1-44d1-a4a4-cd984e542cdc tempest-TestServerVolumeAttachScenarioOldVersion-1477530148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:03:28 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-e025cda9-f8b1-44d1-a4a4-cd984e542cdc tempest-TestServerVolumeAttachScenarioOldVersion-1477530148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:03:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-895239517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=650f3f8b-75e9-47ef-9f20-180bc515574b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bbd926f89544437aec3de3558c4502d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:03:28Z,use_quota=True,user_id='8ed7579981284548b150ec3bcc279bcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:03:28 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-e025cda9-f8b1-44d1-a4a4-cd984e542cdc tempest-TestServerVolumeAttachScenarioOldVersion-1477530148 None] Creating volume 650f3f8b-75e9-47ef-9f20-180bc515574b {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:03:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-e025cda9-f8b1-44d1-a4a4-cd984e542cdc tempest-TestServerVolumeAttachScenarioOldVersion-1477530148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:03:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-e025cda9-f8b1-44d1-a4a4-cd984e542cdc tempest-TestServerVolumeAttachScenarioOldVersion-1477530148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:03:28 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-e025cda9-f8b1-44d1-a4a4-cd984e542cdc tempest-TestServerVolumeAttachScenarioOldVersion-1477530148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:03:28 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-e025cda9-f8b1-44d1-a4a4-cd984e542cdc tempest-TestServerVolumeAttachScenarioOldVersion-1477530148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:03:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-e025cda9-f8b1-44d1-a4a4-cd984e542cdc tempest-TestServerVolumeAttachScenarioOldVersion-1477530148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:03:28 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-e025cda9-f8b1-44d1-a4a4-cd984e542cdc tempest-TestServerVolumeAttachScenarioOldVersion-1477530148 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:03:28 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-e025cda9-f8b1-44d1-a4a4-cd984e542cdc tempest-TestServerVolumeAttachScenarioOldVersion-1477530148 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:03:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e025cda9-f8b1-44d1-a4a4-cd984e542cdc tempest-TestServerVolumeAttachScenarioOldVersion-1477530148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-650f3f8b-75e9-47ef-9f20-180bc515574b 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:28 devstack sudo[103213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-650f3f8b-75e9-47ef-9f20-180bc515574b 1073741824 Jul 30 17:03:28 devstack sudo[103213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:28 devstack sudo[103213]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e025cda9-f8b1-44d1-a4a4-cd984e542cdc tempest-TestServerVolumeAttachScenarioOldVersion-1477530148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-650f3f8b-75e9-47ef-9f20-180bc515574b 1073741824" returned: 0 in 0.406s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e025cda9-f8b1-44d1-a4a4-cd984e542cdc tempest-TestServerVolumeAttachScenarioOldVersion-1477530148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-650f3f8b-75e9-47ef-9f20-180bc515574b {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:28 devstack sudo[103219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-650f3f8b-75e9-47ef-9f20-180bc515574b Jul 30 17:03:28 devstack sudo[103219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:28 devstack sudo[103219]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e025cda9-f8b1-44d1-a4a4-cd984e542cdc tempest-TestServerVolumeAttachScenarioOldVersion-1477530148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-650f3f8b-75e9-47ef-9f20-180bc515574b" returned: 0 in 0.234s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:28 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-e025cda9-f8b1-44d1-a4a4-cd984e542cdc tempest-TestServerVolumeAttachScenarioOldVersion-1477530148 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:03:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-e025cda9-f8b1-44d1-a4a4-cd984e542cdc tempest-TestServerVolumeAttachScenarioOldVersion-1477530148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:03:28 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e025cda9-f8b1-44d1-a4a4-cd984e542cdc tempest-TestServerVolumeAttachScenarioOldVersion-1477530148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a7b7104-52d2-4803-b11d-f98c3a932803) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-650f3f8b-75e9-47ef-9f20-180bc515574b', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:28 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e025cda9-f8b1-44d1-a4a4-cd984e542cdc tempest-TestServerVolumeAttachScenarioOldVersion-1477530148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (347bb949-7c96-41a2-a88e-63b8e4756412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:28 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-e025cda9-f8b1-44d1-a4a4-cd984e542cdc tempest-TestServerVolumeAttachScenarioOldVersion-1477530148 None] Volume volume-650f3f8b-75e9-47ef-9f20-180bc515574b (650f3f8b-75e9-47ef-9f20-180bc515574b): created successfully Jul 30 17:03:28 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e025cda9-f8b1-44d1-a4a4-cd984e542cdc tempest-TestServerVolumeAttachScenarioOldVersion-1477530148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (347bb949-7c96-41a2-a88e-63b8e4756412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:28 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e025cda9-f8b1-44d1-a4a4-cd984e542cdc tempest-TestServerVolumeAttachScenarioOldVersion-1477530148 None] Flow 'volume_create_manager' (1ef74f38-4c8f-47da-ad4c-8b7b57bfc354) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:03:28 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-e025cda9-f8b1-44d1-a4a4-cd984e542cdc tempest-TestServerVolumeAttachScenarioOldVersion-1477530148 None] Created volume successfully. Jul 30 17:03:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-1f8b640d-c2a0-4d4c-b7de-ce6ec296f0a5 req-0995f635-debf-430e-8df0-c4a7e277a929 tempest-TestServerVolumeAttachScenarioOldVersion-1477530148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:03:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-1f8b640d-c2a0-4d4c-b7de-ce6ec296f0a5 req-0995f635-debf-430e-8df0-c4a7e277a929 tempest-TestServerVolumeAttachScenarioOldVersion-1477530148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:03:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-1f8b640d-c2a0-4d4c-b7de-ce6ec296f0a5 req-0995f635-debf-430e-8df0-c4a7e277a929 tempest-TestServerVolumeAttachScenarioOldVersion-1477530148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:03:29 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [req-1f8b640d-c2a0-4d4c-b7de-ce6ec296f0a5 req-0995f635-debf-430e-8df0-c4a7e277a929 tempest-TestServerVolumeAttachScenarioOldVersion-1477530148 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924', 'name': 'volume-650f3f8b-75e9-47ef-9f20-180bc515574b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6fad8021-39fc-4a3e-8f9a-9243df3f3763', 'enforce_multipath': True} {{(pid=88568) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 17:03:29 devstack cinder-volume[88568]: INFO cinder.volume.manager [req-1f8b640d-c2a0-4d4c-b7de-ce6ec296f0a5 req-0995f635-debf-430e-8df0-c4a7e277a929 tempest-TestServerVolumeAttachScenarioOldVersion-1477530148 None] attachment_update completed successfully. Jul 30 17:03:31 devstack cinder-volume[88568]: INFO cinder.volume.manager [req-0525e0c3-ac36-4080-8492-3fc16aac7938 req-d6bfc6a4-e6b8-49e3-a25d-e6917ac577cd tempest-TestServerVolumeAttachScenarioOldVersion-1477530148 None] Terminate volume connection completed successfully. Jul 30 17:03:31 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [req-0525e0c3-ac36-4080-8492-3fc16aac7938 req-d6bfc6a4-e6b8-49e3-a25d-e6917ac577cd tempest-TestServerVolumeAttachScenarioOldVersion-1477530148 None] Deleting attachment 6fad8021-39fc-4a3e-8f9a-9243df3f3763. {{(pid=88568) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 17:03:32 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-d7566b0c-c77f-474c-892e-43f40b6a2342 tempest-TestServerVolumeAttachScenarioOldVersion-1477530148 None] Acquiring lock "cinder-650f3f8b-75e9-47ef-9f20-180bc515574b-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:03:32 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-d7566b0c-c77f-474c-892e-43f40b6a2342 tempest-TestServerVolumeAttachScenarioOldVersion-1477530148 None] Lock "cinder-650f3f8b-75e9-47ef-9f20-180bc515574b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:03:32 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-d7566b0c-c77f-474c-892e-43f40b6a2342 tempest-TestServerVolumeAttachScenarioOldVersion-1477530148 None] Acquiring lock "cinder-quobyte-650f3f8b-75e9-47ef-9f20-180bc515574b" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:03:32 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-d7566b0c-c77f-474c-892e-43f40b6a2342 tempest-TestServerVolumeAttachScenarioOldVersion-1477530148 None] Lock "cinder-quobyte-650f3f8b-75e9-47ef-9f20-180bc515574b" acquired by "delete_volume" :: waited 0.020s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:03:32 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eca7d08-84a1-466d-814c-334169b16aba]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:03:32 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d7566b0c-c77f-474c-892e-43f40b6a2342 tempest-TestServerVolumeAttachScenarioOldVersion-1477530148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-650f3f8b-75e9-47ef-9f20-180bc515574b {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:32 devstack sudo[103254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-650f3f8b-75e9-47ef-9f20-180bc515574b Jul 30 17:03:32 devstack sudo[103254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:33 devstack sudo[103254]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:33 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d7566b0c-c77f-474c-892e-43f40b6a2342 tempest-TestServerVolumeAttachScenarioOldVersion-1477530148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-650f3f8b-75e9-47ef-9f20-180bc515574b" returned: 0 in 0.378s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:33 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d7566b0c-c77f-474c-892e-43f40b6a2342 tempest-TestServerVolumeAttachScenarioOldVersion-1477530148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-650f3f8b-75e9-47ef-9f20-180bc515574b {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:33 devstack sudo[103260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-650f3f8b-75e9-47ef-9f20-180bc515574b Jul 30 17:03:33 devstack sudo[103260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:33 devstack sudo[103260]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:33 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d7566b0c-c77f-474c-892e-43f40b6a2342 tempest-TestServerVolumeAttachScenarioOldVersion-1477530148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-650f3f8b-75e9-47ef-9f20-180bc515574b" returned: 0 in 0.247s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:33 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-d7566b0c-c77f-474c-892e-43f40b6a2342 tempest-TestServerVolumeAttachScenarioOldVersion-1477530148 None] Lock "cinder-quobyte-650f3f8b-75e9-47ef-9f20-180bc515574b" released by "delete_volume" :: held 0.663s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:03:33 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-d7566b0c-c77f-474c-892e-43f40b6a2342 tempest-TestServerVolumeAttachScenarioOldVersion-1477530148 None] Created reservations ['e7a493b7-dbfe-4550-8431-a90aa323a7e5', 'd6fddf22-d2b0-4c88-b6a8-a641b8e37f9f', 'caec4523-621c-4a80-bef7-402a2545471f', '3fb2789d-5802-4158-ac80-6f5ba05b185b'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:03:33 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-d7566b0c-c77f-474c-892e-43f40b6a2342 tempest-TestServerVolumeAttachScenarioOldVersion-1477530148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:03:33 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-d7566b0c-c77f-474c-892e-43f40b6a2342 tempest-TestServerVolumeAttachScenarioOldVersion-1477530148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:03:33 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-d7566b0c-c77f-474c-892e-43f40b6a2342 tempest-TestServerVolumeAttachScenarioOldVersion-1477530148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:03:33 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-d7566b0c-c77f-474c-892e-43f40b6a2342 tempest-TestServerVolumeAttachScenarioOldVersion-1477530148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:03:33 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-d7566b0c-c77f-474c-892e-43f40b6a2342 tempest-TestServerVolumeAttachScenarioOldVersion-1477530148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:03:33 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d7566b0c-c77f-474c-892e-43f40b6a2342 tempest-TestServerVolumeAttachScenarioOldVersion-1477530148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:33 devstack sudo[103263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:03:33 devstack sudo[103263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:33 devstack sudo[103263]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:33 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d7566b0c-c77f-474c-892e-43f40b6a2342 tempest-TestServerVolumeAttachScenarioOldVersion-1477530148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.241s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:33 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-d7566b0c-c77f-474c-892e-43f40b6a2342 tempest-TestServerVolumeAttachScenarioOldVersion-1477530148 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:03:33 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-d7566b0c-c77f-474c-892e-43f40b6a2342 tempest-TestServerVolumeAttachScenarioOldVersion-1477530148 None] Deleted volume successfully. Jul 30 17:03:33 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-d7566b0c-c77f-474c-892e-43f40b6a2342 tempest-TestServerVolumeAttachScenarioOldVersion-1477530148 None] Lock "cinder-650f3f8b-75e9-47ef-9f20-180bc515574b-delete_volume" released by "delete_volume" :: held 1.105s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:03:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-20026b4e-1fa3-4746-81f4-86a9b26409c9 req-721befb5-631f-4ebc-a8b3-b36015a920f2 tempest-TestInstancesWithCinderVolumes-1055681914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:03:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-20026b4e-1fa3-4746-81f4-86a9b26409c9 req-721befb5-631f-4ebc-a8b3-b36015a920f2 tempest-TestInstancesWithCinderVolumes-1055681914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:03:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-20026b4e-1fa3-4746-81f4-86a9b26409c9 req-721befb5-631f-4ebc-a8b3-b36015a920f2 tempest-TestInstancesWithCinderVolumes-1055681914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:03:36 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [req-20026b4e-1fa3-4746-81f4-86a9b26409c9 req-721befb5-631f-4ebc-a8b3-b36015a920f2 tempest-TestInstancesWithCinderVolumes-1055681914 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924', 'name': 'volume-eb15f1af-4b3a-4310-b4c5-3d5e8187be5f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0cbaca61-90c0-4c41-956a-8e4e23ff5548', 'enforce_multipath': True} {{(pid=88568) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 17:03:36 devstack cinder-volume[88568]: INFO cinder.volume.manager [req-20026b4e-1fa3-4746-81f4-86a9b26409c9 req-721befb5-631f-4ebc-a8b3-b36015a920f2 tempest-TestInstancesWithCinderVolumes-1055681914 None] attachment_update completed successfully. Jul 30 17:03:39 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-b90bae26-a702-4722-8dd4-46141d9f4443 req-3f0665df-1753-4016-932c-bd20c07782d0 tempest-TestInstancesWithCinderVolumes-1055681914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:03:39 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-b90bae26-a702-4722-8dd4-46141d9f4443 req-3f0665df-1753-4016-932c-bd20c07782d0 tempest-TestInstancesWithCinderVolumes-1055681914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:03:39 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-b90bae26-a702-4722-8dd4-46141d9f4443 req-3f0665df-1753-4016-932c-bd20c07782d0 tempest-TestInstancesWithCinderVolumes-1055681914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:03:39 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [req-b90bae26-a702-4722-8dd4-46141d9f4443 req-3f0665df-1753-4016-932c-bd20c07782d0 tempest-TestInstancesWithCinderVolumes-1055681914 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924', 'name': 'volume-5af88b53-2057-4db6-a129-7b6094edc355', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cadedf2b-9daf-4282-a7ce-b24e151396cd', 'enforce_multipath': True} {{(pid=88568) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 17:03:39 devstack cinder-volume[88568]: INFO cinder.volume.manager [req-b90bae26-a702-4722-8dd4-46141d9f4443 req-3f0665df-1753-4016-932c-bd20c07782d0 tempest-TestInstancesWithCinderVolumes-1055681914 None] attachment_update completed successfully. Jul 30 17:03:45 devstack cinder-volume[88568]: INFO cinder.volume.manager [req-91fd7bb0-8a36-4da8-80d8-0872951f07be req-d7431e93-3e9b-4a17-aac3-02b3ff82d75a tempest-TestInstancesWithCinderVolumes-1055681914 None] Terminate volume connection completed successfully. Jul 30 17:03:45 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [req-91fd7bb0-8a36-4da8-80d8-0872951f07be req-d7431e93-3e9b-4a17-aac3-02b3ff82d75a tempest-TestInstancesWithCinderVolumes-1055681914 None] Deleting attachment 0cbaca61-90c0-4c41-956a-8e4e23ff5548. {{(pid=88568) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 17:03:46 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-df90c218-72e0-4889-af3a-d68950375189 tempest-TestInstancesWithCinderVolumes-1055681914 None] Acquiring lock "cinder-eb15f1af-4b3a-4310-b4c5-3d5e8187be5f-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:03:46 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-df90c218-72e0-4889-af3a-d68950375189 tempest-TestInstancesWithCinderVolumes-1055681914 None] Lock "cinder-eb15f1af-4b3a-4310-b4c5-3d5e8187be5f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:03:46 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-df90c218-72e0-4889-af3a-d68950375189 tempest-TestInstancesWithCinderVolumes-1055681914 None] Acquiring lock "cinder-quobyte-eb15f1af-4b3a-4310-b4c5-3d5e8187be5f" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:03:46 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-df90c218-72e0-4889-af3a-d68950375189 tempest-TestInstancesWithCinderVolumes-1055681914 None] Lock "cinder-quobyte-eb15f1af-4b3a-4310-b4c5-3d5e8187be5f" acquired by "delete_volume" :: waited 0.025s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:03:46 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fbd64f9-9225-4a2d-a08a-0dc43f977523]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:03:46 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-df90c218-72e0-4889-af3a-d68950375189 tempest-TestInstancesWithCinderVolumes-1055681914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-eb15f1af-4b3a-4310-b4c5-3d5e8187be5f {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:46 devstack sudo[103421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-eb15f1af-4b3a-4310-b4c5-3d5e8187be5f Jul 30 17:03:46 devstack sudo[103421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:47 devstack sudo[103421]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-df90c218-72e0-4889-af3a-d68950375189 tempest-TestInstancesWithCinderVolumes-1055681914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-eb15f1af-4b3a-4310-b4c5-3d5e8187be5f" returned: 0 in 0.414s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-df90c218-72e0-4889-af3a-d68950375189 tempest-TestInstancesWithCinderVolumes-1055681914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-eb15f1af-4b3a-4310-b4c5-3d5e8187be5f {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:47 devstack sudo[103427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-eb15f1af-4b3a-4310-b4c5-3d5e8187be5f Jul 30 17:03:47 devstack sudo[103427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:47 devstack sudo[103427]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-df90c218-72e0-4889-af3a-d68950375189 tempest-TestInstancesWithCinderVolumes-1055681914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-eb15f1af-4b3a-4310-b4c5-3d5e8187be5f" returned: 0 in 0.259s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:47 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-df90c218-72e0-4889-af3a-d68950375189 tempest-TestInstancesWithCinderVolumes-1055681914 None] Lock "cinder-quobyte-eb15f1af-4b3a-4310-b4c5-3d5e8187be5f" released by "delete_volume" :: held 0.722s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:03:47 devstack cinder-volume[88568]: WARNING cinder.quota [None req-df90c218-72e0-4889-af3a-d68950375189 tempest-TestInstancesWithCinderVolumes-1055681914 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-489176890-716238939 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-489176890-716238939, it is now deprecated. Please use the default quota class for default quota. Jul 30 17:03:47 devstack cinder-volume[88568]: WARNING cinder.quota [None req-df90c218-72e0-4889-af3a-d68950375189 tempest-TestInstancesWithCinderVolumes-1055681914 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-489176890-716238939 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-489176890-716238939, it is now deprecated. Please use the default quota class for default quota. Jul 30 17:03:47 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-df90c218-72e0-4889-af3a-d68950375189 tempest-TestInstancesWithCinderVolumes-1055681914 None] Created reservations ['d27aee62-46f0-43ca-ad65-12918a31a5a1', 'd1aab9bc-92cf-426e-8752-353aaffd745a', '067a4244-d2cf-4b0e-b142-f5c7609b27a5', '3eaab159-780c-4caa-9003-b31661b1a3da'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:03:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-df90c218-72e0-4889-af3a-d68950375189 tempest-TestInstancesWithCinderVolumes-1055681914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:03:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-df90c218-72e0-4889-af3a-d68950375189 tempest-TestInstancesWithCinderVolumes-1055681914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:03:47 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-df90c218-72e0-4889-af3a-d68950375189 tempest-TestInstancesWithCinderVolumes-1055681914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:03:47 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-df90c218-72e0-4889-af3a-d68950375189 tempest-TestInstancesWithCinderVolumes-1055681914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:03:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-df90c218-72e0-4889-af3a-d68950375189 tempest-TestInstancesWithCinderVolumes-1055681914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:03:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-df90c218-72e0-4889-af3a-d68950375189 tempest-TestInstancesWithCinderVolumes-1055681914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:47 devstack sudo[103430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:03:47 devstack sudo[103430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:47 devstack sudo[103430]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-df90c218-72e0-4889-af3a-d68950375189 tempest-TestInstancesWithCinderVolumes-1055681914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.294s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:47 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-df90c218-72e0-4889-af3a-d68950375189 tempest-TestInstancesWithCinderVolumes-1055681914 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:03:47 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-df90c218-72e0-4889-af3a-d68950375189 tempest-TestInstancesWithCinderVolumes-1055681914 None] Deleted volume successfully. Jul 30 17:03:47 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-df90c218-72e0-4889-af3a-d68950375189 tempest-TestInstancesWithCinderVolumes-1055681914 None] Lock "cinder-eb15f1af-4b3a-4310-b4c5-3d5e8187be5f-delete_volume" released by "delete_volume" :: held 1.262s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:03:50 devstack cinder-volume[88568]: INFO cinder.volume.manager [req-ebd1ac0d-8c1c-4b6a-9ce0-ece295c7dac6 req-8e8eeb3b-4f46-42e4-be26-188223f442bc tempest-TestInstancesWithCinderVolumes-1055681914 None] Terminate volume connection completed successfully. Jul 30 17:03:50 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [req-ebd1ac0d-8c1c-4b6a-9ce0-ece295c7dac6 req-8e8eeb3b-4f46-42e4-be26-188223f442bc tempest-TestInstancesWithCinderVolumes-1055681914 None] Deleting attachment cadedf2b-9daf-4282-a7ce-b24e151396cd. {{(pid=88568) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 17:03:51 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-36c81fda-b95d-48b6-82df-4be736a0aea8 tempest-TestInstancesWithCinderVolumes-1055681914 None] Acquiring lock "cinder-5af88b53-2057-4db6-a129-7b6094edc355-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:03:51 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-36c81fda-b95d-48b6-82df-4be736a0aea8 tempest-TestInstancesWithCinderVolumes-1055681914 None] Lock "cinder-5af88b53-2057-4db6-a129-7b6094edc355-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:03:51 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-36c81fda-b95d-48b6-82df-4be736a0aea8 tempest-TestInstancesWithCinderVolumes-1055681914 None] Acquiring lock "cinder-quobyte-5af88b53-2057-4db6-a129-7b6094edc355" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:03:51 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-36c81fda-b95d-48b6-82df-4be736a0aea8 tempest-TestInstancesWithCinderVolumes-1055681914 None] Lock "cinder-quobyte-5af88b53-2057-4db6-a129-7b6094edc355" acquired by "delete_volume" :: waited 0.023s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:03:51 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[50347ea7-bd45-4035-98ef-fdbdaae762f6]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:03:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-36c81fda-b95d-48b6-82df-4be736a0aea8 tempest-TestInstancesWithCinderVolumes-1055681914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5af88b53-2057-4db6-a129-7b6094edc355 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:51 devstack sudo[103465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5af88b53-2057-4db6-a129-7b6094edc355 Jul 30 17:03:51 devstack sudo[103465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:51 devstack sudo[103465]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-36c81fda-b95d-48b6-82df-4be736a0aea8 tempest-TestInstancesWithCinderVolumes-1055681914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5af88b53-2057-4db6-a129-7b6094edc355" returned: 0 in 0.416s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-36c81fda-b95d-48b6-82df-4be736a0aea8 tempest-TestInstancesWithCinderVolumes-1055681914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5af88b53-2057-4db6-a129-7b6094edc355 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:51 devstack sudo[103470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5af88b53-2057-4db6-a129-7b6094edc355 Jul 30 17:03:51 devstack sudo[103470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:51 devstack sudo[103470]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-36c81fda-b95d-48b6-82df-4be736a0aea8 tempest-TestInstancesWithCinderVolumes-1055681914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5af88b53-2057-4db6-a129-7b6094edc355" returned: 0 in 0.270s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:51 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-36c81fda-b95d-48b6-82df-4be736a0aea8 tempest-TestInstancesWithCinderVolumes-1055681914 None] Lock "cinder-quobyte-5af88b53-2057-4db6-a129-7b6094edc355" released by "delete_volume" :: held 0.736s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:03:52 devstack cinder-volume[88568]: WARNING cinder.quota [None req-36c81fda-b95d-48b6-82df-4be736a0aea8 tempest-TestInstancesWithCinderVolumes-1055681914 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-763349120-233048018 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-763349120-233048018, it is now deprecated. Please use the default quota class for default quota. Jul 30 17:03:52 devstack cinder-volume[88568]: WARNING cinder.quota [None req-36c81fda-b95d-48b6-82df-4be736a0aea8 tempest-TestInstancesWithCinderVolumes-1055681914 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-763349120-233048018 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-763349120-233048018, it is now deprecated. Please use the default quota class for default quota. Jul 30 17:03:52 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-36c81fda-b95d-48b6-82df-4be736a0aea8 tempest-TestInstancesWithCinderVolumes-1055681914 None] Created reservations ['a6c7ac5c-4ecc-46df-ad31-8c4958e1fa53', 'b3b0633b-2b3c-46df-a9c2-09d7a6cd4173', 'd262a450-65dc-4b6a-969c-202b64f38b0a', '435a4c72-24f2-464d-80a6-81f5e9ff8b27'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:03:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-36c81fda-b95d-48b6-82df-4be736a0aea8 tempest-TestInstancesWithCinderVolumes-1055681914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:03:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-36c81fda-b95d-48b6-82df-4be736a0aea8 tempest-TestInstancesWithCinderVolumes-1055681914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:03:52 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-36c81fda-b95d-48b6-82df-4be736a0aea8 tempest-TestInstancesWithCinderVolumes-1055681914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:03:52 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-36c81fda-b95d-48b6-82df-4be736a0aea8 tempest-TestInstancesWithCinderVolumes-1055681914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:03:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-36c81fda-b95d-48b6-82df-4be736a0aea8 tempest-TestInstancesWithCinderVolumes-1055681914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:03:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-36c81fda-b95d-48b6-82df-4be736a0aea8 tempest-TestInstancesWithCinderVolumes-1055681914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:52 devstack sudo[103473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:03:52 devstack sudo[103473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:52 devstack cinder-volume[88568]: DEBUG oslo_service.periodic_task [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 17:03:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:03:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:03:52 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:03:52 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:03:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:03:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:52 devstack sudo[103473]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-36c81fda-b95d-48b6-82df-4be736a0aea8 tempest-TestInstancesWithCinderVolumes-1055681914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.404s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:52 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-36c81fda-b95d-48b6-82df-4be736a0aea8 tempest-TestInstancesWithCinderVolumes-1055681914 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:03:52 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-36c81fda-b95d-48b6-82df-4be736a0aea8 tempest-TestInstancesWithCinderVolumes-1055681914 None] Deleted volume successfully. Jul 30 17:03:52 devstack sudo[103477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:03:52 devstack sudo[103477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:52 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-36c81fda-b95d-48b6-82df-4be736a0aea8 tempest-TestInstancesWithCinderVolumes-1055681914 None] Lock "cinder-5af88b53-2057-4db6-a129-7b6094edc355-delete_volume" released by "delete_volume" :: held 1.408s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:03:52 devstack sudo[103477]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.303s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:52 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:03:52 devstack cinder-volume[88568]: DEBUG oslo_service.periodic_task [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Running periodic task VolumeManager._thread_info {{(pid=88568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 17:03:52 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] thread count: 28 {{(pid=88568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 17:03:52 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] thread info: [<_MainThread(MainThread, started 127406866608256)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 17:03:57 devstack cinder-volume[88568]: INFO cinder.volume.manager [req-6188629f-7219-491b-a8a9-557849e3df90 req-0305261a-80b9-4708-ae51-56f28beca79f tempest-TestInstancesWithCinderVolumes-1055681914 None] Terminate volume connection completed successfully. Jul 30 17:03:57 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [req-6188629f-7219-491b-a8a9-557849e3df90 req-0305261a-80b9-4708-ae51-56f28beca79f tempest-TestInstancesWithCinderVolumes-1055681914 None] Deleting attachment ec264b6b-822a-44c2-be29-d7c65ce4124d. {{(pid=88568) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 17:03:58 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-2933e314-83e9-49d2-9555-cbe361fa7cf6 tempest-TestInstancesWithCinderVolumes-1055681914 None] Acquiring lock "cinder-c3ed928e-4587-4bb3-bfa2-d57572ce2e23-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:03:58 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-2933e314-83e9-49d2-9555-cbe361fa7cf6 tempest-TestInstancesWithCinderVolumes-1055681914 None] Lock "cinder-c3ed928e-4587-4bb3-bfa2-d57572ce2e23-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:03:58 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-2933e314-83e9-49d2-9555-cbe361fa7cf6 tempest-TestInstancesWithCinderVolumes-1055681914 None] Acquiring lock "cinder-quobyte-c3ed928e-4587-4bb3-bfa2-d57572ce2e23" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:03:58 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-2933e314-83e9-49d2-9555-cbe361fa7cf6 tempest-TestInstancesWithCinderVolumes-1055681914 None] Lock "cinder-quobyte-c3ed928e-4587-4bb3-bfa2-d57572ce2e23" acquired by "delete_volume" :: waited 0.017s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:03:58 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd77c118-dd4b-4f42-a0e6-795f59ce5954]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:03:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2933e314-83e9-49d2-9555-cbe361fa7cf6 tempest-TestInstancesWithCinderVolumes-1055681914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c3ed928e-4587-4bb3-bfa2-d57572ce2e23 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:58 devstack sudo[103510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c3ed928e-4587-4bb3-bfa2-d57572ce2e23 Jul 30 17:03:58 devstack sudo[103510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:58 devstack sudo[103510]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2933e314-83e9-49d2-9555-cbe361fa7cf6 tempest-TestInstancesWithCinderVolumes-1055681914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c3ed928e-4587-4bb3-bfa2-d57572ce2e23" returned: 0 in 0.428s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2933e314-83e9-49d2-9555-cbe361fa7cf6 tempest-TestInstancesWithCinderVolumes-1055681914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c3ed928e-4587-4bb3-bfa2-d57572ce2e23 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:58 devstack sudo[103515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c3ed928e-4587-4bb3-bfa2-d57572ce2e23 Jul 30 17:03:58 devstack sudo[103515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:59 devstack sudo[103515]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2933e314-83e9-49d2-9555-cbe361fa7cf6 tempest-TestInstancesWithCinderVolumes-1055681914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c3ed928e-4587-4bb3-bfa2-d57572ce2e23" returned: 0 in 0.272s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:59 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-2933e314-83e9-49d2-9555-cbe361fa7cf6 tempest-TestInstancesWithCinderVolumes-1055681914 None] Lock "cinder-quobyte-c3ed928e-4587-4bb3-bfa2-d57572ce2e23" released by "delete_volume" :: held 0.751s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:03:59 devstack cinder-volume[88568]: WARNING cinder.quota [None req-2933e314-83e9-49d2-9555-cbe361fa7cf6 tempest-TestInstancesWithCinderVolumes-1055681914 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-765809910-1635079086 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-765809910-1635079086, it is now deprecated. Please use the default quota class for default quota. Jul 30 17:03:59 devstack cinder-volume[88568]: WARNING cinder.quota [None req-2933e314-83e9-49d2-9555-cbe361fa7cf6 tempest-TestInstancesWithCinderVolumes-1055681914 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-765809910-1635079086 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-765809910-1635079086, it is now deprecated. Please use the default quota class for default quota. Jul 30 17:03:59 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-2933e314-83e9-49d2-9555-cbe361fa7cf6 tempest-TestInstancesWithCinderVolumes-1055681914 None] Created reservations ['aedea4b1-8e1e-42ae-b14d-a12341d059b3', '89d01322-3770-47c0-94da-a5e7a148ef40', 'edeb47ad-6dbd-46db-a48b-a3f07494998f', '25dd248c-f230-4d79-9a87-90e8f05a9780'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:03:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-2933e314-83e9-49d2-9555-cbe361fa7cf6 tempest-TestInstancesWithCinderVolumes-1055681914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:03:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-2933e314-83e9-49d2-9555-cbe361fa7cf6 tempest-TestInstancesWithCinderVolumes-1055681914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:03:59 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-2933e314-83e9-49d2-9555-cbe361fa7cf6 tempest-TestInstancesWithCinderVolumes-1055681914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:03:59 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-2933e314-83e9-49d2-9555-cbe361fa7cf6 tempest-TestInstancesWithCinderVolumes-1055681914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:03:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-2933e314-83e9-49d2-9555-cbe361fa7cf6 tempest-TestInstancesWithCinderVolumes-1055681914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:03:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2933e314-83e9-49d2-9555-cbe361fa7cf6 tempest-TestInstancesWithCinderVolumes-1055681914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:59 devstack sudo[103518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:03:59 devstack sudo[103518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:59 devstack sudo[103518]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2933e314-83e9-49d2-9555-cbe361fa7cf6 tempest-TestInstancesWithCinderVolumes-1055681914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.302s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:59 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-2933e314-83e9-49d2-9555-cbe361fa7cf6 tempest-TestInstancesWithCinderVolumes-1055681914 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:03:59 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-2933e314-83e9-49d2-9555-cbe361fa7cf6 tempest-TestInstancesWithCinderVolumes-1055681914 None] Deleted volume successfully. Jul 30 17:03:59 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-2933e314-83e9-49d2-9555-cbe361fa7cf6 tempest-TestInstancesWithCinderVolumes-1055681914 None] Lock "cinder-c3ed928e-4587-4bb3-bfa2-d57572ce2e23-delete_volume" released by "delete_volume" :: held 1.261s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:04:09 devstack cinder-volume[88568]: DEBUG dbcounter [-] [88568] Writing DB stats cinder:SELECT=53,cinder:UPDATE=40,cinder:INSERT=8,cinder:DELETE=2 {{(pid=88568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 17:04:09 devstack cinder-volume[88568]: DEBUG dbcounter [-] [88568] Writing DB stats cinder:SELECT=38,cinder:UPDATE=39,cinder:DELETE=3,cinder:INSERT=9 {{(pid=88568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 17:04:13 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dc1b899-b838-41ce-9623-09b826553bbb tempest-TestStampPattern-1593609708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:04:13 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-5dc1b899-b838-41ce-9623-09b826553bbb tempest-TestStampPattern-1593609708 None] Flow 'volume_create_manager' (06ea2737-fddb-4218-8f5f-eb25538910bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:04:13 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-5dc1b899-b838-41ce-9623-09b826553bbb tempest-TestStampPattern-1593609708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5faea3cb-3f56-4976-b685-4e538906edd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:04:13 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-5dc1b899-b838-41ce-9623-09b826553bbb tempest-TestStampPattern-1593609708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5faea3cb-3f56-4976-b685-4e538906edd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:04:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1243376312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e974420e-98cc-41aa-8c88-dd8b5b713dce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3aac3344083b462f85bf960d622952e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:04:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:04:13Z,use_quota=True,user_id='83ca292805a34a299f62c025592d722a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:04:13 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-5dc1b899-b838-41ce-9623-09b826553bbb tempest-TestStampPattern-1593609708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb01789f-2965-47b5-8e03-c16764816cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:04:13 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-5dc1b899-b838-41ce-9623-09b826553bbb tempest-TestStampPattern-1593609708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb01789f-2965-47b5-8e03-c16764816cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:04:13 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-5dc1b899-b838-41ce-9623-09b826553bbb tempest-TestStampPattern-1593609708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d300309-a899-4b21-9ecb-be47a20058b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:04:13 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-5dc1b899-b838-41ce-9623-09b826553bbb tempest-TestStampPattern-1593609708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d300309-a899-4b21-9ecb-be47a20058b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e974420e-98cc-41aa-8c88-dd8b5b713dce', 'volume_name': 'volume-e974420e-98cc-41aa-8c88-dd8b5b713dce', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:04:13 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-5dc1b899-b838-41ce-9623-09b826553bbb tempest-TestStampPattern-1593609708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (accda53e-64ec-42f2-b823-59e15be154bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:04:13 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-5dc1b899-b838-41ce-9623-09b826553bbb tempest-TestStampPattern-1593609708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (accda53e-64ec-42f2-b823-59e15be154bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:04:13 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-5dc1b899-b838-41ce-9623-09b826553bbb tempest-TestStampPattern-1593609708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9464dda-52f1-4d99-938d-06290288fe14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:04:13 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-5dc1b899-b838-41ce-9623-09b826553bbb tempest-TestStampPattern-1593609708 None] Volume e974420e-98cc-41aa-8c88-dd8b5b713dce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e974420e-98cc-41aa-8c88-dd8b5b713dce', 'volume_size': 1} Jul 30 17:04:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-5dc1b899-b838-41ce-9623-09b826553bbb tempest-TestStampPattern-1593609708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:04:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-5dc1b899-b838-41ce-9623-09b826553bbb tempest-TestStampPattern-1593609708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:04:13 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-5dc1b899-b838-41ce-9623-09b826553bbb tempest-TestStampPattern-1593609708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:04:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1243376312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e974420e-98cc-41aa-8c88-dd8b5b713dce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3aac3344083b462f85bf960d622952e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:04:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:04:13Z,use_quota=True,user_id='83ca292805a34a299f62c025592d722a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:04:13 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-5dc1b899-b838-41ce-9623-09b826553bbb tempest-TestStampPattern-1593609708 None] Creating volume e974420e-98cc-41aa-8c88-dd8b5b713dce {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:04:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-5dc1b899-b838-41ce-9623-09b826553bbb tempest-TestStampPattern-1593609708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:04:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-5dc1b899-b838-41ce-9623-09b826553bbb tempest-TestStampPattern-1593609708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:04:13 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-5dc1b899-b838-41ce-9623-09b826553bbb tempest-TestStampPattern-1593609708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:04:13 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-5dc1b899-b838-41ce-9623-09b826553bbb tempest-TestStampPattern-1593609708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:04:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-5dc1b899-b838-41ce-9623-09b826553bbb tempest-TestStampPattern-1593609708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:04:13 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-5dc1b899-b838-41ce-9623-09b826553bbb tempest-TestStampPattern-1593609708 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:04:13 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-5dc1b899-b838-41ce-9623-09b826553bbb tempest-TestStampPattern-1593609708 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:04:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-5dc1b899-b838-41ce-9623-09b826553bbb tempest-TestStampPattern-1593609708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e974420e-98cc-41aa-8c88-dd8b5b713dce 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:13 devstack sudo[103531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e974420e-98cc-41aa-8c88-dd8b5b713dce 1073741824 Jul 30 17:04:13 devstack sudo[103531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:14 devstack sudo[103531]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-5dc1b899-b838-41ce-9623-09b826553bbb tempest-TestStampPattern-1593609708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e974420e-98cc-41aa-8c88-dd8b5b713dce 1073741824" returned: 0 in 0.511s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-5dc1b899-b838-41ce-9623-09b826553bbb tempest-TestStampPattern-1593609708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e974420e-98cc-41aa-8c88-dd8b5b713dce {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:14 devstack sudo[103537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e974420e-98cc-41aa-8c88-dd8b5b713dce Jul 30 17:04:14 devstack sudo[103537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:14 devstack sudo[103537]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-5dc1b899-b838-41ce-9623-09b826553bbb tempest-TestStampPattern-1593609708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e974420e-98cc-41aa-8c88-dd8b5b713dce" returned: 0 in 0.302s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:14 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-5dc1b899-b838-41ce-9623-09b826553bbb tempest-TestStampPattern-1593609708 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:04:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-5dc1b899-b838-41ce-9623-09b826553bbb tempest-TestStampPattern-1593609708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:04:14 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-5dc1b899-b838-41ce-9623-09b826553bbb tempest-TestStampPattern-1593609708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9464dda-52f1-4d99-938d-06290288fe14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e974420e-98cc-41aa-8c88-dd8b5b713dce', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:04:14 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-5dc1b899-b838-41ce-9623-09b826553bbb tempest-TestStampPattern-1593609708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19baa127-d6a3-4791-b0dd-b81d5b879a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:04:14 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-5dc1b899-b838-41ce-9623-09b826553bbb tempest-TestStampPattern-1593609708 None] Volume volume-e974420e-98cc-41aa-8c88-dd8b5b713dce (e974420e-98cc-41aa-8c88-dd8b5b713dce): created successfully Jul 30 17:04:14 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-5dc1b899-b838-41ce-9623-09b826553bbb tempest-TestStampPattern-1593609708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19baa127-d6a3-4791-b0dd-b81d5b879a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:04:14 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-5dc1b899-b838-41ce-9623-09b826553bbb tempest-TestStampPattern-1593609708 None] Flow 'volume_create_manager' (06ea2737-fddb-4218-8f5f-eb25538910bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:04:14 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-5dc1b899-b838-41ce-9623-09b826553bbb tempest-TestStampPattern-1593609708 None] Created volume successfully. Jul 30 17:04:24 devstack cinder-volume[88568]: DEBUG dbcounter [-] [88568] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2 {{(pid=88568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 17:04:24 devstack cinder-volume[88568]: DEBUG dbcounter [-] [88568] Writing DB stats cinder:UPDATE=4,cinder:SELECT=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=88568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 17:04:46 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce154883-8b48-4fe9-a899-163257ca219e tempest-TestMinimumBasicScenario-189804170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:04:46 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ce154883-8b48-4fe9-a899-163257ca219e tempest-TestMinimumBasicScenario-189804170 None] Flow 'volume_create_manager' (06a5369b-ea3a-4586-812c-3cf07c27f266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:04:46 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ce154883-8b48-4fe9-a899-163257ca219e tempest-TestMinimumBasicScenario-189804170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5c3ac29-5c0a-457f-a976-5b2cc6034d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:04:46 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ce154883-8b48-4fe9-a899-163257ca219e tempest-TestMinimumBasicScenario-189804170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5c3ac29-5c0a-457f-a976-5b2cc6034d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:04:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-354320030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bdf45fb-fbf5-43aa-a6ee-d1b22c3310eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f33ff55ee3cb46f4acc2cdd6ddbe58cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:04:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:04:47Z,use_quota=True,user_id='e13531e05a914d388a414ab2e1e914a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:04:46 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ce154883-8b48-4fe9-a899-163257ca219e tempest-TestMinimumBasicScenario-189804170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e9da587-0c3b-45b3-8f26-84a3c55e710c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:04:46 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ce154883-8b48-4fe9-a899-163257ca219e tempest-TestMinimumBasicScenario-189804170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e9da587-0c3b-45b3-8f26-84a3c55e710c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:04:46 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ce154883-8b48-4fe9-a899-163257ca219e tempest-TestMinimumBasicScenario-189804170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7ea4526-8d2c-45dc-bc80-1aa85dc5bbc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:04:46 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ce154883-8b48-4fe9-a899-163257ca219e tempest-TestMinimumBasicScenario-189804170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7ea4526-8d2c-45dc-bc80-1aa85dc5bbc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bdf45fb-fbf5-43aa-a6ee-d1b22c3310eb', 'volume_name': 'volume-6bdf45fb-fbf5-43aa-a6ee-d1b22c3310eb', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:04:46 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ce154883-8b48-4fe9-a899-163257ca219e tempest-TestMinimumBasicScenario-189804170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae282303-6d77-4e0a-9613-1d0444b227c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:04:46 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ce154883-8b48-4fe9-a899-163257ca219e tempest-TestMinimumBasicScenario-189804170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae282303-6d77-4e0a-9613-1d0444b227c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:04:46 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ce154883-8b48-4fe9-a899-163257ca219e tempest-TestMinimumBasicScenario-189804170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a194e140-9d79-4199-bd4e-d2a557304ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:04:46 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-ce154883-8b48-4fe9-a899-163257ca219e tempest-TestMinimumBasicScenario-189804170 None] Volume 6bdf45fb-fbf5-43aa-a6ee-d1b22c3310eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bdf45fb-fbf5-43aa-a6ee-d1b22c3310eb', 'volume_size': 1} Jul 30 17:04:46 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-ce154883-8b48-4fe9-a899-163257ca219e tempest-TestMinimumBasicScenario-189804170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:04:46 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-ce154883-8b48-4fe9-a899-163257ca219e tempest-TestMinimumBasicScenario-189804170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:04:46 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-ce154883-8b48-4fe9-a899-163257ca219e tempest-TestMinimumBasicScenario-189804170 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:04:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-354320030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bdf45fb-fbf5-43aa-a6ee-d1b22c3310eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f33ff55ee3cb46f4acc2cdd6ddbe58cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:04:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:04:47Z,use_quota=True,user_id='e13531e05a914d388a414ab2e1e914a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:04:46 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-ce154883-8b48-4fe9-a899-163257ca219e tempest-TestMinimumBasicScenario-189804170 None] Creating volume 6bdf45fb-fbf5-43aa-a6ee-d1b22c3310eb {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:04:46 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-ce154883-8b48-4fe9-a899-163257ca219e tempest-TestMinimumBasicScenario-189804170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:04:46 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-ce154883-8b48-4fe9-a899-163257ca219e tempest-TestMinimumBasicScenario-189804170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:04:46 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-ce154883-8b48-4fe9-a899-163257ca219e tempest-TestMinimumBasicScenario-189804170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:04:46 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-ce154883-8b48-4fe9-a899-163257ca219e tempest-TestMinimumBasicScenario-189804170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:04:46 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-ce154883-8b48-4fe9-a899-163257ca219e tempest-TestMinimumBasicScenario-189804170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:04:46 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-ce154883-8b48-4fe9-a899-163257ca219e tempest-TestMinimumBasicScenario-189804170 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:04:46 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-ce154883-8b48-4fe9-a899-163257ca219e tempest-TestMinimumBasicScenario-189804170 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:04:46 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-ce154883-8b48-4fe9-a899-163257ca219e tempest-TestMinimumBasicScenario-189804170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6bdf45fb-fbf5-43aa-a6ee-d1b22c3310eb 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:46 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-cf65d19e-8e14-4b9a-bdd9-e419f315d61b req-668353ab-45f7-4131-9645-e0f9a1e59731 tempest-TestStampPattern-1593609708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:04:46 devstack sudo[103842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6bdf45fb-fbf5-43aa-a6ee-d1b22c3310eb 1073741824 Jul 30 17:04:46 devstack sudo[103842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:47 devstack sudo[103842]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-ce154883-8b48-4fe9-a899-163257ca219e tempest-TestMinimumBasicScenario-189804170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6bdf45fb-fbf5-43aa-a6ee-d1b22c3310eb 1073741824" returned: 0 in 0.428s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-ce154883-8b48-4fe9-a899-163257ca219e tempest-TestMinimumBasicScenario-189804170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6bdf45fb-fbf5-43aa-a6ee-d1b22c3310eb {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:47 devstack sudo[103847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6bdf45fb-fbf5-43aa-a6ee-d1b22c3310eb Jul 30 17:04:47 devstack sudo[103847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:47 devstack sudo[103847]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-ce154883-8b48-4fe9-a899-163257ca219e tempest-TestMinimumBasicScenario-189804170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6bdf45fb-fbf5-43aa-a6ee-d1b22c3310eb" returned: 0 in 0.262s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:47 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-ce154883-8b48-4fe9-a899-163257ca219e tempest-TestMinimumBasicScenario-189804170 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:04:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-ce154883-8b48-4fe9-a899-163257ca219e tempest-TestMinimumBasicScenario-189804170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:04:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-cf65d19e-8e14-4b9a-bdd9-e419f315d61b req-668353ab-45f7-4131-9645-e0f9a1e59731 tempest-TestStampPattern-1593609708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.700s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:04:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ce154883-8b48-4fe9-a899-163257ca219e tempest-TestMinimumBasicScenario-189804170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a194e140-9d79-4199-bd4e-d2a557304ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bdf45fb-fbf5-43aa-a6ee-d1b22c3310eb', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:04:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ce154883-8b48-4fe9-a899-163257ca219e tempest-TestMinimumBasicScenario-189804170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86053c09-ea0a-4740-9925-d9f3c5fcf559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:04:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-cf65d19e-8e14-4b9a-bdd9-e419f315d61b req-668353ab-45f7-4131-9645-e0f9a1e59731 tempest-TestStampPattern-1593609708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:04:47 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-ce154883-8b48-4fe9-a899-163257ca219e tempest-TestMinimumBasicScenario-189804170 None] Volume volume-6bdf45fb-fbf5-43aa-a6ee-d1b22c3310eb (6bdf45fb-fbf5-43aa-a6ee-d1b22c3310eb): created successfully Jul 30 17:04:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ce154883-8b48-4fe9-a899-163257ca219e tempest-TestMinimumBasicScenario-189804170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86053c09-ea0a-4740-9925-d9f3c5fcf559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:04:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-ce154883-8b48-4fe9-a899-163257ca219e tempest-TestMinimumBasicScenario-189804170 None] Flow 'volume_create_manager' (06a5369b-ea3a-4586-812c-3cf07c27f266) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:04:47 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-ce154883-8b48-4fe9-a899-163257ca219e tempest-TestMinimumBasicScenario-189804170 None] Created volume successfully. Jul 30 17:04:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [req-cf65d19e-8e14-4b9a-bdd9-e419f315d61b req-668353ab-45f7-4131-9645-e0f9a1e59731 tempest-TestStampPattern-1593609708 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924', 'name': 'volume-e974420e-98cc-41aa-8c88-dd8b5b713dce', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '84c512e7-d5fe-40ac-8ab4-059677682318', 'enforce_multipath': True} {{(pid=88568) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 17:04:47 devstack cinder-volume[88568]: INFO cinder.volume.manager [req-cf65d19e-8e14-4b9a-bdd9-e419f315d61b req-668353ab-45f7-4131-9645-e0f9a1e59731 tempest-TestStampPattern-1593609708 None] attachment_update completed successfully. Jul 30 17:04:48 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-5eab1eb3-3d5d-4201-8e26-615dce767480 req-828bd68d-a102-4781-8ef8-02bafdbabc3f tempest-TestMinimumBasicScenario-189804170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:04:48 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-5eab1eb3-3d5d-4201-8e26-615dce767480 req-828bd68d-a102-4781-8ef8-02bafdbabc3f tempest-TestMinimumBasicScenario-189804170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:04:48 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-5eab1eb3-3d5d-4201-8e26-615dce767480 req-828bd68d-a102-4781-8ef8-02bafdbabc3f tempest-TestMinimumBasicScenario-189804170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:04:48 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [req-5eab1eb3-3d5d-4201-8e26-615dce767480 req-828bd68d-a102-4781-8ef8-02bafdbabc3f tempest-TestMinimumBasicScenario-189804170 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924', 'name': 'volume-6bdf45fb-fbf5-43aa-a6ee-d1b22c3310eb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6c0b3392-b30c-4e63-8223-57b31756feef', 'enforce_multipath': True} {{(pid=88568) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 17:04:48 devstack cinder-volume[88568]: INFO cinder.volume.manager [req-5eab1eb3-3d5d-4201-8e26-615dce767480 req-828bd68d-a102-4781-8ef8-02bafdbabc3f tempest-TestMinimumBasicScenario-189804170 None] attachment_update completed successfully. Jul 30 17:04:52 devstack cinder-volume[88568]: DEBUG oslo_service.periodic_task [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 17:04:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:04:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:04:52 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:04:52 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:04:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:04:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:52 devstack sudo[104280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:04:52 devstack sudo[104280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:52 devstack sudo[104280]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.425s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:52 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:04:52 devstack cinder-volume[88568]: DEBUG oslo_service.periodic_task [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Running periodic task VolumeManager._thread_info {{(pid=88568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 17:04:52 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] thread count: 28 {{(pid=88568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 17:04:52 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] thread info: [<_MainThread(MainThread, started 127406866608256)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 17:04:53 devstack cinder-volume[88568]: INFO cinder.volume.manager [req-47c5e372-67cd-4ad5-bbf0-e4786a8fcb6b req-3efd5f99-d267-49c8-b4c7-b5000520ed92 tempest-TestStampPattern-1593609708 None] Terminate volume connection completed successfully. Jul 30 17:04:53 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [req-47c5e372-67cd-4ad5-bbf0-e4786a8fcb6b req-3efd5f99-d267-49c8-b4c7-b5000520ed92 tempest-TestStampPattern-1593609708 None] Deleting attachment 84c512e7-d5fe-40ac-8ab4-059677682318. {{(pid=88568) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 17:04:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-8384a12c-0e0f-46d8-b338-dcd5d80a3c49 tempest-TestStampPattern-1593609708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:04:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-8384a12c-0e0f-46d8-b338-dcd5d80a3c49 tempest-TestStampPattern-1593609708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:04:54 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-8384a12c-0e0f-46d8-b338-dcd5d80a3c49 tempest-TestStampPattern-1593609708 None] Creating offline snapshot ceec5bdf-a6e2-4719-be7b-0ef5f5fd285c of volume e974420e-98cc-41aa-8c88-dd8b5b713dce {{(pid=88568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:04:54 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ced929-cc73-446b-aee9-282a3a13effc]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:04:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8384a12c-0e0f-46d8-b338-dcd5d80a3c49 tempest-TestStampPattern-1593609708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e974420e-98cc-41aa-8c88-dd8b5b713dce {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:54 devstack sudo[104290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e974420e-98cc-41aa-8c88-dd8b5b713dce Jul 30 17:04:54 devstack sudo[104290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:54 devstack sudo[104290]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8384a12c-0e0f-46d8-b338-dcd5d80a3c49 tempest-TestStampPattern-1593609708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e974420e-98cc-41aa-8c88-dd8b5b713dce" returned: 0 in 0.528s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8384a12c-0e0f-46d8-b338-dcd5d80a3c49 tempest-TestStampPattern-1593609708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e974420e-98cc-41aa-8c88-dd8b5b713dce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e974420e-98cc-41aa-8c88-dd8b5b713dce.ceec5bdf-a6e2-4719-be7b-0ef5f5fd285c 1G {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:54 devstack sudo[104296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e974420e-98cc-41aa-8c88-dd8b5b713dce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e974420e-98cc-41aa-8c88-dd8b5b713dce.ceec5bdf-a6e2-4719-be7b-0ef5f5fd285c 1G Jul 30 17:04:54 devstack sudo[104296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:55 devstack sudo[104296]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8384a12c-0e0f-46d8-b338-dcd5d80a3c49 tempest-TestStampPattern-1593609708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e974420e-98cc-41aa-8c88-dd8b5b713dce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e974420e-98cc-41aa-8c88-dd8b5b713dce.ceec5bdf-a6e2-4719-be7b-0ef5f5fd285c 1G" returned: 0 in 0.488s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8384a12c-0e0f-46d8-b338-dcd5d80a3c49 tempest-TestStampPattern-1593609708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e974420e-98cc-41aa-8c88-dd8b5b713dce -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e974420e-98cc-41aa-8c88-dd8b5b713dce.ceec5bdf-a6e2-4719-be7b-0ef5f5fd285c {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:55 devstack sudo[104302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e974420e-98cc-41aa-8c88-dd8b5b713dce -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e974420e-98cc-41aa-8c88-dd8b5b713dce.ceec5bdf-a6e2-4719-be7b-0ef5f5fd285c Jul 30 17:04:55 devstack sudo[104302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:55 devstack sudo[104302]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8384a12c-0e0f-46d8-b338-dcd5d80a3c49 tempest-TestStampPattern-1593609708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e974420e-98cc-41aa-8c88-dd8b5b713dce -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e974420e-98cc-41aa-8c88-dd8b5b713dce.ceec5bdf-a6e2-4719-be7b-0ef5f5fd285c" returned: 0 in 0.363s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:55 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-8384a12c-0e0f-46d8-b338-dcd5d80a3c49 tempest-TestStampPattern-1593609708 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e974420e-98cc-41aa-8c88-dd8b5b713dce.ceec5bdf-a6e2-4719-be7b-0ef5f5fd285c is being set with open permissions: ugo+rw Jul 30 17:04:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8384a12c-0e0f-46d8-b338-dcd5d80a3c49 tempest-TestStampPattern-1593609708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e974420e-98cc-41aa-8c88-dd8b5b713dce.ceec5bdf-a6e2-4719-be7b-0ef5f5fd285c {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:55 devstack sudo[104308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e974420e-98cc-41aa-8c88-dd8b5b713dce.ceec5bdf-a6e2-4719-be7b-0ef5f5fd285c Jul 30 17:04:55 devstack sudo[104308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:56 devstack sudo[104308]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8384a12c-0e0f-46d8-b338-dcd5d80a3c49 tempest-TestStampPattern-1593609708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e974420e-98cc-41aa-8c88-dd8b5b713dce.ceec5bdf-a6e2-4719-be7b-0ef5f5fd285c" returned: 0 in 0.260s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8384a12c-0e0f-46d8-b338-dcd5d80a3c49 tempest-TestStampPattern-1593609708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e974420e-98cc-41aa-8c88-dd8b5b713dce.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:56 devstack sudo[104311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e974420e-98cc-41aa-8c88-dd8b5b713dce.info Jul 30 17:04:56 devstack sudo[104311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:56 devstack sudo[104311]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8384a12c-0e0f-46d8-b338-dcd5d80a3c49 tempest-TestStampPattern-1593609708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e974420e-98cc-41aa-8c88-dd8b5b713dce.info" returned: 0 in 0.287s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:56 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-8384a12c-0e0f-46d8-b338-dcd5d80a3c49 tempest-TestStampPattern-1593609708 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e974420e-98cc-41aa-8c88-dd8b5b713dce.info is being set with open permissions: ugo+rw Jul 30 17:04:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8384a12c-0e0f-46d8-b338-dcd5d80a3c49 tempest-TestStampPattern-1593609708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e974420e-98cc-41aa-8c88-dd8b5b713dce.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:56 devstack sudo[104330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e974420e-98cc-41aa-8c88-dd8b5b713dce.info Jul 30 17:04:56 devstack sudo[104330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:56 devstack sudo[104330]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8384a12c-0e0f-46d8-b338-dcd5d80a3c49 tempest-TestStampPattern-1593609708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e974420e-98cc-41aa-8c88-dd8b5b713dce.info" returned: 0 in 0.265s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-8384a12c-0e0f-46d8-b338-dcd5d80a3c49 tempest-TestStampPattern-1593609708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.326s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:04:56 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-8384a12c-0e0f-46d8-b338-dcd5d80a3c49 tempest-TestStampPattern-1593609708 None] Create snapshot completed successfully Jul 30 17:05:04 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cbe93ce-f086-475a-8926-1ed61931bc08 tempest-TestStampPattern-1593609708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:05:04 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4cbe93ce-f086-475a-8926-1ed61931bc08 tempest-TestStampPattern-1593609708 None] Flow 'volume_create_manager' (1e3b6ffe-7079-4967-aaa1-5ee4fbd38e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:05:04 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4cbe93ce-f086-475a-8926-1ed61931bc08 tempest-TestStampPattern-1593609708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6680271-43f4-47e4-8fa2-57b3dc6d3176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:05:04 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4cbe93ce-f086-475a-8926-1ed61931bc08 tempest-TestStampPattern-1593609708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6680271-43f4-47e4-8fa2-57b3dc6d3176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:05:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1493118314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5778e9b3-9ee6-4943-ae88-6e363e75b4e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3aac3344083b462f85bf960d622952e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:05:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ceec5bdf-a6e2-4719-be7b-0ef5f5fd285c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:05:04Z,use_quota=True,user_id='83ca292805a34a299f62c025592d722a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:05:04 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4cbe93ce-f086-475a-8926-1ed61931bc08 tempest-TestStampPattern-1593609708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (313f25ff-97ff-4d7a-a286-20b0ea9deca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:05:04 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4cbe93ce-f086-475a-8926-1ed61931bc08 tempest-TestStampPattern-1593609708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (313f25ff-97ff-4d7a-a286-20b0ea9deca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:05:04 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4cbe93ce-f086-475a-8926-1ed61931bc08 tempest-TestStampPattern-1593609708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b37ba589-84b2-4f31-968a-ca69bff73d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:05:04 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4cbe93ce-f086-475a-8926-1ed61931bc08 tempest-TestStampPattern-1593609708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b37ba589-84b2-4f31-968a-ca69bff73d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5778e9b3-9ee6-4943-ae88-6e363e75b4e4', 'volume_name': 'volume-5778e9b3-9ee6-4943-ae88-6e363e75b4e4', 'volume_size': 1, 'snapshot_id': 'ceec5bdf-a6e2-4719-be7b-0ef5f5fd285c'}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:05:04 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4cbe93ce-f086-475a-8926-1ed61931bc08 tempest-TestStampPattern-1593609708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d887c64-0d05-4165-8cb4-c87b168091ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:05:04 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4cbe93ce-f086-475a-8926-1ed61931bc08 tempest-TestStampPattern-1593609708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d887c64-0d05-4165-8cb4-c87b168091ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:05:04 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4cbe93ce-f086-475a-8926-1ed61931bc08 tempest-TestStampPattern-1593609708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df2b950e-f5bb-4dfe-a527-f689dbfd9ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:05:04 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-4cbe93ce-f086-475a-8926-1ed61931bc08 tempest-TestStampPattern-1593609708 None] Volume 5778e9b3-9ee6-4943-ae88-6e363e75b4e4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5778e9b3-9ee6-4943-ae88-6e363e75b4e4', 'volume_size': 1, 'snapshot_id': 'ceec5bdf-a6e2-4719-be7b-0ef5f5fd285c'} Jul 30 17:05:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-4cbe93ce-f086-475a-8926-1ed61931bc08 tempest-TestStampPattern-1593609708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:05:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-4cbe93ce-f086-475a-8926-1ed61931bc08 tempest-TestStampPattern-1593609708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:05:04 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-4cbe93ce-f086-475a-8926-1ed61931bc08 tempest-TestStampPattern-1593609708 None] Acquiring lock "cinder-quobyte-ceec5bdf-a6e2-4719-be7b-0ef5f5fd285c-5778e9b3-9ee6-4943-ae88-6e363e75b4e4" by "_create_volume_from_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:05:04 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-4cbe93ce-f086-475a-8926-1ed61931bc08 tempest-TestStampPattern-1593609708 None] Lock "cinder-quobyte-ceec5bdf-a6e2-4719-be7b-0ef5f5fd285c-5778e9b3-9ee6-4943-ae88-6e363e75b4e4" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:05:04 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-4cbe93ce-f086-475a-8926-1ed61931bc08 tempest-TestStampPattern-1593609708 None] Creating volume 5778e9b3-9ee6-4943-ae88-6e363e75b4e4 from snapshot ceec5bdf-a6e2-4719-be7b-0ef5f5fd285c {{(pid=88568) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 30 17:05:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-4cbe93ce-f086-475a-8926-1ed61931bc08 tempest-TestStampPattern-1593609708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:05:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-4cbe93ce-f086-475a-8926-1ed61931bc08 tempest-TestStampPattern-1593609708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:05:04 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-4cbe93ce-f086-475a-8926-1ed61931bc08 tempest-TestStampPattern-1593609708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:05:04 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-4cbe93ce-f086-475a-8926-1ed61931bc08 tempest-TestStampPattern-1593609708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:05:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-4cbe93ce-f086-475a-8926-1ed61931bc08 tempest-TestStampPattern-1593609708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:05:04 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-4cbe93ce-f086-475a-8926-1ed61931bc08 tempest-TestStampPattern-1593609708 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:05:04 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-4cbe93ce-f086-475a-8926-1ed61931bc08 tempest-TestStampPattern-1593609708 None] Acquiring lock "cinder-quobyte-5778e9b3-9ee6-4943-ae88-6e363e75b4e4" by "_copy_volume_from_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:05:04 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-4cbe93ce-f086-475a-8926-1ed61931bc08 tempest-TestStampPattern-1593609708 None] Lock "cinder-quobyte-5778e9b3-9ee6-4943-ae88-6e363e75b4e4" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:05:04 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-4cbe93ce-f086-475a-8926-1ed61931bc08 tempest-TestStampPattern-1593609708 None] snapshot: ceec5bdf-a6e2-4719-be7b-0ef5f5fd285c, volume: 5778e9b3-9ee6-4943-ae88-6e363e75b4e4, {{(pid=88568) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 30 17:05:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-4cbe93ce-f086-475a-8926-1ed61931bc08 tempest-TestStampPattern-1593609708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:05:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-4cbe93ce-f086-475a-8926-1ed61931bc08 tempest-TestStampPattern-1593609708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:05:04 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-4cbe93ce-f086-475a-8926-1ed61931bc08 tempest-TestStampPattern-1593609708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:05:04 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-4cbe93ce-f086-475a-8926-1ed61931bc08 tempest-TestStampPattern-1593609708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:05:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-4cbe93ce-f086-475a-8926-1ed61931bc08 tempest-TestStampPattern-1593609708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:05:04 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[44282e4b-ed18-4d17-bf2e-63547d9e1197]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:05:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-4cbe93ce-f086-475a-8926-1ed61931bc08 tempest-TestStampPattern-1593609708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e974420e-98cc-41aa-8c88-dd8b5b713dce.ceec5bdf-a6e2-4719-be7b-0ef5f5fd285c {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:05:04 devstack sudo[104392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e974420e-98cc-41aa-8c88-dd8b5b713dce.ceec5bdf-a6e2-4719-be7b-0ef5f5fd285c Jul 30 17:05:04 devstack sudo[104392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:05:04 devstack sudo[104392]: pam_unix(sudo:session): session closed for user root Jul 30 17:05:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-4cbe93ce-f086-475a-8926-1ed61931bc08 tempest-TestStampPattern-1593609708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e974420e-98cc-41aa-8c88-dd8b5b713dce.ceec5bdf-a6e2-4719-be7b-0ef5f5fd285c" returned: 0 in 0.417s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:05:04 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-4cbe93ce-f086-475a-8926-1ed61931bc08 tempest-TestStampPattern-1593609708 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e974420e-98cc-41aa-8c88-dd8b5b713dce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:05:04 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c79885e-f646-47d0-bcd3-63c8a1092882]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:05:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-4cbe93ce-f086-475a-8926-1ed61931bc08 tempest-TestStampPattern-1593609708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e974420e-98cc-41aa-8c88-dd8b5b713dce {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:05:04 devstack sudo[104397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e974420e-98cc-41aa-8c88-dd8b5b713dce Jul 30 17:05:04 devstack sudo[104397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:05:05 devstack sudo[104397]: pam_unix(sudo:session): session closed for user root Jul 30 17:05:05 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-4cbe93ce-f086-475a-8926-1ed61931bc08 tempest-TestStampPattern-1593609708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e974420e-98cc-41aa-8c88-dd8b5b713dce" returned: 0 in 0.437s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:05:05 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-4cbe93ce-f086-475a-8926-1ed61931bc08 tempest-TestStampPattern-1593609708 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e974420e-98cc-41aa-8c88-dd8b5b713dce {{(pid=88568) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 30 17:05:05 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-4cbe93ce-f086-475a-8926-1ed61931bc08 tempest-TestStampPattern-1593609708 None] Creating direct copy from snapshot {{(pid=88568) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 30 17:05:05 devstack cinder-volume[88568]: DEBUG cinder.utils [None req-4cbe93ce-f086-475a-8926-1ed61931bc08 tempest-TestStampPattern-1593609708 None] Path /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5778e9b3-9ee6-4943-ae88-6e363e75b4e4 not found in is_blk_device check {{(pid=88568) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 30 17:05:05 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-4cbe93ce-f086-475a-8926-1ed61931bc08 tempest-TestStampPattern-1593609708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e974420e-98cc-41aa-8c88-dd8b5b713dce /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5778e9b3-9ee6-4943-ae88-6e363e75b4e4 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:05:05 devstack sudo[104406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e974420e-98cc-41aa-8c88-dd8b5b713dce /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5778e9b3-9ee6-4943-ae88-6e363e75b4e4 Jul 30 17:05:05 devstack sudo[104406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:05:11 devstack sudo[104406]: pam_unix(sudo:session): session closed for user root Jul 30 17:05:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-4cbe93ce-f086-475a-8926-1ed61931bc08 tempest-TestStampPattern-1593609708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e974420e-98cc-41aa-8c88-dd8b5b713dce /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5778e9b3-9ee6-4943-ae88-6e363e75b4e4" returned: 0 in 6.549s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:05:11 devstack cinder-volume[88568]: DEBUG cinder.image.image_utils [None req-4cbe93ce-f086-475a-8926-1ed61931bc08 tempest-TestStampPattern-1593609708 None] Image conversion details: src /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e974420e-98cc-41aa-8c88-dd8b5b713dce, size 1024.00 MB, duration 6.55 sec, destination /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5778e9b3-9ee6-4943-ae88-6e363e75b4e4 {{(pid=88568) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 17:05:11 devstack cinder-volume[88568]: INFO cinder.image.image_utils [None req-4cbe93ce-f086-475a-8926-1ed61931bc08 tempest-TestStampPattern-1593609708 None] Converted 1024.00 MB image at 156.26 MB/s Jul 30 17:05:11 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-4cbe93ce-f086-475a-8926-1ed61931bc08 tempest-TestStampPattern-1593609708 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5778e9b3-9ee6-4943-ae88-6e363e75b4e4 is being set with open permissions: ugo+rw Jul 30 17:05:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-4cbe93ce-f086-475a-8926-1ed61931bc08 tempest-TestStampPattern-1593609708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5778e9b3-9ee6-4943-ae88-6e363e75b4e4 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:05:11 devstack sudo[104446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5778e9b3-9ee6-4943-ae88-6e363e75b4e4 Jul 30 17:05:11 devstack sudo[104446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:05:12 devstack sudo[104446]: pam_unix(sudo:session): session closed for user root Jul 30 17:05:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-4cbe93ce-f086-475a-8926-1ed61931bc08 tempest-TestStampPattern-1593609708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5778e9b3-9ee6-4943-ae88-6e363e75b4e4" returned: 0 in 0.359s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:05:12 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-4cbe93ce-f086-475a-8926-1ed61931bc08 tempest-TestStampPattern-1593609708 None] Lock "cinder-quobyte-5778e9b3-9ee6-4943-ae88-6e363e75b4e4" released by "_copy_volume_from_snapshot" :: held 7.854s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:05:12 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-4cbe93ce-f086-475a-8926-1ed61931bc08 tempest-TestStampPattern-1593609708 None] Lock "cinder-quobyte-ceec5bdf-a6e2-4719-be7b-0ef5f5fd285c-5778e9b3-9ee6-4943-ae88-6e363e75b4e4" released by "_create_volume_from_snapshot" :: held 7.931s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:05:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-4cbe93ce-f086-475a-8926-1ed61931bc08 tempest-TestStampPattern-1593609708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.948s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:05:12 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4cbe93ce-f086-475a-8926-1ed61931bc08 tempest-TestStampPattern-1593609708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df2b950e-f5bb-4dfe-a527-f689dbfd9ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5778e9b3-9ee6-4943-ae88-6e363e75b4e4', 'volume_size': 1, 'snapshot_id': 'ceec5bdf-a6e2-4719-be7b-0ef5f5fd285c'}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:05:12 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4cbe93ce-f086-475a-8926-1ed61931bc08 tempest-TestStampPattern-1593609708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c73891d-6b7c-4107-9ff1-033d4e8637a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:05:12 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-4cbe93ce-f086-475a-8926-1ed61931bc08 tempest-TestStampPattern-1593609708 None] Volume volume-5778e9b3-9ee6-4943-ae88-6e363e75b4e4 (5778e9b3-9ee6-4943-ae88-6e363e75b4e4): created successfully Jul 30 17:05:12 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4cbe93ce-f086-475a-8926-1ed61931bc08 tempest-TestStampPattern-1593609708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c73891d-6b7c-4107-9ff1-033d4e8637a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:05:12 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-4cbe93ce-f086-475a-8926-1ed61931bc08 tempest-TestStampPattern-1593609708 None] Flow 'volume_create_manager' (1e3b6ffe-7079-4967-aaa1-5ee4fbd38e1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:05:12 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-4cbe93ce-f086-475a-8926-1ed61931bc08 tempest-TestStampPattern-1593609708 None] Created volume successfully. Jul 30 17:05:22 devstack cinder-volume[88568]: DEBUG dbcounter [-] [88568] Writing DB stats cinder:UPDATE=12,cinder:SELECT=22,cinder:INSERT=1,cinder:DELETE=1 {{(pid=88568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 17:05:22 devstack cinder-volume[88568]: DEBUG dbcounter [-] [88568] Writing DB stats cinder:SELECT=25,cinder:UPDATE=10,cinder:INSERT=2,cinder:DELETE=2 {{(pid=88568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 17:05:41 devstack cinder-volume[88568]: INFO cinder.volume.manager [req-25fc99a1-05cc-4d0e-b09a-9911f5b2a282 req-ba94f063-d745-482c-960e-d807e4e2230f tempest-TestMinimumBasicScenario-189804170 None] Terminate volume connection completed successfully. Jul 30 17:05:41 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [req-25fc99a1-05cc-4d0e-b09a-9911f5b2a282 req-ba94f063-d745-482c-960e-d807e4e2230f tempest-TestMinimumBasicScenario-189804170 None] Deleting attachment 6c0b3392-b30c-4e63-8223-57b31756feef. {{(pid=88568) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 17:05:42 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-c24d9200-896e-4704-b73b-82a73984f44c tempest-TestMinimumBasicScenario-189804170 None] Acquiring lock "cinder-6bdf45fb-fbf5-43aa-a6ee-d1b22c3310eb-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:05:42 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-c24d9200-896e-4704-b73b-82a73984f44c tempest-TestMinimumBasicScenario-189804170 None] Lock "cinder-6bdf45fb-fbf5-43aa-a6ee-d1b22c3310eb-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:05:42 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-c24d9200-896e-4704-b73b-82a73984f44c tempest-TestMinimumBasicScenario-189804170 None] Acquiring lock "cinder-quobyte-6bdf45fb-fbf5-43aa-a6ee-d1b22c3310eb" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:05:42 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-c24d9200-896e-4704-b73b-82a73984f44c tempest-TestMinimumBasicScenario-189804170 None] Lock "cinder-quobyte-6bdf45fb-fbf5-43aa-a6ee-d1b22c3310eb" acquired by "delete_volume" :: waited 0.018s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:05:42 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b203494-d0e5-4ad4-94d3-ce02ab4ab814]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:05:42 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-c24d9200-896e-4704-b73b-82a73984f44c tempest-TestMinimumBasicScenario-189804170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6bdf45fb-fbf5-43aa-a6ee-d1b22c3310eb {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:05:42 devstack sudo[104650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6bdf45fb-fbf5-43aa-a6ee-d1b22c3310eb Jul 30 17:05:42 devstack sudo[104650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:05:42 devstack sudo[104650]: pam_unix(sudo:session): session closed for user root Jul 30 17:05:42 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-c24d9200-896e-4704-b73b-82a73984f44c tempest-TestMinimumBasicScenario-189804170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6bdf45fb-fbf5-43aa-a6ee-d1b22c3310eb" returned: 0 in 0.416s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:05:42 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-c24d9200-896e-4704-b73b-82a73984f44c tempest-TestMinimumBasicScenario-189804170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6bdf45fb-fbf5-43aa-a6ee-d1b22c3310eb {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:05:42 devstack sudo[104660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6bdf45fb-fbf5-43aa-a6ee-d1b22c3310eb Jul 30 17:05:42 devstack sudo[104660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:05:43 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-e97552bb-1c97-492c-a67e-cbe7c0c03c3a req-78b4137c-5baf-42f9-8b66-4f6a6d15bbc6 tempest-TestStampPattern-1593609708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:05:43 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-e97552bb-1c97-492c-a67e-cbe7c0c03c3a req-78b4137c-5baf-42f9-8b66-4f6a6d15bbc6 tempest-TestStampPattern-1593609708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:05:43 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-e97552bb-1c97-492c-a67e-cbe7c0c03c3a req-78b4137c-5baf-42f9-8b66-4f6a6d15bbc6 tempest-TestStampPattern-1593609708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:05:43 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [req-e97552bb-1c97-492c-a67e-cbe7c0c03c3a req-78b4137c-5baf-42f9-8b66-4f6a6d15bbc6 tempest-TestStampPattern-1593609708 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924', 'name': 'volume-5778e9b3-9ee6-4943-ae88-6e363e75b4e4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '96b60e61-bf5e-4ce7-8a76-4902a095f0f9', 'enforce_multipath': True} {{(pid=88568) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 17:05:43 devstack sudo[104660]: pam_unix(sudo:session): session closed for user root Jul 30 17:05:43 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-c24d9200-896e-4704-b73b-82a73984f44c tempest-TestMinimumBasicScenario-189804170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6bdf45fb-fbf5-43aa-a6ee-d1b22c3310eb" returned: 0 in 0.270s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:05:43 devstack cinder-volume[88568]: INFO cinder.volume.manager [req-e97552bb-1c97-492c-a67e-cbe7c0c03c3a req-78b4137c-5baf-42f9-8b66-4f6a6d15bbc6 tempest-TestStampPattern-1593609708 None] attachment_update completed successfully. Jul 30 17:05:43 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-c24d9200-896e-4704-b73b-82a73984f44c tempest-TestMinimumBasicScenario-189804170 None] Lock "cinder-quobyte-6bdf45fb-fbf5-43aa-a6ee-d1b22c3310eb" released by "delete_volume" :: held 0.731s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:05:43 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-c24d9200-896e-4704-b73b-82a73984f44c tempest-TestMinimumBasicScenario-189804170 None] Created reservations ['0a32f65e-0e7b-41ef-a16d-b0f610500a6a', '8aa07ed2-c751-444e-b8f4-cbe299a7e085', '0a839f87-18f5-465f-b014-7f847f1e237a', '42476b94-33af-4a74-bdda-6e9b9086331b'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:05:43 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-c24d9200-896e-4704-b73b-82a73984f44c tempest-TestMinimumBasicScenario-189804170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:05:43 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-c24d9200-896e-4704-b73b-82a73984f44c tempest-TestMinimumBasicScenario-189804170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:05:43 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-c24d9200-896e-4704-b73b-82a73984f44c tempest-TestMinimumBasicScenario-189804170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:05:43 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-c24d9200-896e-4704-b73b-82a73984f44c tempest-TestMinimumBasicScenario-189804170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:05:43 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-c24d9200-896e-4704-b73b-82a73984f44c tempest-TestMinimumBasicScenario-189804170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:05:43 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-c24d9200-896e-4704-b73b-82a73984f44c tempest-TestMinimumBasicScenario-189804170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:05:43 devstack sudo[104689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:05:43 devstack sudo[104689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:05:43 devstack sudo[104689]: pam_unix(sudo:session): session closed for user root Jul 30 17:05:43 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-c24d9200-896e-4704-b73b-82a73984f44c tempest-TestMinimumBasicScenario-189804170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.275s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:05:43 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-c24d9200-896e-4704-b73b-82a73984f44c tempest-TestMinimumBasicScenario-189804170 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:05:43 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-c24d9200-896e-4704-b73b-82a73984f44c tempest-TestMinimumBasicScenario-189804170 None] Deleted volume successfully. Jul 30 17:05:43 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-c24d9200-896e-4704-b73b-82a73984f44c tempest-TestMinimumBasicScenario-189804170 None] Lock "cinder-6bdf45fb-fbf5-43aa-a6ee-d1b22c3310eb-delete_volume" released by "delete_volume" :: held 1.230s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:05:46 devstack cinder-volume[88568]: INFO cinder.volume.manager [req-70e5cc12-7764-4a93-b516-2bac24e677e3 req-c74dc44b-16bb-428c-87ed-51f46931db79 tempest-TestStampPattern-1593609708 None] Terminate volume connection completed successfully. Jul 30 17:05:46 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [req-70e5cc12-7764-4a93-b516-2bac24e677e3 req-c74dc44b-16bb-428c-87ed-51f46931db79 tempest-TestStampPattern-1593609708 None] Deleting attachment 96b60e61-bf5e-4ce7-8a76-4902a095f0f9. {{(pid=88568) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 17:05:51 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-2345c34a-d22c-4d1d-8ac3-fb2d72ac493e tempest-TestStampPattern-1593609708 None] Acquiring lock "cinder-5778e9b3-9ee6-4943-ae88-6e363e75b4e4-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:05:51 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-2345c34a-d22c-4d1d-8ac3-fb2d72ac493e tempest-TestStampPattern-1593609708 None] Lock "cinder-5778e9b3-9ee6-4943-ae88-6e363e75b4e4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:05:51 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-2345c34a-d22c-4d1d-8ac3-fb2d72ac493e tempest-TestStampPattern-1593609708 None] Acquiring lock "cinder-quobyte-5778e9b3-9ee6-4943-ae88-6e363e75b4e4" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:05:51 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-2345c34a-d22c-4d1d-8ac3-fb2d72ac493e tempest-TestStampPattern-1593609708 None] Lock "cinder-quobyte-5778e9b3-9ee6-4943-ae88-6e363e75b4e4" acquired by "delete_volume" :: waited 0.023s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:05:51 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7211f8c-d64f-47e4-9040-adee6fd0ee3d]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:05:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2345c34a-d22c-4d1d-8ac3-fb2d72ac493e tempest-TestStampPattern-1593609708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5778e9b3-9ee6-4943-ae88-6e363e75b4e4 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:05:51 devstack sudo[105164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5778e9b3-9ee6-4943-ae88-6e363e75b4e4 Jul 30 17:05:51 devstack sudo[105164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:05:51 devstack sudo[105164]: pam_unix(sudo:session): session closed for user root Jul 30 17:05:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2345c34a-d22c-4d1d-8ac3-fb2d72ac493e tempest-TestStampPattern-1593609708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5778e9b3-9ee6-4943-ae88-6e363e75b4e4" returned: 0 in 0.395s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:05:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2345c34a-d22c-4d1d-8ac3-fb2d72ac493e tempest-TestStampPattern-1593609708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5778e9b3-9ee6-4943-ae88-6e363e75b4e4 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:05:51 devstack sudo[105169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5778e9b3-9ee6-4943-ae88-6e363e75b4e4 Jul 30 17:05:51 devstack sudo[105169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:05:52 devstack sudo[105169]: pam_unix(sudo:session): session closed for user root Jul 30 17:05:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2345c34a-d22c-4d1d-8ac3-fb2d72ac493e tempest-TestStampPattern-1593609708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5778e9b3-9ee6-4943-ae88-6e363e75b4e4" returned: 0 in 0.250s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:05:52 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-2345c34a-d22c-4d1d-8ac3-fb2d72ac493e tempest-TestStampPattern-1593609708 None] Lock "cinder-quobyte-5778e9b3-9ee6-4943-ae88-6e363e75b4e4" released by "delete_volume" :: held 0.685s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:05:52 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-2345c34a-d22c-4d1d-8ac3-fb2d72ac493e tempest-TestStampPattern-1593609708 None] Created reservations ['40ee159d-1a78-4d39-8db6-e0018cea4825', 'd614eda5-2207-4e09-8d57-bd21979fd5e7', 'b09a54fe-4873-4e11-8230-eae78e86fb1a', 'be65ae72-d511-43c1-b51b-91e5c8215a34'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:05:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-2345c34a-d22c-4d1d-8ac3-fb2d72ac493e tempest-TestStampPattern-1593609708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:05:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-2345c34a-d22c-4d1d-8ac3-fb2d72ac493e tempest-TestStampPattern-1593609708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:05:52 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-2345c34a-d22c-4d1d-8ac3-fb2d72ac493e tempest-TestStampPattern-1593609708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:05:52 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-2345c34a-d22c-4d1d-8ac3-fb2d72ac493e tempest-TestStampPattern-1593609708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:05:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-2345c34a-d22c-4d1d-8ac3-fb2d72ac493e tempest-TestStampPattern-1593609708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:05:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2345c34a-d22c-4d1d-8ac3-fb2d72ac493e tempest-TestStampPattern-1593609708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:05:52 devstack sudo[105173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:05:52 devstack sudo[105173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:05:52 devstack sudo[105173]: pam_unix(sudo:session): session closed for user root Jul 30 17:05:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2345c34a-d22c-4d1d-8ac3-fb2d72ac493e tempest-TestStampPattern-1593609708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.288s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:05:52 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-2345c34a-d22c-4d1d-8ac3-fb2d72ac493e tempest-TestStampPattern-1593609708 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:05:52 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-2345c34a-d22c-4d1d-8ac3-fb2d72ac493e tempest-TestStampPattern-1593609708 None] Deleted volume successfully. Jul 30 17:05:52 devstack cinder-volume[88568]: DEBUG oslo_service.periodic_task [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 17:05:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:05:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:05:52 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:05:52 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:05:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:05:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:05:52 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-2345c34a-d22c-4d1d-8ac3-fb2d72ac493e tempest-TestStampPattern-1593609708 None] Lock "cinder-5778e9b3-9ee6-4943-ae88-6e363e75b4e4-delete_volume" released by "delete_volume" :: held 1.222s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:05:52 devstack sudo[105176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:05:52 devstack sudo[105176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:05:52 devstack sudo[105176]: pam_unix(sudo:session): session closed for user root Jul 30 17:05:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.276s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:05:52 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:05:52 devstack cinder-volume[88568]: DEBUG oslo_service.periodic_task [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Running periodic task VolumeManager._thread_info {{(pid=88568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 17:05:52 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] thread count: 28 {{(pid=88568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 17:05:52 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] thread info: [<_MainThread(MainThread, started 127406866608256)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 17:05:52 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-e96240ba-fe4c-441e-b0d2-a57ef0b28710 tempest-TestStampPattern-1593609708 None] Acquiring lock "cinder-ceec5bdf-a6e2-4719-be7b-0ef5f5fd285c-delete_snapshot" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:05:52 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-e96240ba-fe4c-441e-b0d2-a57ef0b28710 tempest-TestStampPattern-1593609708 None] Lock "cinder-ceec5bdf-a6e2-4719-be7b-0ef5f5fd285c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:05:52 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-e96240ba-fe4c-441e-b0d2-a57ef0b28710 tempest-TestStampPattern-1593609708 None] Acquiring lock "cinder-quobyte-e974420e-98cc-41aa-8c88-dd8b5b713dce" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:05:52 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-e96240ba-fe4c-441e-b0d2-a57ef0b28710 tempest-TestStampPattern-1593609708 None] Lock "cinder-quobyte-e974420e-98cc-41aa-8c88-dd8b5b713dce" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:05:52 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-e96240ba-fe4c-441e-b0d2-a57ef0b28710 tempest-TestStampPattern-1593609708 None] Acquiring lock "cinder-quobyte-ceec5bdf-a6e2-4719-be7b-0ef5f5fd285c" by "_delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:05:52 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-e96240ba-fe4c-441e-b0d2-a57ef0b28710 tempest-TestStampPattern-1593609708 None] Lock "cinder-quobyte-ceec5bdf-a6e2-4719-be7b-0ef5f5fd285c" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:05:52 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-e96240ba-fe4c-441e-b0d2-a57ef0b28710 tempest-TestStampPattern-1593609708 None] Deleting offline snapshot ceec5bdf-a6e2-4719-be7b-0ef5f5fd285c of volume e974420e-98cc-41aa-8c88-dd8b5b713dce {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:05:52 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-e96240ba-fe4c-441e-b0d2-a57ef0b28710 tempest-TestStampPattern-1593609708 None] snapshot_file for this snap is: volume-e974420e-98cc-41aa-8c88-dd8b5b713dce.ceec5bdf-a6e2-4719-be7b-0ef5f5fd285c {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:05:52 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a8b23c-f699-4707-a042-1289f67edd59]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:05:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e96240ba-fe4c-441e-b0d2-a57ef0b28710 tempest-TestStampPattern-1593609708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e974420e-98cc-41aa-8c88-dd8b5b713dce.ceec5bdf-a6e2-4719-be7b-0ef5f5fd285c {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:05:53 devstack sudo[105179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e974420e-98cc-41aa-8c88-dd8b5b713dce.ceec5bdf-a6e2-4719-be7b-0ef5f5fd285c Jul 30 17:05:53 devstack sudo[105179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:05:53 devstack sudo[105179]: pam_unix(sudo:session): session closed for user root Jul 30 17:05:53 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e96240ba-fe4c-441e-b0d2-a57ef0b28710 tempest-TestStampPattern-1593609708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e974420e-98cc-41aa-8c88-dd8b5b713dce.ceec5bdf-a6e2-4719-be7b-0ef5f5fd285c" returned: 0 in 0.379s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:05:53 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-e96240ba-fe4c-441e-b0d2-a57ef0b28710 tempest-TestStampPattern-1593609708 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e974420e-98cc-41aa-8c88-dd8b5b713dce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:05:53 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73bfba3-02e0-4dba-80b7-cdb7ed10e01c]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:05:53 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e96240ba-fe4c-441e-b0d2-a57ef0b28710 tempest-TestStampPattern-1593609708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e974420e-98cc-41aa-8c88-dd8b5b713dce {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:05:53 devstack sudo[105184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e974420e-98cc-41aa-8c88-dd8b5b713dce Jul 30 17:05:53 devstack sudo[105184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:05:53 devstack sudo[105184]: pam_unix(sudo:session): session closed for user root Jul 30 17:05:53 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e96240ba-fe4c-441e-b0d2-a57ef0b28710 tempest-TestStampPattern-1593609708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e974420e-98cc-41aa-8c88-dd8b5b713dce" returned: 0 in 0.591s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:05:53 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e96240ba-fe4c-441e-b0d2-a57ef0b28710 tempest-TestStampPattern-1593609708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e974420e-98cc-41aa-8c88-dd8b5b713dce.ceec5bdf-a6e2-4719-be7b-0ef5f5fd285c {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:05:53 devstack sudo[105189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e974420e-98cc-41aa-8c88-dd8b5b713dce.ceec5bdf-a6e2-4719-be7b-0ef5f5fd285c Jul 30 17:05:53 devstack sudo[105189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:05:54 devstack sudo[105189]: pam_unix(sudo:session): session closed for user root Jul 30 17:05:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e96240ba-fe4c-441e-b0d2-a57ef0b28710 tempest-TestStampPattern-1593609708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e974420e-98cc-41aa-8c88-dd8b5b713dce.ceec5bdf-a6e2-4719-be7b-0ef5f5fd285c" returned: 0 in 0.352s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:05:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e96240ba-fe4c-441e-b0d2-a57ef0b28710 tempest-TestStampPattern-1593609708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e974420e-98cc-41aa-8c88-dd8b5b713dce.ceec5bdf-a6e2-4719-be7b-0ef5f5fd285c {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:05:54 devstack sudo[105195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e974420e-98cc-41aa-8c88-dd8b5b713dce.ceec5bdf-a6e2-4719-be7b-0ef5f5fd285c Jul 30 17:05:54 devstack sudo[105195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:05:54 devstack sudo[105195]: pam_unix(sudo:session): session closed for user root Jul 30 17:05:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e96240ba-fe4c-441e-b0d2-a57ef0b28710 tempest-TestStampPattern-1593609708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e974420e-98cc-41aa-8c88-dd8b5b713dce.ceec5bdf-a6e2-4719-be7b-0ef5f5fd285c" returned: 0 in 0.279s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:05:54 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-e96240ba-fe4c-441e-b0d2-a57ef0b28710 tempest-TestStampPattern-1593609708 None] Lock "cinder-quobyte-ceec5bdf-a6e2-4719-be7b-0ef5f5fd285c" released by "_delete_snapshot" :: held 1.702s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:05:54 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-e96240ba-fe4c-441e-b0d2-a57ef0b28710 tempest-TestStampPattern-1593609708 None] Lock "cinder-quobyte-e974420e-98cc-41aa-8c88-dd8b5b713dce" released by "delete_snapshot" :: held 1.726s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:05:54 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-e96240ba-fe4c-441e-b0d2-a57ef0b28710 tempest-TestStampPattern-1593609708 None] Created reservations ['2cd3eed6-a129-4369-aefe-f51188597dda', 'dc23a2bf-96a8-443f-a196-04c224425638', '2b660311-d97e-405f-860b-298d3443457f', '940bb29b-e458-4bcd-b963-e73160493e68'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:05:54 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-e96240ba-fe4c-441e-b0d2-a57ef0b28710 tempest-TestStampPattern-1593609708 None] Delete snapshot completed successfully. Jul 30 17:05:54 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-e96240ba-fe4c-441e-b0d2-a57ef0b28710 tempest-TestStampPattern-1593609708 None] Lock "cinder-ceec5bdf-a6e2-4719-be7b-0ef5f5fd285c-delete_snapshot" released by "delete_snapshot" :: held 1.910s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:05:58 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-7ab3b499-6cfc-47ee-801e-c360ce3b8b6a tempest-TestStampPattern-1593609708 None] Acquiring lock "cinder-e974420e-98cc-41aa-8c88-dd8b5b713dce-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:05:58 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-7ab3b499-6cfc-47ee-801e-c360ce3b8b6a tempest-TestStampPattern-1593609708 None] Lock "cinder-e974420e-98cc-41aa-8c88-dd8b5b713dce-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:05:58 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-7ab3b499-6cfc-47ee-801e-c360ce3b8b6a tempest-TestStampPattern-1593609708 None] Acquiring lock "cinder-quobyte-e974420e-98cc-41aa-8c88-dd8b5b713dce" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:05:58 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-7ab3b499-6cfc-47ee-801e-c360ce3b8b6a tempest-TestStampPattern-1593609708 None] Lock "cinder-quobyte-e974420e-98cc-41aa-8c88-dd8b5b713dce" acquired by "delete_volume" :: waited 0.017s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:05:58 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ed1d8d-615a-4f84-b063-2719aa0f9cc2]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:05:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7ab3b499-6cfc-47ee-801e-c360ce3b8b6a tempest-TestStampPattern-1593609708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e974420e-98cc-41aa-8c88-dd8b5b713dce {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:05:58 devstack sudo[105229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e974420e-98cc-41aa-8c88-dd8b5b713dce Jul 30 17:05:58 devstack sudo[105229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:05:59 devstack sudo[105229]: pam_unix(sudo:session): session closed for user root Jul 30 17:05:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7ab3b499-6cfc-47ee-801e-c360ce3b8b6a tempest-TestStampPattern-1593609708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e974420e-98cc-41aa-8c88-dd8b5b713dce" returned: 0 in 0.395s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:05:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7ab3b499-6cfc-47ee-801e-c360ce3b8b6a tempest-TestStampPattern-1593609708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e974420e-98cc-41aa-8c88-dd8b5b713dce {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:05:59 devstack sudo[105234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e974420e-98cc-41aa-8c88-dd8b5b713dce Jul 30 17:05:59 devstack sudo[105234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:05:59 devstack sudo[105234]: pam_unix(sudo:session): session closed for user root Jul 30 17:05:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7ab3b499-6cfc-47ee-801e-c360ce3b8b6a tempest-TestStampPattern-1593609708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e974420e-98cc-41aa-8c88-dd8b5b713dce" returned: 0 in 0.255s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:05:59 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-7ab3b499-6cfc-47ee-801e-c360ce3b8b6a tempest-TestStampPattern-1593609708 None] Lock "cinder-quobyte-e974420e-98cc-41aa-8c88-dd8b5b713dce" released by "delete_volume" :: held 0.730s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:05:59 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-7ab3b499-6cfc-47ee-801e-c360ce3b8b6a tempest-TestStampPattern-1593609708 None] Created reservations ['dfbdb83d-8faf-42cc-862a-9f087019fb44', 'afcc4e79-ca0b-4f26-8ebb-43877b071ca8', '24a46ff5-5830-4172-a682-c7f5421d0cea', '59e5756c-d042-40e1-83ff-fc5fc4efe2d4'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:05:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-7ab3b499-6cfc-47ee-801e-c360ce3b8b6a tempest-TestStampPattern-1593609708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:05:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-7ab3b499-6cfc-47ee-801e-c360ce3b8b6a tempest-TestStampPattern-1593609708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:05:59 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-7ab3b499-6cfc-47ee-801e-c360ce3b8b6a tempest-TestStampPattern-1593609708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:05:59 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-7ab3b499-6cfc-47ee-801e-c360ce3b8b6a tempest-TestStampPattern-1593609708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:05:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-7ab3b499-6cfc-47ee-801e-c360ce3b8b6a tempest-TestStampPattern-1593609708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:05:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7ab3b499-6cfc-47ee-801e-c360ce3b8b6a tempest-TestStampPattern-1593609708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:05:59 devstack sudo[105237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:05:59 devstack sudo[105237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:05:59 devstack sudo[105237]: pam_unix(sudo:session): session closed for user root Jul 30 17:05:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7ab3b499-6cfc-47ee-801e-c360ce3b8b6a tempest-TestStampPattern-1593609708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.276s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:05:59 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-7ab3b499-6cfc-47ee-801e-c360ce3b8b6a tempest-TestStampPattern-1593609708 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:05:59 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-7ab3b499-6cfc-47ee-801e-c360ce3b8b6a tempest-TestStampPattern-1593609708 None] Deleted volume successfully. Jul 30 17:05:59 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-7ab3b499-6cfc-47ee-801e-c360ce3b8b6a tempest-TestStampPattern-1593609708 None] Lock "cinder-e974420e-98cc-41aa-8c88-dd8b5b713dce-delete_volume" released by "delete_volume" :: held 1.233s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:06:09 devstack cinder-volume[88568]: DEBUG dbcounter [-] [88568] Writing DB stats cinder:SELECT=24,cinder:UPDATE=34,cinder:INSERT=8,cinder:DELETE=1 {{(pid=88568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 17:06:09 devstack cinder-volume[88568]: DEBUG dbcounter [-] [88568] Writing DB stats cinder:SELECT=34,cinder:UPDATE=28,cinder:INSERT=8,cinder:DELETE=2 {{(pid=88568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 17:06:17 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-a16f5147-0ba4-4502-9397-834b7000ddfd tempest-CinderUnicodeTest-343011416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:06:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a16f5147-0ba4-4502-9397-834b7000ddfd tempest-CinderUnicodeTest-343011416 None] Flow 'volume_create_manager' (5ff7eb77-4d92-4b62-9042-ca3a8c40c701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:06:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a16f5147-0ba4-4502-9397-834b7000ddfd tempest-CinderUnicodeTest-343011416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abf76a88-3129-4b63-8b8c-5109c6caf3de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:06:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a16f5147-0ba4-4502-9397-834b7000ddfd tempest-CinderUnicodeTest-343011416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abf76a88-3129-4b63-8b8c-5109c6caf3de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:06:17Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5492d2b6-5ab7-4417-ab4f-ac290c31f41b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78186c673d09407d93874302246ce196',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:06:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:06:17Z,use_quota=True,user_id='5a83e45ca9444649b8a86de0be3e9507',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:06:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a16f5147-0ba4-4502-9397-834b7000ddfd tempest-CinderUnicodeTest-343011416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a2e24b0-86e8-4ee5-b5e6-98c24e564687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:06:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a16f5147-0ba4-4502-9397-834b7000ddfd tempest-CinderUnicodeTest-343011416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a2e24b0-86e8-4ee5-b5e6-98c24e564687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:06:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a16f5147-0ba4-4502-9397-834b7000ddfd tempest-CinderUnicodeTest-343011416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74679a74-7d16-4322-9458-0735a98a0f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:06:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a16f5147-0ba4-4502-9397-834b7000ddfd tempest-CinderUnicodeTest-343011416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74679a74-7d16-4322-9458-0735a98a0f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5492d2b6-5ab7-4417-ab4f-ac290c31f41b', 'volume_name': 'volume-5492d2b6-5ab7-4417-ab4f-ac290c31f41b', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:06:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a16f5147-0ba4-4502-9397-834b7000ddfd tempest-CinderUnicodeTest-343011416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d116028-4198-4faa-ba85-bc07b21615fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:06:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a16f5147-0ba4-4502-9397-834b7000ddfd tempest-CinderUnicodeTest-343011416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d116028-4198-4faa-ba85-bc07b21615fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:06:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a16f5147-0ba4-4502-9397-834b7000ddfd tempest-CinderUnicodeTest-343011416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b199580-a00d-4334-bfd0-d24da7a9df39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:06:17 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-a16f5147-0ba4-4502-9397-834b7000ddfd tempest-CinderUnicodeTest-343011416 None] Volume 5492d2b6-5ab7-4417-ab4f-ac290c31f41b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5492d2b6-5ab7-4417-ab4f-ac290c31f41b', 'volume_size': 1} Jul 30 17:06:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a16f5147-0ba4-4502-9397-834b7000ddfd tempest-CinderUnicodeTest-343011416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:06:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a16f5147-0ba4-4502-9397-834b7000ddfd tempest-CinderUnicodeTest-343011416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:06:17 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-a16f5147-0ba4-4502-9397-834b7000ddfd tempest-CinderUnicodeTest-343011416 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:06:17Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5492d2b6-5ab7-4417-ab4f-ac290c31f41b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78186c673d09407d93874302246ce196',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:06:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:06:17Z,use_quota=True,user_id='5a83e45ca9444649b8a86de0be3e9507',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:06:17 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-a16f5147-0ba4-4502-9397-834b7000ddfd tempest-CinderUnicodeTest-343011416 None] Creating volume 5492d2b6-5ab7-4417-ab4f-ac290c31f41b {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:06:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a16f5147-0ba4-4502-9397-834b7000ddfd tempest-CinderUnicodeTest-343011416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:06:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a16f5147-0ba4-4502-9397-834b7000ddfd tempest-CinderUnicodeTest-343011416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:06:17 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-a16f5147-0ba4-4502-9397-834b7000ddfd tempest-CinderUnicodeTest-343011416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:06:17 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-a16f5147-0ba4-4502-9397-834b7000ddfd tempest-CinderUnicodeTest-343011416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:06:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a16f5147-0ba4-4502-9397-834b7000ddfd tempest-CinderUnicodeTest-343011416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:06:17 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-a16f5147-0ba4-4502-9397-834b7000ddfd tempest-CinderUnicodeTest-343011416 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:06:17 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-a16f5147-0ba4-4502-9397-834b7000ddfd tempest-CinderUnicodeTest-343011416 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:06:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a16f5147-0ba4-4502-9397-834b7000ddfd tempest-CinderUnicodeTest-343011416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5492d2b6-5ab7-4417-ab4f-ac290c31f41b 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:17 devstack sudo[105254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5492d2b6-5ab7-4417-ab4f-ac290c31f41b 1073741824 Jul 30 17:06:17 devstack sudo[105254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:17 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-03095d11-ffc5-4b49-b7ce-c9f127a52260 tempest-TestServerVolumeAttachmentScenario-953339173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:06:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-03095d11-ffc5-4b49-b7ce-c9f127a52260 tempest-TestServerVolumeAttachmentScenario-953339173 None] Flow 'volume_create_manager' (5cd1d191-8b2b-4496-803d-24ba866393c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:06:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-03095d11-ffc5-4b49-b7ce-c9f127a52260 tempest-TestServerVolumeAttachmentScenario-953339173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8da5a687-0748-4bb0-8cd0-ba1f78ec8c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:06:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-03095d11-ffc5-4b49-b7ce-c9f127a52260 tempest-TestServerVolumeAttachmentScenario-953339173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8da5a687-0748-4bb0-8cd0-ba1f78ec8c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:06:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1939215388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fba3d2d6-74ef-4f23-a0bb-357cc10d7340,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18456add6e014b418d6f490ca2d8865a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:06:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:06:17Z,use_quota=True,user_id='fc5139942c8d4778adc860bec20f2d02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:06:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-03095d11-ffc5-4b49-b7ce-c9f127a52260 tempest-TestServerVolumeAttachmentScenario-953339173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a2772b0-d778-449b-86ed-ade82933583f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:06:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-03095d11-ffc5-4b49-b7ce-c9f127a52260 tempest-TestServerVolumeAttachmentScenario-953339173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a2772b0-d778-449b-86ed-ade82933583f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:06:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-03095d11-ffc5-4b49-b7ce-c9f127a52260 tempest-TestServerVolumeAttachmentScenario-953339173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4750fec-54fb-4977-80cf-dcf998f1e927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:06:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-03095d11-ffc5-4b49-b7ce-c9f127a52260 tempest-TestServerVolumeAttachmentScenario-953339173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4750fec-54fb-4977-80cf-dcf998f1e927) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fba3d2d6-74ef-4f23-a0bb-357cc10d7340', 'volume_name': 'volume-fba3d2d6-74ef-4f23-a0bb-357cc10d7340', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:06:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-03095d11-ffc5-4b49-b7ce-c9f127a52260 tempest-TestServerVolumeAttachmentScenario-953339173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (897f03db-43ae-47ef-855a-b4ae9c893f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:06:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-03095d11-ffc5-4b49-b7ce-c9f127a52260 tempest-TestServerVolumeAttachmentScenario-953339173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (897f03db-43ae-47ef-855a-b4ae9c893f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:06:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-03095d11-ffc5-4b49-b7ce-c9f127a52260 tempest-TestServerVolumeAttachmentScenario-953339173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17db3a27-26aa-45ed-b7bf-d139accd2dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:06:17 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-03095d11-ffc5-4b49-b7ce-c9f127a52260 tempest-TestServerVolumeAttachmentScenario-953339173 None] Volume fba3d2d6-74ef-4f23-a0bb-357cc10d7340: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fba3d2d6-74ef-4f23-a0bb-357cc10d7340', 'volume_size': 1} Jul 30 17:06:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-03095d11-ffc5-4b49-b7ce-c9f127a52260 tempest-TestServerVolumeAttachmentScenario-953339173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:06:17 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7b4dd68-9408-4045-bfe4-4ee0f31c9a2c tempest-TestServerVolumeAttachmentScenario-953339173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:06:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-c7b4dd68-9408-4045-bfe4-4ee0f31c9a2c tempest-TestServerVolumeAttachmentScenario-953339173 None] Flow 'volume_create_manager' (8de149da-2bb1-4a84-9246-d07872455ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:06:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-c7b4dd68-9408-4045-bfe4-4ee0f31c9a2c tempest-TestServerVolumeAttachmentScenario-953339173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd102065-d5ef-40b9-a14c-fe8ba5866af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:06:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-c7b4dd68-9408-4045-bfe4-4ee0f31c9a2c tempest-TestServerVolumeAttachmentScenario-953339173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd102065-d5ef-40b9-a14c-fe8ba5866af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:06:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1561659729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a085605-c2a3-4106-8c53-7f1c2588676c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18456add6e014b418d6f490ca2d8865a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:06:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:06:17Z,use_quota=True,user_id='fc5139942c8d4778adc860bec20f2d02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:06:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-c7b4dd68-9408-4045-bfe4-4ee0f31c9a2c tempest-TestServerVolumeAttachmentScenario-953339173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40eff197-d20d-41f5-8897-1ce61d1675e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:06:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-c7b4dd68-9408-4045-bfe4-4ee0f31c9a2c tempest-TestServerVolumeAttachmentScenario-953339173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40eff197-d20d-41f5-8897-1ce61d1675e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:06:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-c7b4dd68-9408-4045-bfe4-4ee0f31c9a2c tempest-TestServerVolumeAttachmentScenario-953339173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (242ad011-2565-4d54-bda5-1492226e4f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:06:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-c7b4dd68-9408-4045-bfe4-4ee0f31c9a2c tempest-TestServerVolumeAttachmentScenario-953339173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (242ad011-2565-4d54-bda5-1492226e4f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a085605-c2a3-4106-8c53-7f1c2588676c', 'volume_name': 'volume-7a085605-c2a3-4106-8c53-7f1c2588676c', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:06:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-c7b4dd68-9408-4045-bfe4-4ee0f31c9a2c tempest-TestServerVolumeAttachmentScenario-953339173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9246f5a-8332-4bdb-98e4-b977b7dd3ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:06:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-c7b4dd68-9408-4045-bfe4-4ee0f31c9a2c tempest-TestServerVolumeAttachmentScenario-953339173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9246f5a-8332-4bdb-98e4-b977b7dd3ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:06:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-c7b4dd68-9408-4045-bfe4-4ee0f31c9a2c tempest-TestServerVolumeAttachmentScenario-953339173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e658d66-cf8c-49c4-995c-5dc0ea3d517b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:06:17 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-c7b4dd68-9408-4045-bfe4-4ee0f31c9a2c tempest-TestServerVolumeAttachmentScenario-953339173 None] Volume 7a085605-c2a3-4106-8c53-7f1c2588676c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a085605-c2a3-4106-8c53-7f1c2588676c', 'volume_size': 1} Jul 30 17:06:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-c7b4dd68-9408-4045-bfe4-4ee0f31c9a2c tempest-TestServerVolumeAttachmentScenario-953339173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:06:17 devstack sudo[105254]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a16f5147-0ba4-4502-9397-834b7000ddfd tempest-CinderUnicodeTest-343011416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5492d2b6-5ab7-4417-ab4f-ac290c31f41b 1073741824" returned: 0 in 0.529s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a16f5147-0ba4-4502-9397-834b7000ddfd tempest-CinderUnicodeTest-343011416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5492d2b6-5ab7-4417-ab4f-ac290c31f41b {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:17 devstack sudo[105260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5492d2b6-5ab7-4417-ab4f-ac290c31f41b Jul 30 17:06:17 devstack sudo[105260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:18 devstack sudo[105260]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a16f5147-0ba4-4502-9397-834b7000ddfd tempest-CinderUnicodeTest-343011416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5492d2b6-5ab7-4417-ab4f-ac290c31f41b" returned: 0 in 0.257s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:18 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-a16f5147-0ba4-4502-9397-834b7000ddfd tempest-CinderUnicodeTest-343011416 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:06:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a16f5147-0ba4-4502-9397-834b7000ddfd tempest-CinderUnicodeTest-343011416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:06:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-03095d11-ffc5-4b49-b7ce-c9f127a52260 tempest-TestServerVolumeAttachmentScenario-953339173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.682s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:06:18 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-03095d11-ffc5-4b49-b7ce-c9f127a52260 tempest-TestServerVolumeAttachmentScenario-953339173 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:06:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1939215388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fba3d2d6-74ef-4f23-a0bb-357cc10d7340,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18456add6e014b418d6f490ca2d8865a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:06:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:06:17Z,use_quota=True,user_id='fc5139942c8d4778adc860bec20f2d02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:06:18 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-03095d11-ffc5-4b49-b7ce-c9f127a52260 tempest-TestServerVolumeAttachmentScenario-953339173 None] Creating volume fba3d2d6-74ef-4f23-a0bb-357cc10d7340 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:06:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-03095d11-ffc5-4b49-b7ce-c9f127a52260 tempest-TestServerVolumeAttachmentScenario-953339173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:06:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-03095d11-ffc5-4b49-b7ce-c9f127a52260 tempest-TestServerVolumeAttachmentScenario-953339173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:06:18 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-03095d11-ffc5-4b49-b7ce-c9f127a52260 tempest-TestServerVolumeAttachmentScenario-953339173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:06:18 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-03095d11-ffc5-4b49-b7ce-c9f127a52260 tempest-TestServerVolumeAttachmentScenario-953339173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:06:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-03095d11-ffc5-4b49-b7ce-c9f127a52260 tempest-TestServerVolumeAttachmentScenario-953339173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:06:18 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-03095d11-ffc5-4b49-b7ce-c9f127a52260 tempest-TestServerVolumeAttachmentScenario-953339173 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:06:18 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-03095d11-ffc5-4b49-b7ce-c9f127a52260 tempest-TestServerVolumeAttachmentScenario-953339173 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:06:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-03095d11-ffc5-4b49-b7ce-c9f127a52260 tempest-TestServerVolumeAttachmentScenario-953339173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fba3d2d6-74ef-4f23-a0bb-357cc10d7340 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:18 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a16f5147-0ba4-4502-9397-834b7000ddfd tempest-CinderUnicodeTest-343011416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b199580-a00d-4334-bfd0-d24da7a9df39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5492d2b6-5ab7-4417-ab4f-ac290c31f41b', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:06:18 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a16f5147-0ba4-4502-9397-834b7000ddfd tempest-CinderUnicodeTest-343011416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b836daa7-4ebb-43ad-974a-4b847f2eaf5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:06:18 devstack sudo[105263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fba3d2d6-74ef-4f23-a0bb-357cc10d7340 1073741824 Jul 30 17:06:18 devstack sudo[105263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:18 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-a16f5147-0ba4-4502-9397-834b7000ddfd tempest-CinderUnicodeTest-343011416 None] Volume volume-5492d2b6-5ab7-4417-ab4f-ac290c31f41b (5492d2b6-5ab7-4417-ab4f-ac290c31f41b): created successfully Jul 30 17:06:18 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a16f5147-0ba4-4502-9397-834b7000ddfd tempest-CinderUnicodeTest-343011416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b836daa7-4ebb-43ad-974a-4b847f2eaf5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:06:18 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a16f5147-0ba4-4502-9397-834b7000ddfd tempest-CinderUnicodeTest-343011416 None] Flow 'volume_create_manager' (5ff7eb77-4d92-4b62-9042-ca3a8c40c701) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:06:18 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-a16f5147-0ba4-4502-9397-834b7000ddfd tempest-CinderUnicodeTest-343011416 None] Created volume successfully. Jul 30 17:06:18 devstack sudo[105263]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-03095d11-ffc5-4b49-b7ce-c9f127a52260 tempest-TestServerVolumeAttachmentScenario-953339173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fba3d2d6-74ef-4f23-a0bb-357cc10d7340 1073741824" returned: 0 in 0.466s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-03095d11-ffc5-4b49-b7ce-c9f127a52260 tempest-TestServerVolumeAttachmentScenario-953339173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fba3d2d6-74ef-4f23-a0bb-357cc10d7340 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:18 devstack sudo[105269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fba3d2d6-74ef-4f23-a0bb-357cc10d7340 Jul 30 17:06:18 devstack sudo[105269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:18 devstack sudo[105269]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-03095d11-ffc5-4b49-b7ce-c9f127a52260 tempest-TestServerVolumeAttachmentScenario-953339173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fba3d2d6-74ef-4f23-a0bb-357cc10d7340" returned: 0 in 0.248s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:18 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-03095d11-ffc5-4b49-b7ce-c9f127a52260 tempest-TestServerVolumeAttachmentScenario-953339173 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:06:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-03095d11-ffc5-4b49-b7ce-c9f127a52260 tempest-TestServerVolumeAttachmentScenario-953339173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:06:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-c7b4dd68-9408-4045-bfe4-4ee0f31c9a2c tempest-TestServerVolumeAttachmentScenario-953339173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.171s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:06:18 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-c7b4dd68-9408-4045-bfe4-4ee0f31c9a2c tempest-TestServerVolumeAttachmentScenario-953339173 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:06:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1561659729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a085605-c2a3-4106-8c53-7f1c2588676c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18456add6e014b418d6f490ca2d8865a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:06:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:06:17Z,use_quota=True,user_id='fc5139942c8d4778adc860bec20f2d02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:06:18 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-c7b4dd68-9408-4045-bfe4-4ee0f31c9a2c tempest-TestServerVolumeAttachmentScenario-953339173 None] Creating volume 7a085605-c2a3-4106-8c53-7f1c2588676c {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:06:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-c7b4dd68-9408-4045-bfe4-4ee0f31c9a2c tempest-TestServerVolumeAttachmentScenario-953339173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:06:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-c7b4dd68-9408-4045-bfe4-4ee0f31c9a2c tempest-TestServerVolumeAttachmentScenario-953339173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:06:18 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-c7b4dd68-9408-4045-bfe4-4ee0f31c9a2c tempest-TestServerVolumeAttachmentScenario-953339173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:06:18 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-c7b4dd68-9408-4045-bfe4-4ee0f31c9a2c tempest-TestServerVolumeAttachmentScenario-953339173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:06:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-c7b4dd68-9408-4045-bfe4-4ee0f31c9a2c tempest-TestServerVolumeAttachmentScenario-953339173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:06:18 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-c7b4dd68-9408-4045-bfe4-4ee0f31c9a2c tempest-TestServerVolumeAttachmentScenario-953339173 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:06:18 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-c7b4dd68-9408-4045-bfe4-4ee0f31c9a2c tempest-TestServerVolumeAttachmentScenario-953339173 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:06:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-c7b4dd68-9408-4045-bfe4-4ee0f31c9a2c tempest-TestServerVolumeAttachmentScenario-953339173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7a085605-c2a3-4106-8c53-7f1c2588676c 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:18 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-03095d11-ffc5-4b49-b7ce-c9f127a52260 tempest-TestServerVolumeAttachmentScenario-953339173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17db3a27-26aa-45ed-b7bf-d139accd2dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fba3d2d6-74ef-4f23-a0bb-357cc10d7340', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:06:18 devstack sudo[105272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7a085605-c2a3-4106-8c53-7f1c2588676c 1073741824 Jul 30 17:06:18 devstack sudo[105272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:18 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-03095d11-ffc5-4b49-b7ce-c9f127a52260 tempest-TestServerVolumeAttachmentScenario-953339173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b45ae4c4-2382-4676-9db0-74991b105b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:06:18 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-03095d11-ffc5-4b49-b7ce-c9f127a52260 tempest-TestServerVolumeAttachmentScenario-953339173 None] Volume volume-fba3d2d6-74ef-4f23-a0bb-357cc10d7340 (fba3d2d6-74ef-4f23-a0bb-357cc10d7340): created successfully Jul 30 17:06:18 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-03095d11-ffc5-4b49-b7ce-c9f127a52260 tempest-TestServerVolumeAttachmentScenario-953339173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b45ae4c4-2382-4676-9db0-74991b105b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:06:18 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-03095d11-ffc5-4b49-b7ce-c9f127a52260 tempest-TestServerVolumeAttachmentScenario-953339173 None] Flow 'volume_create_manager' (5cd1d191-8b2b-4496-803d-24ba866393c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:06:18 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-03095d11-ffc5-4b49-b7ce-c9f127a52260 tempest-TestServerVolumeAttachmentScenario-953339173 None] Created volume successfully. Jul 30 17:06:19 devstack sudo[105272]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:19 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-c7b4dd68-9408-4045-bfe4-4ee0f31c9a2c tempest-TestServerVolumeAttachmentScenario-953339173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7a085605-c2a3-4106-8c53-7f1c2588676c 1073741824" returned: 0 in 0.486s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:19 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-c7b4dd68-9408-4045-bfe4-4ee0f31c9a2c tempest-TestServerVolumeAttachmentScenario-953339173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7a085605-c2a3-4106-8c53-7f1c2588676c {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:19 devstack sudo[105279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7a085605-c2a3-4106-8c53-7f1c2588676c Jul 30 17:06:19 devstack sudo[105279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:19 devstack sudo[105279]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:19 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-c7b4dd68-9408-4045-bfe4-4ee0f31c9a2c tempest-TestServerVolumeAttachmentScenario-953339173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7a085605-c2a3-4106-8c53-7f1c2588676c" returned: 0 in 0.295s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:19 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-c7b4dd68-9408-4045-bfe4-4ee0f31c9a2c tempest-TestServerVolumeAttachmentScenario-953339173 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:06:19 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-c7b4dd68-9408-4045-bfe4-4ee0f31c9a2c tempest-TestServerVolumeAttachmentScenario-953339173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:06:19 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-c7b4dd68-9408-4045-bfe4-4ee0f31c9a2c tempest-TestServerVolumeAttachmentScenario-953339173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e658d66-cf8c-49c4-995c-5dc0ea3d517b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a085605-c2a3-4106-8c53-7f1c2588676c', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:06:19 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-c7b4dd68-9408-4045-bfe4-4ee0f31c9a2c tempest-TestServerVolumeAttachmentScenario-953339173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36b382b6-a112-4190-afa2-65b2b486ab2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:06:19 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-c7b4dd68-9408-4045-bfe4-4ee0f31c9a2c tempest-TestServerVolumeAttachmentScenario-953339173 None] Volume volume-7a085605-c2a3-4106-8c53-7f1c2588676c (7a085605-c2a3-4106-8c53-7f1c2588676c): created successfully Jul 30 17:06:19 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-c7b4dd68-9408-4045-bfe4-4ee0f31c9a2c tempest-TestServerVolumeAttachmentScenario-953339173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36b382b6-a112-4190-afa2-65b2b486ab2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:06:19 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-c7b4dd68-9408-4045-bfe4-4ee0f31c9a2c tempest-TestServerVolumeAttachmentScenario-953339173 None] Flow 'volume_create_manager' (8de149da-2bb1-4a84-9246-d07872455ba4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:06:19 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-c7b4dd68-9408-4045-bfe4-4ee0f31c9a2c tempest-TestServerVolumeAttachmentScenario-953339173 None] Created volume successfully. Jul 30 17:06:19 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-df028450-df81-46de-862a-1f413e91ed0e tempest-CinderUnicodeTest-343011416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:06:19 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-df028450-df81-46de-862a-1f413e91ed0e tempest-CinderUnicodeTest-343011416 None] Flow 'volume_create_manager' (ae9c268c-c635-47ec-876b-ed852ab03c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:06:19 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-df028450-df81-46de-862a-1f413e91ed0e tempest-CinderUnicodeTest-343011416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abcd07b8-1a8b-4fb9-8d88-89d7f48a592a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:06:19 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-df028450-df81-46de-862a-1f413e91ed0e tempest-CinderUnicodeTest-343011416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abcd07b8-1a8b-4fb9-8d88-89d7f48a592a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:06:19Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1097337371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e51cee3-2b50-4e91-afcb-77a9fd3025f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78186c673d09407d93874302246ce196',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:06:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:06:20Z,use_quota=True,user_id='5a83e45ca9444649b8a86de0be3e9507',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:06:19 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-df028450-df81-46de-862a-1f413e91ed0e tempest-CinderUnicodeTest-343011416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da1d943a-ece1-4c1b-a173-c7e538914a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:06:19 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-df028450-df81-46de-862a-1f413e91ed0e tempest-CinderUnicodeTest-343011416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da1d943a-ece1-4c1b-a173-c7e538914a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:06:19 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-df028450-df81-46de-862a-1f413e91ed0e tempest-CinderUnicodeTest-343011416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41f528f1-ddf5-4a4e-958f-cdef9353455c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:06:19 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-df028450-df81-46de-862a-1f413e91ed0e tempest-CinderUnicodeTest-343011416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41f528f1-ddf5-4a4e-958f-cdef9353455c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e51cee3-2b50-4e91-afcb-77a9fd3025f7', 'volume_name': 'volume-7e51cee3-2b50-4e91-afcb-77a9fd3025f7', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:06:19 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-df028450-df81-46de-862a-1f413e91ed0e tempest-CinderUnicodeTest-343011416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53160604-5596-41a4-8324-4de2383362aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:06:19 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-df028450-df81-46de-862a-1f413e91ed0e tempest-CinderUnicodeTest-343011416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53160604-5596-41a4-8324-4de2383362aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:06:19 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-df028450-df81-46de-862a-1f413e91ed0e tempest-CinderUnicodeTest-343011416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4474c17-7e98-4f6b-a0bf-825ffb337adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:06:19 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-df028450-df81-46de-862a-1f413e91ed0e tempest-CinderUnicodeTest-343011416 None] Volume 7e51cee3-2b50-4e91-afcb-77a9fd3025f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e51cee3-2b50-4e91-afcb-77a9fd3025f7', 'volume_size': 1} Jul 30 17:06:19 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-df028450-df81-46de-862a-1f413e91ed0e tempest-CinderUnicodeTest-343011416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:06:19 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-df028450-df81-46de-862a-1f413e91ed0e tempest-CinderUnicodeTest-343011416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:06:19 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-df028450-df81-46de-862a-1f413e91ed0e tempest-CinderUnicodeTest-343011416 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:06:19Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1097337371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e51cee3-2b50-4e91-afcb-77a9fd3025f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78186c673d09407d93874302246ce196',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:06:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:06:20Z,use_quota=True,user_id='5a83e45ca9444649b8a86de0be3e9507',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:06:19 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-df028450-df81-46de-862a-1f413e91ed0e tempest-CinderUnicodeTest-343011416 None] Creating volume 7e51cee3-2b50-4e91-afcb-77a9fd3025f7 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:06:19 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-df028450-df81-46de-862a-1f413e91ed0e tempest-CinderUnicodeTest-343011416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:06:19 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-df028450-df81-46de-862a-1f413e91ed0e tempest-CinderUnicodeTest-343011416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:06:19 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-df028450-df81-46de-862a-1f413e91ed0e tempest-CinderUnicodeTest-343011416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:06:19 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-df028450-df81-46de-862a-1f413e91ed0e tempest-CinderUnicodeTest-343011416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:06:19 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-df028450-df81-46de-862a-1f413e91ed0e tempest-CinderUnicodeTest-343011416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:06:19 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-df028450-df81-46de-862a-1f413e91ed0e tempest-CinderUnicodeTest-343011416 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:06:19 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-df028450-df81-46de-862a-1f413e91ed0e tempest-CinderUnicodeTest-343011416 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:06:19 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-df028450-df81-46de-862a-1f413e91ed0e tempest-CinderUnicodeTest-343011416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7e51cee3-2b50-4e91-afcb-77a9fd3025f7 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:19 devstack sudo[105282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7e51cee3-2b50-4e91-afcb-77a9fd3025f7 1073741824 Jul 30 17:06:19 devstack sudo[105282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:20 devstack sudo[105282]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-df028450-df81-46de-862a-1f413e91ed0e tempest-CinderUnicodeTest-343011416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7e51cee3-2b50-4e91-afcb-77a9fd3025f7 1073741824" returned: 0 in 0.506s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-df028450-df81-46de-862a-1f413e91ed0e tempest-CinderUnicodeTest-343011416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7e51cee3-2b50-4e91-afcb-77a9fd3025f7 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:20 devstack sudo[105291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7e51cee3-2b50-4e91-afcb-77a9fd3025f7 Jul 30 17:06:20 devstack sudo[105291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:20 devstack sudo[105291]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-df028450-df81-46de-862a-1f413e91ed0e tempest-CinderUnicodeTest-343011416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7e51cee3-2b50-4e91-afcb-77a9fd3025f7" returned: 0 in 0.277s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:20 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-df028450-df81-46de-862a-1f413e91ed0e tempest-CinderUnicodeTest-343011416 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:06:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-df028450-df81-46de-862a-1f413e91ed0e tempest-CinderUnicodeTest-343011416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:06:20 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-df028450-df81-46de-862a-1f413e91ed0e tempest-CinderUnicodeTest-343011416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4474c17-7e98-4f6b-a0bf-825ffb337adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e51cee3-2b50-4e91-afcb-77a9fd3025f7', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:06:20 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-df028450-df81-46de-862a-1f413e91ed0e tempest-CinderUnicodeTest-343011416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b617c78d-e370-46e3-841a-21080d6bdac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:06:20 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-df028450-df81-46de-862a-1f413e91ed0e tempest-CinderUnicodeTest-343011416 None] Volume volume-7e51cee3-2b50-4e91-afcb-77a9fd3025f7 (7e51cee3-2b50-4e91-afcb-77a9fd3025f7): created successfully Jul 30 17:06:20 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-df028450-df81-46de-862a-1f413e91ed0e tempest-CinderUnicodeTest-343011416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b617c78d-e370-46e3-841a-21080d6bdac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:06:20 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-df028450-df81-46de-862a-1f413e91ed0e tempest-CinderUnicodeTest-343011416 None] Flow 'volume_create_manager' (ae9c268c-c635-47ec-876b-ed852ab03c30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:06:20 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-df028450-df81-46de-862a-1f413e91ed0e tempest-CinderUnicodeTest-343011416 None] Created volume successfully. Jul 30 17:06:22 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-30c6f7b5-591b-41d6-a385-d425595190bd tempest-CinderUnicodeTest-343011416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:06:22 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-30c6f7b5-591b-41d6-a385-d425595190bd tempest-CinderUnicodeTest-343011416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:06:22 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-30c6f7b5-591b-41d6-a385-d425595190bd tempest-CinderUnicodeTest-343011416 None] Creating offline snapshot d12cf772-f0ff-444d-a41b-e2c94bb890f8 of volume 7e51cee3-2b50-4e91-afcb-77a9fd3025f7 {{(pid=88568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:06:22 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd33605-e3d6-4fad-ad4d-f535bf37cb1e]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:06:22 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-30c6f7b5-591b-41d6-a385-d425595190bd tempest-CinderUnicodeTest-343011416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7e51cee3-2b50-4e91-afcb-77a9fd3025f7 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:22 devstack sudo[105311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7e51cee3-2b50-4e91-afcb-77a9fd3025f7 Jul 30 17:06:22 devstack sudo[105311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:22 devstack sudo[105311]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:22 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-30c6f7b5-591b-41d6-a385-d425595190bd tempest-CinderUnicodeTest-343011416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7e51cee3-2b50-4e91-afcb-77a9fd3025f7" returned: 0 in 0.387s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:22 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-30c6f7b5-591b-41d6-a385-d425595190bd tempest-CinderUnicodeTest-343011416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7e51cee3-2b50-4e91-afcb-77a9fd3025f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7e51cee3-2b50-4e91-afcb-77a9fd3025f7.d12cf772-f0ff-444d-a41b-e2c94bb890f8 1G {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:22 devstack sudo[105316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7e51cee3-2b50-4e91-afcb-77a9fd3025f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7e51cee3-2b50-4e91-afcb-77a9fd3025f7.d12cf772-f0ff-444d-a41b-e2c94bb890f8 1G Jul 30 17:06:22 devstack sudo[105316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:22 devstack sudo[105316]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:22 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-30c6f7b5-591b-41d6-a385-d425595190bd tempest-CinderUnicodeTest-343011416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7e51cee3-2b50-4e91-afcb-77a9fd3025f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7e51cee3-2b50-4e91-afcb-77a9fd3025f7.d12cf772-f0ff-444d-a41b-e2c94bb890f8 1G" returned: 0 in 0.436s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:22 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-30c6f7b5-591b-41d6-a385-d425595190bd tempest-CinderUnicodeTest-343011416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e51cee3-2b50-4e91-afcb-77a9fd3025f7 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7e51cee3-2b50-4e91-afcb-77a9fd3025f7.d12cf772-f0ff-444d-a41b-e2c94bb890f8 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:23 devstack sudo[105322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e51cee3-2b50-4e91-afcb-77a9fd3025f7 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7e51cee3-2b50-4e91-afcb-77a9fd3025f7.d12cf772-f0ff-444d-a41b-e2c94bb890f8 Jul 30 17:06:23 devstack sudo[105322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:23 devstack sudo[105322]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:23 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-30c6f7b5-591b-41d6-a385-d425595190bd tempest-CinderUnicodeTest-343011416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e51cee3-2b50-4e91-afcb-77a9fd3025f7 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7e51cee3-2b50-4e91-afcb-77a9fd3025f7.d12cf772-f0ff-444d-a41b-e2c94bb890f8" returned: 0 in 0.323s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:23 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-30c6f7b5-591b-41d6-a385-d425595190bd tempest-CinderUnicodeTest-343011416 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7e51cee3-2b50-4e91-afcb-77a9fd3025f7.d12cf772-f0ff-444d-a41b-e2c94bb890f8 is being set with open permissions: ugo+rw Jul 30 17:06:23 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-30c6f7b5-591b-41d6-a385-d425595190bd tempest-CinderUnicodeTest-343011416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7e51cee3-2b50-4e91-afcb-77a9fd3025f7.d12cf772-f0ff-444d-a41b-e2c94bb890f8 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:23 devstack sudo[105328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7e51cee3-2b50-4e91-afcb-77a9fd3025f7.d12cf772-f0ff-444d-a41b-e2c94bb890f8 Jul 30 17:06:23 devstack sudo[105328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:23 devstack sudo[105328]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:23 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-30c6f7b5-591b-41d6-a385-d425595190bd tempest-CinderUnicodeTest-343011416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7e51cee3-2b50-4e91-afcb-77a9fd3025f7.d12cf772-f0ff-444d-a41b-e2c94bb890f8" returned: 0 in 0.248s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:23 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-30c6f7b5-591b-41d6-a385-d425595190bd tempest-CinderUnicodeTest-343011416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7e51cee3-2b50-4e91-afcb-77a9fd3025f7.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:23 devstack sudo[105331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7e51cee3-2b50-4e91-afcb-77a9fd3025f7.info Jul 30 17:06:23 devstack sudo[105331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:24 devstack sudo[105331]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-30c6f7b5-591b-41d6-a385-d425595190bd tempest-CinderUnicodeTest-343011416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7e51cee3-2b50-4e91-afcb-77a9fd3025f7.info" returned: 0 in 0.422s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:24 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-30c6f7b5-591b-41d6-a385-d425595190bd tempest-CinderUnicodeTest-343011416 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7e51cee3-2b50-4e91-afcb-77a9fd3025f7.info is being set with open permissions: ugo+rw Jul 30 17:06:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-30c6f7b5-591b-41d6-a385-d425595190bd tempest-CinderUnicodeTest-343011416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7e51cee3-2b50-4e91-afcb-77a9fd3025f7.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:24 devstack sudo[105349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7e51cee3-2b50-4e91-afcb-77a9fd3025f7.info Jul 30 17:06:24 devstack sudo[105349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:24 devstack sudo[105349]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-30c6f7b5-591b-41d6-a385-d425595190bd tempest-CinderUnicodeTest-343011416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7e51cee3-2b50-4e91-afcb-77a9fd3025f7.info" returned: 0 in 0.396s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-30c6f7b5-591b-41d6-a385-d425595190bd tempest-CinderUnicodeTest-343011416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.328s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:06:24 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-30c6f7b5-591b-41d6-a385-d425595190bd tempest-CinderUnicodeTest-343011416 None] Create snapshot completed successfully Jul 30 17:06:25 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-0d2cc6d4-561a-46b0-a7c0-bf4f492be571 tempest-CinderUnicodeTest-343011416 None] Acquiring lock "cinder-d12cf772-f0ff-444d-a41b-e2c94bb890f8-delete_snapshot" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:06:25 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-0d2cc6d4-561a-46b0-a7c0-bf4f492be571 tempest-CinderUnicodeTest-343011416 None] Lock "cinder-d12cf772-f0ff-444d-a41b-e2c94bb890f8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:06:25 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-0d2cc6d4-561a-46b0-a7c0-bf4f492be571 tempest-CinderUnicodeTest-343011416 None] Acquiring lock "cinder-quobyte-7e51cee3-2b50-4e91-afcb-77a9fd3025f7" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:06:25 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-0d2cc6d4-561a-46b0-a7c0-bf4f492be571 tempest-CinderUnicodeTest-343011416 None] Lock "cinder-quobyte-7e51cee3-2b50-4e91-afcb-77a9fd3025f7" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:06:25 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-0d2cc6d4-561a-46b0-a7c0-bf4f492be571 tempest-CinderUnicodeTest-343011416 None] Acquiring lock "cinder-quobyte-d12cf772-f0ff-444d-a41b-e2c94bb890f8" by "_delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:06:25 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-0d2cc6d4-561a-46b0-a7c0-bf4f492be571 tempest-CinderUnicodeTest-343011416 None] Lock "cinder-quobyte-d12cf772-f0ff-444d-a41b-e2c94bb890f8" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:06:25 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-0d2cc6d4-561a-46b0-a7c0-bf4f492be571 tempest-CinderUnicodeTest-343011416 None] Deleting offline snapshot d12cf772-f0ff-444d-a41b-e2c94bb890f8 of volume 7e51cee3-2b50-4e91-afcb-77a9fd3025f7 {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:06:25 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-0d2cc6d4-561a-46b0-a7c0-bf4f492be571 tempest-CinderUnicodeTest-343011416 None] snapshot_file for this snap is: volume-7e51cee3-2b50-4e91-afcb-77a9fd3025f7.d12cf772-f0ff-444d-a41b-e2c94bb890f8 {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:06:25 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[4778e669-0239-4cfb-a0b0-a571e68c0ac5]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:06:25 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0d2cc6d4-561a-46b0-a7c0-bf4f492be571 tempest-CinderUnicodeTest-343011416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7e51cee3-2b50-4e91-afcb-77a9fd3025f7.d12cf772-f0ff-444d-a41b-e2c94bb890f8 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:25 devstack sudo[105418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7e51cee3-2b50-4e91-afcb-77a9fd3025f7.d12cf772-f0ff-444d-a41b-e2c94bb890f8 Jul 30 17:06:25 devstack sudo[105418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:25 devstack sudo[105418]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:25 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0d2cc6d4-561a-46b0-a7c0-bf4f492be571 tempest-CinderUnicodeTest-343011416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7e51cee3-2b50-4e91-afcb-77a9fd3025f7.d12cf772-f0ff-444d-a41b-e2c94bb890f8" returned: 0 in 0.373s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:25 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-0d2cc6d4-561a-46b0-a7c0-bf4f492be571 tempest-CinderUnicodeTest-343011416 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e51cee3-2b50-4e91-afcb-77a9fd3025f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:06:25 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1fdce38-64c1-498c-96ae-c7d2dabb8892]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:06:25 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0d2cc6d4-561a-46b0-a7c0-bf4f492be571 tempest-CinderUnicodeTest-343011416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7e51cee3-2b50-4e91-afcb-77a9fd3025f7 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:25 devstack sudo[105424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7e51cee3-2b50-4e91-afcb-77a9fd3025f7 Jul 30 17:06:25 devstack sudo[105424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:26 devstack sudo[105424]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0d2cc6d4-561a-46b0-a7c0-bf4f492be571 tempest-CinderUnicodeTest-343011416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7e51cee3-2b50-4e91-afcb-77a9fd3025f7" returned: 0 in 0.414s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0d2cc6d4-561a-46b0-a7c0-bf4f492be571 tempest-CinderUnicodeTest-343011416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7e51cee3-2b50-4e91-afcb-77a9fd3025f7.d12cf772-f0ff-444d-a41b-e2c94bb890f8 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:26 devstack sudo[105431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7e51cee3-2b50-4e91-afcb-77a9fd3025f7.d12cf772-f0ff-444d-a41b-e2c94bb890f8 Jul 30 17:06:26 devstack sudo[105431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:26 devstack sudo[105431]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0d2cc6d4-561a-46b0-a7c0-bf4f492be571 tempest-CinderUnicodeTest-343011416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7e51cee3-2b50-4e91-afcb-77a9fd3025f7.d12cf772-f0ff-444d-a41b-e2c94bb890f8" returned: 0 in 0.437s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0d2cc6d4-561a-46b0-a7c0-bf4f492be571 tempest-CinderUnicodeTest-343011416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7e51cee3-2b50-4e91-afcb-77a9fd3025f7.d12cf772-f0ff-444d-a41b-e2c94bb890f8 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:26 devstack sudo[105437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7e51cee3-2b50-4e91-afcb-77a9fd3025f7.d12cf772-f0ff-444d-a41b-e2c94bb890f8 Jul 30 17:06:26 devstack sudo[105437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:26 devstack sudo[105437]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0d2cc6d4-561a-46b0-a7c0-bf4f492be571 tempest-CinderUnicodeTest-343011416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7e51cee3-2b50-4e91-afcb-77a9fd3025f7.d12cf772-f0ff-444d-a41b-e2c94bb890f8" returned: 0 in 0.259s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:26 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-0d2cc6d4-561a-46b0-a7c0-bf4f492be571 tempest-CinderUnicodeTest-343011416 None] Lock "cinder-quobyte-d12cf772-f0ff-444d-a41b-e2c94bb890f8" released by "_delete_snapshot" :: held 1.596s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:06:26 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-0d2cc6d4-561a-46b0-a7c0-bf4f492be571 tempest-CinderUnicodeTest-343011416 None] Lock "cinder-quobyte-7e51cee3-2b50-4e91-afcb-77a9fd3025f7" released by "delete_snapshot" :: held 1.625s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:06:27 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-0d2cc6d4-561a-46b0-a7c0-bf4f492be571 tempest-CinderUnicodeTest-343011416 None] Created reservations ['e2327e23-48ec-4879-b623-156fcaad1dff', '8941b783-0196-458d-aa81-75563b5138c5', '1903b131-6837-4f63-97e0-dfcc2c1b55f8', 'e51a4fa7-22e6-48dc-a0fa-ad473a3901fc'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:06:27 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-0d2cc6d4-561a-46b0-a7c0-bf4f492be571 tempest-CinderUnicodeTest-343011416 None] Delete snapshot completed successfully. Jul 30 17:06:27 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-0d2cc6d4-561a-46b0-a7c0-bf4f492be571 tempest-CinderUnicodeTest-343011416 None] Lock "cinder-d12cf772-f0ff-444d-a41b-e2c94bb890f8-delete_snapshot" released by "delete_snapshot" :: held 1.767s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:06:27 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-74170a4e-5227-4529-8bbd-a062b2eb47c8 tempest-CinderUnicodeTest-343011416 None] Acquiring lock "cinder-7e51cee3-2b50-4e91-afcb-77a9fd3025f7-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:06:27 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-74170a4e-5227-4529-8bbd-a062b2eb47c8 tempest-CinderUnicodeTest-343011416 None] Lock "cinder-7e51cee3-2b50-4e91-afcb-77a9fd3025f7-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:06:27 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-74170a4e-5227-4529-8bbd-a062b2eb47c8 tempest-CinderUnicodeTest-343011416 None] Acquiring lock "cinder-quobyte-7e51cee3-2b50-4e91-afcb-77a9fd3025f7" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:06:27 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-74170a4e-5227-4529-8bbd-a062b2eb47c8 tempest-CinderUnicodeTest-343011416 None] Lock "cinder-quobyte-7e51cee3-2b50-4e91-afcb-77a9fd3025f7" acquired by "delete_volume" :: waited 0.020s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:06:27 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2da2450-f08a-433a-b4ba-69f8e0b70738]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:06:27 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-74170a4e-5227-4529-8bbd-a062b2eb47c8 tempest-CinderUnicodeTest-343011416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7e51cee3-2b50-4e91-afcb-77a9fd3025f7 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:27 devstack sudo[105440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7e51cee3-2b50-4e91-afcb-77a9fd3025f7 Jul 30 17:06:27 devstack sudo[105440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:28 devstack sudo[105440]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-74170a4e-5227-4529-8bbd-a062b2eb47c8 tempest-CinderUnicodeTest-343011416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7e51cee3-2b50-4e91-afcb-77a9fd3025f7" returned: 0 in 0.408s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-74170a4e-5227-4529-8bbd-a062b2eb47c8 tempest-CinderUnicodeTest-343011416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7e51cee3-2b50-4e91-afcb-77a9fd3025f7 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:28 devstack sudo[105445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7e51cee3-2b50-4e91-afcb-77a9fd3025f7 Jul 30 17:06:28 devstack sudo[105445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:28 devstack sudo[105445]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-74170a4e-5227-4529-8bbd-a062b2eb47c8 tempest-CinderUnicodeTest-343011416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7e51cee3-2b50-4e91-afcb-77a9fd3025f7" returned: 0 in 0.270s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:28 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-74170a4e-5227-4529-8bbd-a062b2eb47c8 tempest-CinderUnicodeTest-343011416 None] Lock "cinder-quobyte-7e51cee3-2b50-4e91-afcb-77a9fd3025f7" released by "delete_volume" :: held 0.744s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:06:28 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-74170a4e-5227-4529-8bbd-a062b2eb47c8 tempest-CinderUnicodeTest-343011416 None] Created reservations ['d3f6cedf-bf60-4d49-89ba-9ddae2fcb35d', '7b8f48a0-837b-42b2-9e21-16851f4f5639', '54db73dc-5270-4b6c-9541-6b6c579c32e3', '98f33c59-d075-4577-9e4b-6217ffdfa40b'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:06:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-74170a4e-5227-4529-8bbd-a062b2eb47c8 tempest-CinderUnicodeTest-343011416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:06:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-74170a4e-5227-4529-8bbd-a062b2eb47c8 tempest-CinderUnicodeTest-343011416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:06:28 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-74170a4e-5227-4529-8bbd-a062b2eb47c8 tempest-CinderUnicodeTest-343011416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:06:28 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-74170a4e-5227-4529-8bbd-a062b2eb47c8 tempest-CinderUnicodeTest-343011416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:06:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-74170a4e-5227-4529-8bbd-a062b2eb47c8 tempest-CinderUnicodeTest-343011416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:06:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-74170a4e-5227-4529-8bbd-a062b2eb47c8 tempest-CinderUnicodeTest-343011416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:28 devstack sudo[105448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:06:28 devstack sudo[105448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:28 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-5c7739ab-4c1b-4c6f-8828-fd1739ae6b1d tempest-CinderUnicodeTest-343011416 None] Acquiring lock "cinder-5492d2b6-5ab7-4417-ab4f-ac290c31f41b-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:06:28 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-5c7739ab-4c1b-4c6f-8828-fd1739ae6b1d tempest-CinderUnicodeTest-343011416 None] Lock "cinder-5492d2b6-5ab7-4417-ab4f-ac290c31f41b-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:06:28 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-5c7739ab-4c1b-4c6f-8828-fd1739ae6b1d tempest-CinderUnicodeTest-343011416 None] Acquiring lock "cinder-quobyte-5492d2b6-5ab7-4417-ab4f-ac290c31f41b" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:06:28 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-5c7739ab-4c1b-4c6f-8828-fd1739ae6b1d tempest-CinderUnicodeTest-343011416 None] Lock "cinder-quobyte-5492d2b6-5ab7-4417-ab4f-ac290c31f41b" acquired by "delete_volume" :: waited 0.031s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:06:28 devstack sudo[105448]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-74170a4e-5227-4529-8bbd-a062b2eb47c8 tempest-CinderUnicodeTest-343011416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.483s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:28 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-74170a4e-5227-4529-8bbd-a062b2eb47c8 tempest-CinderUnicodeTest-343011416 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:06:28 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-74170a4e-5227-4529-8bbd-a062b2eb47c8 tempest-CinderUnicodeTest-343011416 None] Deleted volume successfully. Jul 30 17:06:28 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[672d5789-60cf-4a35-8033-b6e519ebbf00]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:06:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-5c7739ab-4c1b-4c6f-8828-fd1739ae6b1d tempest-CinderUnicodeTest-343011416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5492d2b6-5ab7-4417-ab4f-ac290c31f41b {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:29 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-74170a4e-5227-4529-8bbd-a062b2eb47c8 tempest-CinderUnicodeTest-343011416 None] Lock "cinder-7e51cee3-2b50-4e91-afcb-77a9fd3025f7-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:06:29 devstack sudo[105452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5492d2b6-5ab7-4417-ab4f-ac290c31f41b Jul 30 17:06:29 devstack sudo[105452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:29 devstack sudo[105452]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-5c7739ab-4c1b-4c6f-8828-fd1739ae6b1d tempest-CinderUnicodeTest-343011416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5492d2b6-5ab7-4417-ab4f-ac290c31f41b" returned: 0 in 0.417s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-5c7739ab-4c1b-4c6f-8828-fd1739ae6b1d tempest-CinderUnicodeTest-343011416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5492d2b6-5ab7-4417-ab4f-ac290c31f41b {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:29 devstack sudo[105458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5492d2b6-5ab7-4417-ab4f-ac290c31f41b Jul 30 17:06:29 devstack sudo[105458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:29 devstack sudo[105458]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-5c7739ab-4c1b-4c6f-8828-fd1739ae6b1d tempest-CinderUnicodeTest-343011416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5492d2b6-5ab7-4417-ab4f-ac290c31f41b" returned: 0 in 0.276s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:29 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-5c7739ab-4c1b-4c6f-8828-fd1739ae6b1d tempest-CinderUnicodeTest-343011416 None] Lock "cinder-quobyte-5492d2b6-5ab7-4417-ab4f-ac290c31f41b" released by "delete_volume" :: held 0.779s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:06:29 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-5c7739ab-4c1b-4c6f-8828-fd1739ae6b1d tempest-CinderUnicodeTest-343011416 None] Created reservations ['d79f285f-5cb4-4dc1-bd52-b6358d32ddac', '586b6266-8999-41d8-9f7f-6d20e1ec690b', '60b60340-6bc9-4c67-9f67-7d06b05ceb43', '57dfad71-9305-46f7-8adb-0898a0ac0572'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:06:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-5c7739ab-4c1b-4c6f-8828-fd1739ae6b1d tempest-CinderUnicodeTest-343011416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:06:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-5c7739ab-4c1b-4c6f-8828-fd1739ae6b1d tempest-CinderUnicodeTest-343011416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:06:29 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-5c7739ab-4c1b-4c6f-8828-fd1739ae6b1d tempest-CinderUnicodeTest-343011416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:06:29 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-5c7739ab-4c1b-4c6f-8828-fd1739ae6b1d tempest-CinderUnicodeTest-343011416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:06:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-5c7739ab-4c1b-4c6f-8828-fd1739ae6b1d tempest-CinderUnicodeTest-343011416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:06:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-5c7739ab-4c1b-4c6f-8828-fd1739ae6b1d tempest-CinderUnicodeTest-343011416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:29 devstack sudo[105461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:06:29 devstack sudo[105461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:30 devstack sudo[105461]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:30 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-5c7739ab-4c1b-4c6f-8828-fd1739ae6b1d tempest-CinderUnicodeTest-343011416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.274s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:30 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-5c7739ab-4c1b-4c6f-8828-fd1739ae6b1d tempest-CinderUnicodeTest-343011416 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:06:30 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-5c7739ab-4c1b-4c6f-8828-fd1739ae6b1d tempest-CinderUnicodeTest-343011416 None] Deleted volume successfully. Jul 30 17:06:30 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-5c7739ab-4c1b-4c6f-8828-fd1739ae6b1d tempest-CinderUnicodeTest-343011416 None] Lock "cinder-5492d2b6-5ab7-4417-ab4f-ac290c31f41b-delete_volume" released by "delete_volume" :: held 1.361s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:06:39 devstack cinder-volume[88568]: DEBUG dbcounter [-] [88568] Writing DB stats cinder:UPDATE=38,cinder:SELECT=22,cinder:DELETE=3,cinder:INSERT=8 {{(pid=88568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 17:06:40 devstack cinder-volume[88568]: DEBUG dbcounter [-] [88568] Writing DB stats cinder:SELECT=32,cinder:UPDATE=32,cinder:INSERT=9,cinder:DELETE=4 {{(pid=88568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 17:06:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-b22cb036-aa45-48ef-bcf9-415ba8ea741d req-20b185b2-4a1d-497d-ab20-72163aa452d3 tempest-TestServerVolumeAttachmentScenario-953339173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:06:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-b22cb036-aa45-48ef-bcf9-415ba8ea741d req-20b185b2-4a1d-497d-ab20-72163aa452d3 tempest-TestServerVolumeAttachmentScenario-953339173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:06:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-b22cb036-aa45-48ef-bcf9-415ba8ea741d req-20b185b2-4a1d-497d-ab20-72163aa452d3 tempest-TestServerVolumeAttachmentScenario-953339173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:06:50 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [req-b22cb036-aa45-48ef-bcf9-415ba8ea741d req-20b185b2-4a1d-497d-ab20-72163aa452d3 tempest-TestServerVolumeAttachmentScenario-953339173 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924', 'name': 'volume-fba3d2d6-74ef-4f23-a0bb-357cc10d7340', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cc9846fd-3229-4507-a887-5d7c0e48eba0', 'enforce_multipath': True} {{(pid=88568) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 17:06:50 devstack cinder-volume[88568]: INFO cinder.volume.manager [req-b22cb036-aa45-48ef-bcf9-415ba8ea741d req-20b185b2-4a1d-497d-ab20-72163aa452d3 tempest-TestServerVolumeAttachmentScenario-953339173 None] attachment_update completed successfully. Jul 30 17:06:52 devstack cinder-volume[88568]: DEBUG oslo_service.periodic_task [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 17:06:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:06:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:06:52 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:06:52 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:06:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:06:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:52 devstack sudo[105923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:06:52 devstack sudo[105923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:52 devstack sudo[105923]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.253s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:52 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:06:52 devstack cinder-volume[88568]: DEBUG oslo_service.periodic_task [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Running periodic task VolumeManager._thread_info {{(pid=88568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 17:06:52 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] thread count: 28 {{(pid=88568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 17:06:52 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] thread info: [<_MainThread(MainThread, started 127406866608256)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 17:06:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-6aeb05d1-0c80-4545-a39d-a6b0af67de8e req-9f770cf9-cc17-48d4-8f2b-1a0dd3efd704 tempest-TestServerVolumeAttachmentScenario-953339173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:06:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-6aeb05d1-0c80-4545-a39d-a6b0af67de8e req-9f770cf9-cc17-48d4-8f2b-1a0dd3efd704 tempest-TestServerVolumeAttachmentScenario-953339173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:06:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-6aeb05d1-0c80-4545-a39d-a6b0af67de8e req-9f770cf9-cc17-48d4-8f2b-1a0dd3efd704 tempest-TestServerVolumeAttachmentScenario-953339173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:06:54 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [req-6aeb05d1-0c80-4545-a39d-a6b0af67de8e req-9f770cf9-cc17-48d4-8f2b-1a0dd3efd704 tempest-TestServerVolumeAttachmentScenario-953339173 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924', 'name': 'volume-7a085605-c2a3-4106-8c53-7f1c2588676c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7423dbd9-02d9-4cda-8963-b6e2856cdbe7', 'enforce_multipath': True} {{(pid=88568) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 17:06:54 devstack cinder-volume[88568]: INFO cinder.volume.manager [req-6aeb05d1-0c80-4545-a39d-a6b0af67de8e req-9f770cf9-cc17-48d4-8f2b-1a0dd3efd704 tempest-TestServerVolumeAttachmentScenario-953339173 None] attachment_update completed successfully. Jul 30 17:06:56 devstack cinder-volume[88568]: INFO cinder.volume.manager [req-50f1ab07-a647-4afc-9e4a-e0c2a43bf6cc req-fc5a114f-3804-471e-8107-25a5335e07d8 tempest-TestServerVolumeAttachmentScenario-953339173 None] Terminate volume connection completed successfully. Jul 30 17:06:56 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [req-50f1ab07-a647-4afc-9e4a-e0c2a43bf6cc req-fc5a114f-3804-471e-8107-25a5335e07d8 tempest-TestServerVolumeAttachmentScenario-953339173 None] Deleting attachment 7423dbd9-02d9-4cda-8963-b6e2856cdbe7. {{(pid=88568) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 17:06:57 devstack cinder-volume[88568]: INFO cinder.volume.manager [req-7884c61e-4571-4669-82b6-994b765c118c req-8fc5a6a1-7a87-4258-938d-42c9907159e7 tempest-TestServerVolumeAttachmentScenario-953339173 None] Terminate volume connection completed successfully. Jul 30 17:06:57 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [req-7884c61e-4571-4669-82b6-994b765c118c req-8fc5a6a1-7a87-4258-938d-42c9907159e7 tempest-TestServerVolumeAttachmentScenario-953339173 None] Deleting attachment cc9846fd-3229-4507-a887-5d7c0e48eba0. {{(pid=88568) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 17:07:01 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-a493ad17-d1f7-4e35-849a-b8c037f03e1d tempest-TestServerVolumeAttachmentScenario-953339173 None] Acquiring lock "cinder-7a085605-c2a3-4106-8c53-7f1c2588676c-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:07:02 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-a493ad17-d1f7-4e35-849a-b8c037f03e1d tempest-TestServerVolumeAttachmentScenario-953339173 None] Lock "cinder-7a085605-c2a3-4106-8c53-7f1c2588676c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:07:02 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-a493ad17-d1f7-4e35-849a-b8c037f03e1d tempest-TestServerVolumeAttachmentScenario-953339173 None] Acquiring lock "cinder-quobyte-7a085605-c2a3-4106-8c53-7f1c2588676c" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:07:02 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-a493ad17-d1f7-4e35-849a-b8c037f03e1d tempest-TestServerVolumeAttachmentScenario-953339173 None] Lock "cinder-quobyte-7a085605-c2a3-4106-8c53-7f1c2588676c" acquired by "delete_volume" :: waited 0.013s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:07:02 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[128acabd-9dd1-46ae-aaff-c3620f6dd830]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:07:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a493ad17-d1f7-4e35-849a-b8c037f03e1d tempest-TestServerVolumeAttachmentScenario-953339173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7a085605-c2a3-4106-8c53-7f1c2588676c {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:07:02 devstack sudo[106005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7a085605-c2a3-4106-8c53-7f1c2588676c Jul 30 17:07:02 devstack sudo[106005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:07:02 devstack sudo[106005]: pam_unix(sudo:session): session closed for user root Jul 30 17:07:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a493ad17-d1f7-4e35-849a-b8c037f03e1d tempest-TestServerVolumeAttachmentScenario-953339173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7a085605-c2a3-4106-8c53-7f1c2588676c" returned: 0 in 0.356s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:07:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a493ad17-d1f7-4e35-849a-b8c037f03e1d tempest-TestServerVolumeAttachmentScenario-953339173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7a085605-c2a3-4106-8c53-7f1c2588676c {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:07:02 devstack sudo[106010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7a085605-c2a3-4106-8c53-7f1c2588676c Jul 30 17:07:02 devstack sudo[106010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:07:02 devstack sudo[106010]: pam_unix(sudo:session): session closed for user root Jul 30 17:07:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a493ad17-d1f7-4e35-849a-b8c037f03e1d tempest-TestServerVolumeAttachmentScenario-953339173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7a085605-c2a3-4106-8c53-7f1c2588676c" returned: 0 in 0.239s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:07:02 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-a493ad17-d1f7-4e35-849a-b8c037f03e1d tempest-TestServerVolumeAttachmentScenario-953339173 None] Lock "cinder-quobyte-7a085605-c2a3-4106-8c53-7f1c2588676c" released by "delete_volume" :: held 0.633s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:07:02 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-a493ad17-d1f7-4e35-849a-b8c037f03e1d tempest-TestServerVolumeAttachmentScenario-953339173 None] Created reservations ['efa1d0c4-4c8f-4fdc-bd4e-f8ec7b6c4fa2', 'd3672368-b5d0-434f-a3d0-81b685e93148', '2629cd5e-e823-4180-b81a-07ed8b6df66d', '6173e1d9-9273-46a6-a3b9-72a329c35ce2'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:07:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a493ad17-d1f7-4e35-849a-b8c037f03e1d tempest-TestServerVolumeAttachmentScenario-953339173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:07:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a493ad17-d1f7-4e35-849a-b8c037f03e1d tempest-TestServerVolumeAttachmentScenario-953339173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:07:02 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-a493ad17-d1f7-4e35-849a-b8c037f03e1d tempest-TestServerVolumeAttachmentScenario-953339173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:07:02 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-a493ad17-d1f7-4e35-849a-b8c037f03e1d tempest-TestServerVolumeAttachmentScenario-953339173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:07:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a493ad17-d1f7-4e35-849a-b8c037f03e1d tempest-TestServerVolumeAttachmentScenario-953339173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:07:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a493ad17-d1f7-4e35-849a-b8c037f03e1d tempest-TestServerVolumeAttachmentScenario-953339173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:07:02 devstack sudo[106013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:07:02 devstack sudo[106013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:07:03 devstack sudo[106013]: pam_unix(sudo:session): session closed for user root Jul 30 17:07:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a493ad17-d1f7-4e35-849a-b8c037f03e1d tempest-TestServerVolumeAttachmentScenario-953339173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.249s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:07:03 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-a493ad17-d1f7-4e35-849a-b8c037f03e1d tempest-TestServerVolumeAttachmentScenario-953339173 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:07:03 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-a493ad17-d1f7-4e35-849a-b8c037f03e1d tempest-TestServerVolumeAttachmentScenario-953339173 None] Deleted volume successfully. Jul 30 17:07:03 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-a493ad17-d1f7-4e35-849a-b8c037f03e1d tempest-TestServerVolumeAttachmentScenario-953339173 None] Lock "cinder-7a085605-c2a3-4106-8c53-7f1c2588676c-delete_volume" released by "delete_volume" :: held 1.090s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:07:03 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-82b84c36-9d39-4d86-888d-29f7039fa2f6 tempest-TestServerVolumeAttachmentScenario-953339173 None] Acquiring lock "cinder-fba3d2d6-74ef-4f23-a0bb-357cc10d7340-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:07:03 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-82b84c36-9d39-4d86-888d-29f7039fa2f6 tempest-TestServerVolumeAttachmentScenario-953339173 None] Lock "cinder-fba3d2d6-74ef-4f23-a0bb-357cc10d7340-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:07:03 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-82b84c36-9d39-4d86-888d-29f7039fa2f6 tempest-TestServerVolumeAttachmentScenario-953339173 None] Acquiring lock "cinder-quobyte-fba3d2d6-74ef-4f23-a0bb-357cc10d7340" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:07:03 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-82b84c36-9d39-4d86-888d-29f7039fa2f6 tempest-TestServerVolumeAttachmentScenario-953339173 None] Lock "cinder-quobyte-fba3d2d6-74ef-4f23-a0bb-357cc10d7340" acquired by "delete_volume" :: waited 0.016s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:07:03 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9640148-9c27-4c1d-ba9e-5797432afa3e]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:07:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-82b84c36-9d39-4d86-888d-29f7039fa2f6 tempest-TestServerVolumeAttachmentScenario-953339173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fba3d2d6-74ef-4f23-a0bb-357cc10d7340 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:07:03 devstack sudo[106016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fba3d2d6-74ef-4f23-a0bb-357cc10d7340 Jul 30 17:07:03 devstack sudo[106016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:07:03 devstack sudo[106016]: pam_unix(sudo:session): session closed for user root Jul 30 17:07:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-82b84c36-9d39-4d86-888d-29f7039fa2f6 tempest-TestServerVolumeAttachmentScenario-953339173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fba3d2d6-74ef-4f23-a0bb-357cc10d7340" returned: 0 in 0.343s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:07:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-82b84c36-9d39-4d86-888d-29f7039fa2f6 tempest-TestServerVolumeAttachmentScenario-953339173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fba3d2d6-74ef-4f23-a0bb-357cc10d7340 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:07:03 devstack sudo[106021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fba3d2d6-74ef-4f23-a0bb-357cc10d7340 Jul 30 17:07:03 devstack sudo[106021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:07:03 devstack sudo[106021]: pam_unix(sudo:session): session closed for user root Jul 30 17:07:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-82b84c36-9d39-4d86-888d-29f7039fa2f6 tempest-TestServerVolumeAttachmentScenario-953339173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fba3d2d6-74ef-4f23-a0bb-357cc10d7340" returned: 0 in 0.244s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:07:03 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-82b84c36-9d39-4d86-888d-29f7039fa2f6 tempest-TestServerVolumeAttachmentScenario-953339173 None] Lock "cinder-quobyte-fba3d2d6-74ef-4f23-a0bb-357cc10d7340" released by "delete_volume" :: held 0.624s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:07:03 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-82b84c36-9d39-4d86-888d-29f7039fa2f6 tempest-TestServerVolumeAttachmentScenario-953339173 None] Created reservations ['39a55a22-9580-4b5e-8277-fd64e78e0b46', '58890aae-caf3-4d0e-b0a4-68553aed80e7', 'c4b95ad2-89eb-4084-b6ad-8d2e55802e59', 'fb60c47c-1911-4e54-9606-598b3251917c'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:07:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-82b84c36-9d39-4d86-888d-29f7039fa2f6 tempest-TestServerVolumeAttachmentScenario-953339173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:07:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-82b84c36-9d39-4d86-888d-29f7039fa2f6 tempest-TestServerVolumeAttachmentScenario-953339173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:07:03 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-82b84c36-9d39-4d86-888d-29f7039fa2f6 tempest-TestServerVolumeAttachmentScenario-953339173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:07:03 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-82b84c36-9d39-4d86-888d-29f7039fa2f6 tempest-TestServerVolumeAttachmentScenario-953339173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:07:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-82b84c36-9d39-4d86-888d-29f7039fa2f6 tempest-TestServerVolumeAttachmentScenario-953339173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:07:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-82b84c36-9d39-4d86-888d-29f7039fa2f6 tempest-TestServerVolumeAttachmentScenario-953339173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:07:03 devstack sudo[106024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:07:03 devstack sudo[106024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:07:04 devstack sudo[106024]: pam_unix(sudo:session): session closed for user root Jul 30 17:07:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-82b84c36-9d39-4d86-888d-29f7039fa2f6 tempest-TestServerVolumeAttachmentScenario-953339173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.245s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:07:04 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-82b84c36-9d39-4d86-888d-29f7039fa2f6 tempest-TestServerVolumeAttachmentScenario-953339173 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:07:04 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-82b84c36-9d39-4d86-888d-29f7039fa2f6 tempest-TestServerVolumeAttachmentScenario-953339173 None] Deleted volume successfully. Jul 30 17:07:04 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-82b84c36-9d39-4d86-888d-29f7039fa2f6 tempest-TestServerVolumeAttachmentScenario-953339173 None] Lock "cinder-fba3d2d6-74ef-4f23-a0bb-357cc10d7340-delete_volume" released by "delete_volume" :: held 1.057s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:07:13 devstack cinder-volume[88568]: DEBUG dbcounter [-] [88568] Writing DB stats cinder:SELECT=26,cinder:UPDATE=19,cinder:INSERT=2,cinder:DELETE=1 {{(pid=88568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 17:07:14 devstack cinder-volume[88568]: DEBUG dbcounter [-] [88568] Writing DB stats cinder:SELECT=25,cinder:UPDATE=20,cinder:INSERT=6,cinder:DELETE=1 {{(pid=88568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 17:07:34 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-182327f1-4b11-4ebd-a0fe-51ee769a8ea9 tempest-TestShelveInstance-1270062730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:07:34 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-182327f1-4b11-4ebd-a0fe-51ee769a8ea9 tempest-TestShelveInstance-1270062730 None] Flow 'volume_create_manager' (2a519711-6ce1-48f4-9be9-eb2e27f24574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:07:34 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-182327f1-4b11-4ebd-a0fe-51ee769a8ea9 tempest-TestShelveInstance-1270062730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0b4aa0e-77ff-4987-b157-9db9ea06c5c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:07:34 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-182327f1-4b11-4ebd-a0fe-51ee769a8ea9 tempest-TestShelveInstance-1270062730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0b4aa0e-77ff-4987-b157-9db9ea06c5c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:07:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1831639031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3217060-6add-48fd-bdaa-1e50b2b44634,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='303307f622f04d5e8b6c3071e553aa72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:07:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:07:34Z,use_quota=True,user_id='27af47b47726440b9b9cfa7572bee7f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:07:34 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-182327f1-4b11-4ebd-a0fe-51ee769a8ea9 tempest-TestShelveInstance-1270062730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (677ec858-879d-4f01-adee-e6a603596ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:07:34 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-182327f1-4b11-4ebd-a0fe-51ee769a8ea9 tempest-TestShelveInstance-1270062730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (677ec858-879d-4f01-adee-e6a603596ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:07:34 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-182327f1-4b11-4ebd-a0fe-51ee769a8ea9 tempest-TestShelveInstance-1270062730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (707d4d08-4bb0-4ae1-ba66-faa7f5448d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:07:34 devstack cinder-volume[88568]: DEBUG cinder.image.glance [None req-182327f1-4b11-4ebd-a0fe-51ee769a8ea9 tempest-TestShelveInstance-1270062730 None] Creating Keystone auth plugin from conf {{(pid=88568) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 30 17:07:34 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-182327f1-4b11-4ebd-a0fe-51ee769a8ea9 tempest-TestShelveInstance-1270062730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (707d4d08-4bb0-4ae1-ba66-faa7f5448d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f3217060-6add-48fd-bdaa-1e50b2b44634', 'volume_name': 'volume-f3217060-6add-48fd-bdaa-1e50b2b44634', 'volume_size': 1, 'image_id': '6126230f-0fba-48b9-943c-1885f4fc4be0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6126230f-0fba-48b9-943c-1885f4fc4be0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2802aa975ace4011a130c68c7a9c96bb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6126230f-0fba-48b9-943c-1885f4fc4be0', 'created_at': datetime.datetime(2026, 7, 30, 14, 43, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 43, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6126230f-0fba-48b9-943c-1885f4fc4be0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:07:34 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-182327f1-4b11-4ebd-a0fe-51ee769a8ea9 tempest-TestShelveInstance-1270062730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6afa2a5-8ec9-414f-95ea-e56e61a06f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:07:34 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-182327f1-4b11-4ebd-a0fe-51ee769a8ea9 tempest-TestShelveInstance-1270062730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6afa2a5-8ec9-414f-95ea-e56e61a06f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:07:34 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-182327f1-4b11-4ebd-a0fe-51ee769a8ea9 tempest-TestShelveInstance-1270062730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a689e28-aa17-47f1-beea-aafc407c2ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:07:34 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-182327f1-4b11-4ebd-a0fe-51ee769a8ea9 tempest-TestShelveInstance-1270062730 None] Volume f3217060-6add-48fd-bdaa-1e50b2b44634: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f3217060-6add-48fd-bdaa-1e50b2b44634', 'volume_size': 1, 'image_id': '6126230f-0fba-48b9-943c-1885f4fc4be0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6126230f-0fba-48b9-943c-1885f4fc4be0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2802aa975ace4011a130c68c7a9c96bb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6126230f-0fba-48b9-943c-1885f4fc4be0', 'created_at': datetime.datetime(2026, 7, 30, 14, 43, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 43, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6126230f-0fba-48b9-943c-1885f4fc4be0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 30 17:07:34 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-182327f1-4b11-4ebd-a0fe-51ee769a8ea9 tempest-TestShelveInstance-1270062730 None] Trying to clone f3217060-6add-48fd-bdaa-1e50b2b44634 from image 6126230f-0fba-48b9-943c-1885f4fc4be0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6126230f-0fba-48b9-943c-1885f4fc4be0', 'metadata': {}}]). {{(pid=88568) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 30 17:07:34 devstack cinder-volume[88568]: DEBUG cinder.image.image_utils [None req-182327f1-4b11-4ebd-a0fe-51ee769a8ea9 tempest-TestShelveInstance-1270062730 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6126230f-0fba-48b9-943c-1885f4fc4be0_4gsd1n_0devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88568) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 30 17:07:34 devstack cinder-volume[88568]: INFO cinder.image.image_utils [None req-182327f1-4b11-4ebd-a0fe-51ee769a8ea9 tempest-TestShelveInstance-1270062730 None] Image download 20.69 MB at 20.69 MB/s Jul 30 17:07:34 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e344dd-1ccd-474e-bc77-6cbcd0bf4ec8]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:07:34 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-182327f1-4b11-4ebd-a0fe-51ee769a8ea9 tempest-TestShelveInstance-1270062730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6126230f-0fba-48b9-943c-1885f4fc4be0_4gsd1n_0devstack@QuobyteHD {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:07:34 devstack sudo[106042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6126230f-0fba-48b9-943c-1885f4fc4be0_4gsd1n_0devstack@QuobyteHD Jul 30 17:07:34 devstack sudo[106042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:07:35 devstack sudo[106042]: pam_unix(sudo:session): session closed for user root Jul 30 17:07:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-182327f1-4b11-4ebd-a0fe-51ee769a8ea9 tempest-TestShelveInstance-1270062730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6126230f-0fba-48b9-943c-1885f4fc4be0_4gsd1n_0devstack@QuobyteHD" returned: 0 in 0.336s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:07:35 devstack cinder-volume[88568]: DEBUG cinder.image.image_utils [None req-182327f1-4b11-4ebd-a0fe-51ee769a8ea9 tempest-TestShelveInstance-1270062730 None] Temporary image 6126230f-0fba-48b9-943c-1885f4fc4be0 is fetched for user 27af47b47726440b9b9cfa7572bee7f6. {{(pid=88568) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 30 17:07:35 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[04458cc7-60a8-41a4-b0f8-e27bd5b5d445]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:07:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-182327f1-4b11-4ebd-a0fe-51ee769a8ea9 tempest-TestShelveInstance-1270062730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6126230f-0fba-48b9-943c-1885f4fc4be0_4gsd1n_0devstack@QuobyteHD {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:07:35 devstack sudo[106048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6126230f-0fba-48b9-943c-1885f4fc4be0_4gsd1n_0devstack@QuobyteHD Jul 30 17:07:35 devstack sudo[106048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:07:35 devstack sudo[106048]: pam_unix(sudo:session): session closed for user root Jul 30 17:07:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-182327f1-4b11-4ebd-a0fe-51ee769a8ea9 tempest-TestShelveInstance-1270062730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6126230f-0fba-48b9-943c-1885f4fc4be0_4gsd1n_0devstack@QuobyteHD" returned: 0 in 0.314s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:07:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-182327f1-4b11-4ebd-a0fe-51ee769a8ea9 tempest-TestShelveInstance-1270062730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:07:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-182327f1-4b11-4ebd-a0fe-51ee769a8ea9 tempest-TestShelveInstance-1270062730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:07:35 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-182327f1-4b11-4ebd-a0fe-51ee769a8ea9 tempest-TestShelveInstance-1270062730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:07:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1831639031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3217060-6add-48fd-bdaa-1e50b2b44634,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='303307f622f04d5e8b6c3071e553aa72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:07:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:07:34Z,use_quota=True,user_id='27af47b47726440b9b9cfa7572bee7f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:07:35 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-182327f1-4b11-4ebd-a0fe-51ee769a8ea9 tempest-TestShelveInstance-1270062730 None] Creating volume f3217060-6add-48fd-bdaa-1e50b2b44634 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:07:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-182327f1-4b11-4ebd-a0fe-51ee769a8ea9 tempest-TestShelveInstance-1270062730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:07:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-182327f1-4b11-4ebd-a0fe-51ee769a8ea9 tempest-TestShelveInstance-1270062730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:07:35 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-182327f1-4b11-4ebd-a0fe-51ee769a8ea9 tempest-TestShelveInstance-1270062730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:07:35 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-182327f1-4b11-4ebd-a0fe-51ee769a8ea9 tempest-TestShelveInstance-1270062730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:07:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-182327f1-4b11-4ebd-a0fe-51ee769a8ea9 tempest-TestShelveInstance-1270062730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:07:35 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-182327f1-4b11-4ebd-a0fe-51ee769a8ea9 tempest-TestShelveInstance-1270062730 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:07:35 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-182327f1-4b11-4ebd-a0fe-51ee769a8ea9 tempest-TestShelveInstance-1270062730 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:07:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-182327f1-4b11-4ebd-a0fe-51ee769a8ea9 tempest-TestShelveInstance-1270062730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f3217060-6add-48fd-bdaa-1e50b2b44634 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:07:35 devstack sudo[106053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f3217060-6add-48fd-bdaa-1e50b2b44634 1073741824 Jul 30 17:07:35 devstack sudo[106053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:07:35 devstack sudo[106053]: pam_unix(sudo:session): session closed for user root Jul 30 17:07:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-182327f1-4b11-4ebd-a0fe-51ee769a8ea9 tempest-TestShelveInstance-1270062730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f3217060-6add-48fd-bdaa-1e50b2b44634 1073741824" returned: 0 in 0.387s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:07:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-182327f1-4b11-4ebd-a0fe-51ee769a8ea9 tempest-TestShelveInstance-1270062730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f3217060-6add-48fd-bdaa-1e50b2b44634 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:07:35 devstack sudo[106060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f3217060-6add-48fd-bdaa-1e50b2b44634 Jul 30 17:07:35 devstack sudo[106060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:07:36 devstack sudo[106060]: pam_unix(sudo:session): session closed for user root Jul 30 17:07:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-182327f1-4b11-4ebd-a0fe-51ee769a8ea9 tempest-TestShelveInstance-1270062730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f3217060-6add-48fd-bdaa-1e50b2b44634" returned: 0 in 0.240s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:07:36 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-182327f1-4b11-4ebd-a0fe-51ee769a8ea9 tempest-TestShelveInstance-1270062730 None] <== create_volume: return (669ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:07:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-182327f1-4b11-4ebd-a0fe-51ee769a8ea9 tempest-TestShelveInstance-1270062730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.671s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:07:36 devstack cinder-volume[88568]: DEBUG cinder.volume.volume_utils [None req-182327f1-4b11-4ebd-a0fe-51ee769a8ea9 tempest-TestShelveInstance-1270062730 None] Attempting download of 6126230f-0fba-48b9-943c-1885f4fc4be0 ((None, [{'url': 'file:///opt/stack/data/glance/images/6126230f-0fba-48b9-943c-1885f4fc4be0', 'metadata': {}}])) to volume f3217060-6add-48fd-bdaa-1e50b2b44634. {{(pid=88568) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 30 17:07:36 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b4d55ee-c4bf-40e6-ad69-050229e1288f]: (4, 'raw') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:07:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-182327f1-4b11-4ebd-a0fe-51ee769a8ea9 tempest-TestShelveInstance-1270062730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6126230f-0fba-48b9-943c-1885f4fc4be0_pewcnpl4 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:07:36 devstack sudo[106063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6126230f-0fba-48b9-943c-1885f4fc4be0_pewcnpl4 Jul 30 17:07:36 devstack sudo[106063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:07:36 devstack sudo[106063]: pam_unix(sudo:session): session closed for user root Jul 30 17:07:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-182327f1-4b11-4ebd-a0fe-51ee769a8ea9 tempest-TestShelveInstance-1270062730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6126230f-0fba-48b9-943c-1885f4fc4be0_pewcnpl4" returned: 0 in 0.324s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:07:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-182327f1-4b11-4ebd-a0fe-51ee769a8ea9 tempest-TestShelveInstance-1270062730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6126230f-0fba-48b9-943c-1885f4fc4be0_pewcnpl4 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:07:36 devstack sudo[106067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6126230f-0fba-48b9-943c-1885f4fc4be0_pewcnpl4 Jul 30 17:07:36 devstack sudo[106067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:07:36 devstack sudo[106067]: pam_unix(sudo:session): session closed for user root Jul 30 17:07:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-182327f1-4b11-4ebd-a0fe-51ee769a8ea9 tempest-TestShelveInstance-1270062730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6126230f-0fba-48b9-943c-1885f4fc4be0_pewcnpl4" returned: 1 in 0.321s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:07:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-182327f1-4b11-4ebd-a0fe-51ee769a8ea9 tempest-TestShelveInstance-1270062730 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6126230f-0fba-48b9-943c-1885f4fc4be0_pewcnpl4' failed. Not Retrying. {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 17:07:36 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c2e4a6-0311-4e38-9a3f-3aba81835edc]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:07:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-182327f1-4b11-4ebd-a0fe-51ee769a8ea9 tempest-TestShelveInstance-1270062730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6126230f-0fba-48b9-943c-1885f4fc4be0_4gsd1n_0devstack@QuobyteHD {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:07:36 devstack sudo[106071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6126230f-0fba-48b9-943c-1885f4fc4be0_4gsd1n_0devstack@QuobyteHD Jul 30 17:07:36 devstack sudo[106071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:07:37 devstack sudo[106071]: pam_unix(sudo:session): session closed for user root Jul 30 17:07:37 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-182327f1-4b11-4ebd-a0fe-51ee769a8ea9 tempest-TestShelveInstance-1270062730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6126230f-0fba-48b9-943c-1885f4fc4be0_4gsd1n_0devstack@QuobyteHD" returned: 0 in 0.314s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:07:37 devstack cinder-volume[88568]: DEBUG cinder.image.image_utils [None req-182327f1-4b11-4ebd-a0fe-51ee769a8ea9 tempest-TestShelveInstance-1270062730 None] 6126230f-0fba-48b9-943c-1885f4fc4be0 was qcow2, converting to qcow2 {{(pid=88568) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 30 17:07:37 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-182327f1-4b11-4ebd-a0fe-51ee769a8ea9 tempest-TestShelveInstance-1270062730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6126230f-0fba-48b9-943c-1885f4fc4be0_4gsd1n_0devstack@QuobyteHD /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f3217060-6add-48fd-bdaa-1e50b2b44634 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:07:37 devstack sudo[106076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6126230f-0fba-48b9-943c-1885f4fc4be0_4gsd1n_0devstack@QuobyteHD /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f3217060-6add-48fd-bdaa-1e50b2b44634 Jul 30 17:07:37 devstack sudo[106076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:07:38 devstack sudo[106076]: pam_unix(sudo:session): session closed for user root Jul 30 17:07:38 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-182327f1-4b11-4ebd-a0fe-51ee769a8ea9 tempest-TestShelveInstance-1270062730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6126230f-0fba-48b9-943c-1885f4fc4be0_4gsd1n_0devstack@QuobyteHD /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f3217060-6add-48fd-bdaa-1e50b2b44634" returned: 0 in 1.497s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:07:38 devstack cinder-volume[88568]: DEBUG cinder.image.image_utils [None req-182327f1-4b11-4ebd-a0fe-51ee769a8ea9 tempest-TestShelveInstance-1270062730 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6126230f-0fba-48b9-943c-1885f4fc4be0_4gsd1n_0devstack@QuobyteHD, size 112.00 MB, duration 1.50 sec, destination /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f3217060-6add-48fd-bdaa-1e50b2b44634 {{(pid=88568) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 17:07:38 devstack cinder-volume[88568]: INFO cinder.image.image_utils [None req-182327f1-4b11-4ebd-a0fe-51ee769a8ea9 tempest-TestShelveInstance-1270062730 None] Converted 112.00 MB image at 74.76 MB/s Jul 30 17:07:38 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-182327f1-4b11-4ebd-a0fe-51ee769a8ea9 tempest-TestShelveInstance-1270062730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f3217060-6add-48fd-bdaa-1e50b2b44634 1G {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:07:38 devstack sudo[106087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f3217060-6add-48fd-bdaa-1e50b2b44634 1G Jul 30 17:07:38 devstack sudo[106087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:07:38 devstack sudo[106087]: pam_unix(sudo:session): session closed for user root Jul 30 17:07:38 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-182327f1-4b11-4ebd-a0fe-51ee769a8ea9 tempest-TestShelveInstance-1270062730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f3217060-6add-48fd-bdaa-1e50b2b44634 1G" returned: 0 in 0.337s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:07:38 devstack cinder-volume[88568]: DEBUG cinder.volume.volume_utils [None req-182327f1-4b11-4ebd-a0fe-51ee769a8ea9 tempest-TestShelveInstance-1270062730 None] Downloaded image 6126230f-0fba-48b9-943c-1885f4fc4be0 ((None, [{'url': 'file:///opt/stack/data/glance/images/6126230f-0fba-48b9-943c-1885f4fc4be0', 'metadata': {}}])) to volume f3217060-6add-48fd-bdaa-1e50b2b44634 successfully. {{(pid=88568) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 30 17:07:38 devstack cinder-volume[88568]: DEBUG cinder.image.image_utils [None req-182327f1-4b11-4ebd-a0fe-51ee769a8ea9 tempest-TestShelveInstance-1270062730 None] Temporary image 6126230f-0fba-48b9-943c-1885f4fc4be0 for user 27af47b47726440b9b9cfa7572bee7f6 is deleted. {{(pid=88568) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 30 17:07:38 devstack cinder-volume[88568]: DEBUG cinder.volume.volume_utils [None req-182327f1-4b11-4ebd-a0fe-51ee769a8ea9 tempest-TestShelveInstance-1270062730 None] Marking volume f3217060-6add-48fd-bdaa-1e50b2b44634 as bootable. {{(pid=88568) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 30 17:07:39 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-182327f1-4b11-4ebd-a0fe-51ee769a8ea9 tempest-TestShelveInstance-1270062730 None] Copying metadata from image 6126230f-0fba-48b9-943c-1885f4fc4be0 to f3217060-6add-48fd-bdaa-1e50b2b44634. {{(pid=88568) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 30 17:07:39 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-182327f1-4b11-4ebd-a0fe-51ee769a8ea9 tempest-TestShelveInstance-1270062730 None] Creating volume glance metadata for volume f3217060-6add-48fd-bdaa-1e50b2b44634 backed by image 6126230f-0fba-48b9-943c-1885f4fc4be0 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6126230f-0fba-48b9-943c-1885f4fc4be0', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88568) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 30 17:07:39 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-182327f1-4b11-4ebd-a0fe-51ee769a8ea9 tempest-TestShelveInstance-1270062730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a689e28-aa17-47f1-beea-aafc407c2ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3217060-6add-48fd-bdaa-1e50b2b44634', 'volume_size': 1, 'image_id': '6126230f-0fba-48b9-943c-1885f4fc4be0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6126230f-0fba-48b9-943c-1885f4fc4be0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2802aa975ace4011a130c68c7a9c96bb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6126230f-0fba-48b9-943c-1885f4fc4be0', 'created_at': datetime.datetime(2026, 7, 30, 14, 43, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 43, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6126230f-0fba-48b9-943c-1885f4fc4be0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:07:39 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-182327f1-4b11-4ebd-a0fe-51ee769a8ea9 tempest-TestShelveInstance-1270062730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f34b4d2-c820-4c80-b83f-e3254e3dd034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:07:39 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-182327f1-4b11-4ebd-a0fe-51ee769a8ea9 tempest-TestShelveInstance-1270062730 None] Volume volume-f3217060-6add-48fd-bdaa-1e50b2b44634 (f3217060-6add-48fd-bdaa-1e50b2b44634): created successfully Jul 30 17:07:39 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-182327f1-4b11-4ebd-a0fe-51ee769a8ea9 tempest-TestShelveInstance-1270062730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f34b4d2-c820-4c80-b83f-e3254e3dd034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:07:39 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-182327f1-4b11-4ebd-a0fe-51ee769a8ea9 tempest-TestShelveInstance-1270062730 None] Flow 'volume_create_manager' (2a519711-6ce1-48f4-9be9-eb2e27f24574) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:07:39 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-182327f1-4b11-4ebd-a0fe-51ee769a8ea9 tempest-TestShelveInstance-1270062730 None] Created volume successfully. Jul 30 17:07:41 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-96fce90e-fa4b-444b-920b-62dba32780a8 req-6d3f9c54-e9dc-4ff1-ab4a-deb4884e3216 tempest-TestShelveInstance-1270062730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:07:41 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-96fce90e-fa4b-444b-920b-62dba32780a8 req-6d3f9c54-e9dc-4ff1-ab4a-deb4884e3216 tempest-TestShelveInstance-1270062730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:07:41 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-96fce90e-fa4b-444b-920b-62dba32780a8 req-6d3f9c54-e9dc-4ff1-ab4a-deb4884e3216 tempest-TestShelveInstance-1270062730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:07:41 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [req-96fce90e-fa4b-444b-920b-62dba32780a8 req-6d3f9c54-e9dc-4ff1-ab4a-deb4884e3216 tempest-TestShelveInstance-1270062730 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924', 'name': 'volume-f3217060-6add-48fd-bdaa-1e50b2b44634', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '088a2314-d8d5-4ee9-a488-8c1f04f51fd1', 'enforce_multipath': True} {{(pid=88568) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 17:07:41 devstack cinder-volume[88568]: INFO cinder.volume.manager [req-96fce90e-fa4b-444b-920b-62dba32780a8 req-6d3f9c54-e9dc-4ff1-ab4a-deb4884e3216 tempest-TestShelveInstance-1270062730 None] attachment_update completed successfully. Jul 30 17:07:51 devstack cinder-volume[88568]: DEBUG dbcounter [-] [88568] Writing DB stats cinder:SELECT=13,cinder:INSERT=8,cinder:UPDATE=6 {{(pid=88568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 17:07:51 devstack cinder-volume[88568]: DEBUG dbcounter [-] [88568] Writing DB stats cinder:SELECT=19,cinder:UPDATE=6,cinder:INSERT=6,cinder:DELETE=1 {{(pid=88568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 17:07:52 devstack cinder-volume[88568]: DEBUG oslo_service.periodic_task [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 17:07:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:07:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:07:52 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:07:52 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:07:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:07:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:07:52 devstack sudo[106608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:07:52 devstack sudo[106608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:07:52 devstack sudo[106608]: pam_unix(sudo:session): session closed for user root Jul 30 17:07:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.242s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:07:52 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:07:52 devstack cinder-volume[88568]: DEBUG oslo_service.periodic_task [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Running periodic task VolumeManager._thread_info {{(pid=88568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 17:07:52 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] thread count: 28 {{(pid=88568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 17:07:52 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] thread info: [<_MainThread(MainThread, started 127406866608256)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 17:08:12 devstack cinder-volume[88568]: INFO cinder.volume.manager [req-68dae419-af13-4f1a-942c-6955af265d84 req-5d5fce00-1687-4f0c-8675-ae6c40a9fb63 tempest-TestShelveInstance-1270062730 None] Terminate volume connection completed successfully. Jul 30 17:08:12 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [req-68dae419-af13-4f1a-942c-6955af265d84 req-5d5fce00-1687-4f0c-8675-ae6c40a9fb63 tempest-TestShelveInstance-1270062730 None] Deleting attachment 088a2314-d8d5-4ee9-a488-8c1f04f51fd1. {{(pid=88568) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 17:08:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-8932f7b7-d5bd-45f4-9435-134fd09c7ab8 req-3149e2e9-9578-4f21-a1b9-8ccee6d14fdb tempest-TestShelveInstance-1270062730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:08:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-8932f7b7-d5bd-45f4-9435-134fd09c7ab8 req-3149e2e9-9578-4f21-a1b9-8ccee6d14fdb tempest-TestShelveInstance-1270062730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:08:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-8932f7b7-d5bd-45f4-9435-134fd09c7ab8 req-3149e2e9-9578-4f21-a1b9-8ccee6d14fdb tempest-TestShelveInstance-1270062730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:08:14 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [req-8932f7b7-d5bd-45f4-9435-134fd09c7ab8 req-3149e2e9-9578-4f21-a1b9-8ccee6d14fdb tempest-TestShelveInstance-1270062730 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924', 'name': 'volume-f3217060-6add-48fd-bdaa-1e50b2b44634', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b5f55835-68fe-46a0-92c1-fb8b8384553b', 'enforce_multipath': True} {{(pid=88568) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 17:08:14 devstack cinder-volume[88568]: INFO cinder.volume.manager [req-8932f7b7-d5bd-45f4-9435-134fd09c7ab8 req-3149e2e9-9578-4f21-a1b9-8ccee6d14fdb tempest-TestShelveInstance-1270062730 None] attachment_update completed successfully. Jul 30 17:08:24 devstack cinder-volume[88568]: DEBUG dbcounter [-] [88568] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=88568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 17:08:24 devstack cinder-volume[88568]: DEBUG dbcounter [-] [88568] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=88568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 17:08:44 devstack cinder-volume[88568]: INFO cinder.volume.manager [req-59d7dbee-fa38-4c3e-935e-4c3834814888 req-319318a2-8046-4176-99fc-3a2de51c1db2 tempest-TestShelveInstance-1270062730 None] Terminate volume connection completed successfully. Jul 30 17:08:44 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [req-59d7dbee-fa38-4c3e-935e-4c3834814888 req-319318a2-8046-4176-99fc-3a2de51c1db2 tempest-TestShelveInstance-1270062730 None] Deleting attachment b5f55835-68fe-46a0-92c1-fb8b8384553b. {{(pid=88568) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 17:08:44 devstack cinder-volume[88568]: DEBUG cinder.coordination [req-59d7dbee-fa38-4c3e-935e-4c3834814888 req-ba3aeb66-09d1-498a-a96e-7fd8e7d56212 tempest-TestShelveInstance-1270062730 None] Acquiring lock "cinder-f3217060-6add-48fd-bdaa-1e50b2b44634-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:08:44 devstack cinder-volume[88568]: DEBUG cinder.coordination [req-59d7dbee-fa38-4c3e-935e-4c3834814888 req-ba3aeb66-09d1-498a-a96e-7fd8e7d56212 tempest-TestShelveInstance-1270062730 None] Lock "cinder-f3217060-6add-48fd-bdaa-1e50b2b44634-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:08:44 devstack cinder-volume[88568]: DEBUG cinder.coordination [req-59d7dbee-fa38-4c3e-935e-4c3834814888 req-ba3aeb66-09d1-498a-a96e-7fd8e7d56212 tempest-TestShelveInstance-1270062730 None] Acquiring lock "cinder-quobyte-f3217060-6add-48fd-bdaa-1e50b2b44634" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:08:44 devstack cinder-volume[88568]: DEBUG cinder.coordination [req-59d7dbee-fa38-4c3e-935e-4c3834814888 req-ba3aeb66-09d1-498a-a96e-7fd8e7d56212 tempest-TestShelveInstance-1270062730 None] Lock "cinder-quobyte-f3217060-6add-48fd-bdaa-1e50b2b44634" acquired by "delete_volume" :: waited 0.019s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:08:44 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec718a2f-3cd1-4198-b2e4-e0e1f8f2ba5b]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:08:44 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [req-59d7dbee-fa38-4c3e-935e-4c3834814888 req-ba3aeb66-09d1-498a-a96e-7fd8e7d56212 tempest-TestShelveInstance-1270062730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f3217060-6add-48fd-bdaa-1e50b2b44634 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:44 devstack sudo[107267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f3217060-6add-48fd-bdaa-1e50b2b44634 Jul 30 17:08:44 devstack sudo[107267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:45 devstack sudo[107267]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:45 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [req-59d7dbee-fa38-4c3e-935e-4c3834814888 req-ba3aeb66-09d1-498a-a96e-7fd8e7d56212 tempest-TestShelveInstance-1270062730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f3217060-6add-48fd-bdaa-1e50b2b44634" returned: 0 in 0.381s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:45 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [req-59d7dbee-fa38-4c3e-935e-4c3834814888 req-ba3aeb66-09d1-498a-a96e-7fd8e7d56212 tempest-TestShelveInstance-1270062730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f3217060-6add-48fd-bdaa-1e50b2b44634 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:45 devstack sudo[107273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f3217060-6add-48fd-bdaa-1e50b2b44634 Jul 30 17:08:45 devstack sudo[107273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:45 devstack sudo[107273]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:45 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [req-59d7dbee-fa38-4c3e-935e-4c3834814888 req-ba3aeb66-09d1-498a-a96e-7fd8e7d56212 tempest-TestShelveInstance-1270062730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f3217060-6add-48fd-bdaa-1e50b2b44634" returned: 0 in 0.237s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:45 devstack cinder-volume[88568]: DEBUG cinder.coordination [req-59d7dbee-fa38-4c3e-935e-4c3834814888 req-ba3aeb66-09d1-498a-a96e-7fd8e7d56212 tempest-TestShelveInstance-1270062730 None] Lock "cinder-quobyte-f3217060-6add-48fd-bdaa-1e50b2b44634" released by "delete_volume" :: held 0.663s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:08:45 devstack cinder-volume[88568]: DEBUG cinder.quota [req-59d7dbee-fa38-4c3e-935e-4c3834814888 req-ba3aeb66-09d1-498a-a96e-7fd8e7d56212 tempest-TestShelveInstance-1270062730 None] Created reservations ['653cc001-71b2-462b-bb2d-b304326b6371', '7b8554df-2162-4f6e-b45c-49b3efc7d427', '24922408-4944-49db-b1c6-484b16757b80', 'ea5e9ce1-2b32-4d78-be7d-b8ae6b253e1e'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:08:45 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-59d7dbee-fa38-4c3e-935e-4c3834814888 req-ba3aeb66-09d1-498a-a96e-7fd8e7d56212 tempest-TestShelveInstance-1270062730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:08:45 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-59d7dbee-fa38-4c3e-935e-4c3834814888 req-ba3aeb66-09d1-498a-a96e-7fd8e7d56212 tempest-TestShelveInstance-1270062730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:08:45 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [req-59d7dbee-fa38-4c3e-935e-4c3834814888 req-ba3aeb66-09d1-498a-a96e-7fd8e7d56212 tempest-TestShelveInstance-1270062730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:08:45 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [req-59d7dbee-fa38-4c3e-935e-4c3834814888 req-ba3aeb66-09d1-498a-a96e-7fd8e7d56212 tempest-TestShelveInstance-1270062730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:08:45 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [req-59d7dbee-fa38-4c3e-935e-4c3834814888 req-ba3aeb66-09d1-498a-a96e-7fd8e7d56212 tempest-TestShelveInstance-1270062730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:08:45 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [req-59d7dbee-fa38-4c3e-935e-4c3834814888 req-ba3aeb66-09d1-498a-a96e-7fd8e7d56212 tempest-TestShelveInstance-1270062730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:45 devstack sudo[107276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:08:45 devstack sudo[107276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:45 devstack sudo[107276]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:45 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [req-59d7dbee-fa38-4c3e-935e-4c3834814888 req-ba3aeb66-09d1-498a-a96e-7fd8e7d56212 tempest-TestShelveInstance-1270062730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.266s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:45 devstack cinder-volume[88568]: DEBUG cinder.manager [req-59d7dbee-fa38-4c3e-935e-4c3834814888 req-ba3aeb66-09d1-498a-a96e-7fd8e7d56212 tempest-TestShelveInstance-1270062730 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:08:45 devstack cinder-volume[88568]: INFO cinder.volume.manager [req-59d7dbee-fa38-4c3e-935e-4c3834814888 req-ba3aeb66-09d1-498a-a96e-7fd8e7d56212 tempest-TestShelveInstance-1270062730 None] Deleted volume successfully. Jul 30 17:08:45 devstack cinder-volume[88568]: DEBUG cinder.coordination [req-59d7dbee-fa38-4c3e-935e-4c3834814888 req-ba3aeb66-09d1-498a-a96e-7fd8e7d56212 tempest-TestShelveInstance-1270062730 None] Lock "cinder-f3217060-6add-48fd-bdaa-1e50b2b44634-delete_volume" released by "delete_volume" :: held 1.142s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:08:52 devstack cinder-volume[88568]: DEBUG oslo_service.periodic_task [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 17:08:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:08:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:08:52 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:08:52 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:08:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:08:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:52 devstack sudo[107289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:08:52 devstack sudo[107289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:52 devstack sudo[107289]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.284s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:52 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:08:52 devstack cinder-volume[88568]: DEBUG oslo_service.periodic_task [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Running periodic task VolumeManager._thread_info {{(pid=88568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 17:08:52 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] thread count: 28 {{(pid=88568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 17:08:52 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] thread info: [<_MainThread(MainThread, started 127406866608256)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 17:08:55 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-edfac99e-20f7-48a2-b0b4-6ae1981c9ba8 tempest-CreateVolumesFromImageTest-1183687806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:08:55 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-edfac99e-20f7-48a2-b0b4-6ae1981c9ba8 tempest-CreateVolumesFromImageTest-1183687806 None] Flow 'volume_create_manager' (24516b89-d094-4f44-bf6a-2e67b344d76c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:08:55 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-edfac99e-20f7-48a2-b0b4-6ae1981c9ba8 tempest-CreateVolumesFromImageTest-1183687806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b074242-4359-4dbf-b112-6b1950318165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:55 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-edfac99e-20f7-48a2-b0b4-6ae1981c9ba8 tempest-CreateVolumesFromImageTest-1183687806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b074242-4359-4dbf-b112-6b1950318165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1355036877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d00ad682-e9f0-4b58-a036-226c7f0d40e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ec94787266a421bbf14792cec9c84ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:08:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:08:56Z,use_quota=True,user_id='36960985b04c44e5ad3ff5aefd9017aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:55 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-edfac99e-20f7-48a2-b0b4-6ae1981c9ba8 tempest-CreateVolumesFromImageTest-1183687806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92f3512b-48b8-44ca-a84e-e7656e7a121e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:55 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-edfac99e-20f7-48a2-b0b4-6ae1981c9ba8 tempest-CreateVolumesFromImageTest-1183687806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92f3512b-48b8-44ca-a84e-e7656e7a121e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:55 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-edfac99e-20f7-48a2-b0b4-6ae1981c9ba8 tempest-CreateVolumesFromImageTest-1183687806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d5273a9-cc70-485c-9e18-10ddef1c3bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:55 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-edfac99e-20f7-48a2-b0b4-6ae1981c9ba8 tempest-CreateVolumesFromImageTest-1183687806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d5273a9-cc70-485c-9e18-10ddef1c3bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd00ad682-e9f0-4b58-a036-226c7f0d40e2', 'volume_name': 'volume-d00ad682-e9f0-4b58-a036-226c7f0d40e2', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:56 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-edfac99e-20f7-48a2-b0b4-6ae1981c9ba8 tempest-CreateVolumesFromImageTest-1183687806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0509d239-b771-4ddc-986a-831bfeaf314e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:56 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-edfac99e-20f7-48a2-b0b4-6ae1981c9ba8 tempest-CreateVolumesFromImageTest-1183687806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0509d239-b771-4ddc-986a-831bfeaf314e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:56 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-edfac99e-20f7-48a2-b0b4-6ae1981c9ba8 tempest-CreateVolumesFromImageTest-1183687806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff881302-0ed1-4eaa-a9ac-4b24ca080a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:56 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-edfac99e-20f7-48a2-b0b4-6ae1981c9ba8 tempest-CreateVolumesFromImageTest-1183687806 None] Volume d00ad682-e9f0-4b58-a036-226c7f0d40e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d00ad682-e9f0-4b58-a036-226c7f0d40e2', 'volume_size': 1} Jul 30 17:08:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-edfac99e-20f7-48a2-b0b4-6ae1981c9ba8 tempest-CreateVolumesFromImageTest-1183687806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:08:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-edfac99e-20f7-48a2-b0b4-6ae1981c9ba8 tempest-CreateVolumesFromImageTest-1183687806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:08:56 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-edfac99e-20f7-48a2-b0b4-6ae1981c9ba8 tempest-CreateVolumesFromImageTest-1183687806 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1355036877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d00ad682-e9f0-4b58-a036-226c7f0d40e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ec94787266a421bbf14792cec9c84ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:08:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:08:56Z,use_quota=True,user_id='36960985b04c44e5ad3ff5aefd9017aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:08:56 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-edfac99e-20f7-48a2-b0b4-6ae1981c9ba8 tempest-CreateVolumesFromImageTest-1183687806 None] Creating volume d00ad682-e9f0-4b58-a036-226c7f0d40e2 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:08:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-edfac99e-20f7-48a2-b0b4-6ae1981c9ba8 tempest-CreateVolumesFromImageTest-1183687806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:08:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-edfac99e-20f7-48a2-b0b4-6ae1981c9ba8 tempest-CreateVolumesFromImageTest-1183687806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:08:56 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-edfac99e-20f7-48a2-b0b4-6ae1981c9ba8 tempest-CreateVolumesFromImageTest-1183687806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:08:56 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-edfac99e-20f7-48a2-b0b4-6ae1981c9ba8 tempest-CreateVolumesFromImageTest-1183687806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:08:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-edfac99e-20f7-48a2-b0b4-6ae1981c9ba8 tempest-CreateVolumesFromImageTest-1183687806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:08:56 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-edfac99e-20f7-48a2-b0b4-6ae1981c9ba8 tempest-CreateVolumesFromImageTest-1183687806 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:08:56 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-edfac99e-20f7-48a2-b0b4-6ae1981c9ba8 tempest-CreateVolumesFromImageTest-1183687806 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:08:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-edfac99e-20f7-48a2-b0b4-6ae1981c9ba8 tempest-CreateVolumesFromImageTest-1183687806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d00ad682-e9f0-4b58-a036-226c7f0d40e2 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:56 devstack sudo[107293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d00ad682-e9f0-4b58-a036-226c7f0d40e2 1073741824 Jul 30 17:08:56 devstack sudo[107293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:56 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-6368290b-7d86-45d5-b72d-b04a53e190b4 tempest-CreateVolumesFromImageTest-1183687806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:08:56 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-6368290b-7d86-45d5-b72d-b04a53e190b4 tempest-CreateVolumesFromImageTest-1183687806 None] Flow 'volume_create_manager' (67df9a47-0540-46d6-974d-27b088fa5f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:08:56 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-6368290b-7d86-45d5-b72d-b04a53e190b4 tempest-CreateVolumesFromImageTest-1183687806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3d9cfaf-b73a-481d-9ec6-c4dd40f48ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:56 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-6368290b-7d86-45d5-b72d-b04a53e190b4 tempest-CreateVolumesFromImageTest-1183687806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3d9cfaf-b73a-481d-9ec6-c4dd40f48ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1369040709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05a34f2e-a465-49e4-bb2c-51d8e9d315fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ec94787266a421bbf14792cec9c84ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:08:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:08:56Z,use_quota=True,user_id='36960985b04c44e5ad3ff5aefd9017aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:56 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-6368290b-7d86-45d5-b72d-b04a53e190b4 tempest-CreateVolumesFromImageTest-1183687806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82be21df-6160-4ecf-9301-8d77d7f45acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:56 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-6368290b-7d86-45d5-b72d-b04a53e190b4 tempest-CreateVolumesFromImageTest-1183687806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82be21df-6160-4ecf-9301-8d77d7f45acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:56 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-6368290b-7d86-45d5-b72d-b04a53e190b4 tempest-CreateVolumesFromImageTest-1183687806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d9cc5b5-d16d-40e9-a3c4-6cfd75aa530d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:56 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-6368290b-7d86-45d5-b72d-b04a53e190b4 tempest-CreateVolumesFromImageTest-1183687806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d9cc5b5-d16d-40e9-a3c4-6cfd75aa530d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05a34f2e-a465-49e4-bb2c-51d8e9d315fe', 'volume_name': 'volume-05a34f2e-a465-49e4-bb2c-51d8e9d315fe', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:56 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-6368290b-7d86-45d5-b72d-b04a53e190b4 tempest-CreateVolumesFromImageTest-1183687806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abab45c1-b9c6-4d4b-8912-689dd52f03d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:56 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-6368290b-7d86-45d5-b72d-b04a53e190b4 tempest-CreateVolumesFromImageTest-1183687806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abab45c1-b9c6-4d4b-8912-689dd52f03d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:56 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-6368290b-7d86-45d5-b72d-b04a53e190b4 tempest-CreateVolumesFromImageTest-1183687806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9028ce4f-296f-4e9c-b774-480259cdad6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:56 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-6368290b-7d86-45d5-b72d-b04a53e190b4 tempest-CreateVolumesFromImageTest-1183687806 None] Volume 05a34f2e-a465-49e4-bb2c-51d8e9d315fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05a34f2e-a465-49e4-bb2c-51d8e9d315fe', 'volume_size': 1} Jul 30 17:08:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-6368290b-7d86-45d5-b72d-b04a53e190b4 tempest-CreateVolumesFromImageTest-1183687806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:08:56 devstack sudo[107293]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-edfac99e-20f7-48a2-b0b4-6ae1981c9ba8 tempest-CreateVolumesFromImageTest-1183687806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d00ad682-e9f0-4b58-a036-226c7f0d40e2 1073741824" returned: 0 in 0.537s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-edfac99e-20f7-48a2-b0b4-6ae1981c9ba8 tempest-CreateVolumesFromImageTest-1183687806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d00ad682-e9f0-4b58-a036-226c7f0d40e2 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:56 devstack sudo[107299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d00ad682-e9f0-4b58-a036-226c7f0d40e2 Jul 30 17:08:56 devstack sudo[107299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:56 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-623e98aa-9047-4031-9cf3-2514693102dc tempest-CreateVolumesFromImageTest-1183687806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:08:56 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-623e98aa-9047-4031-9cf3-2514693102dc tempest-CreateVolumesFromImageTest-1183687806 None] Flow 'volume_create_manager' (17cbff84-ce57-4a44-ba62-6bc6648d2e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:08:56 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-623e98aa-9047-4031-9cf3-2514693102dc tempest-CreateVolumesFromImageTest-1183687806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8690f3d-22b3-412b-89e4-9b81feecca08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:56 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-623e98aa-9047-4031-9cf3-2514693102dc tempest-CreateVolumesFromImageTest-1183687806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8690f3d-22b3-412b-89e4-9b81feecca08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1496107258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=379ac367-357c-402f-9bd9-c3b752244875,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ec94787266a421bbf14792cec9c84ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:08:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:08:57Z,use_quota=True,user_id='36960985b04c44e5ad3ff5aefd9017aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:56 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-623e98aa-9047-4031-9cf3-2514693102dc tempest-CreateVolumesFromImageTest-1183687806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bf54ebe-42b1-4ec7-9b07-9455cf0d1f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:56 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-623e98aa-9047-4031-9cf3-2514693102dc tempest-CreateVolumesFromImageTest-1183687806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bf54ebe-42b1-4ec7-9b07-9455cf0d1f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:56 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-623e98aa-9047-4031-9cf3-2514693102dc tempest-CreateVolumesFromImageTest-1183687806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (489cfa55-2405-4b38-ab09-4e76d33c6681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:56 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-623e98aa-9047-4031-9cf3-2514693102dc tempest-CreateVolumesFromImageTest-1183687806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (489cfa55-2405-4b38-ab09-4e76d33c6681) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '379ac367-357c-402f-9bd9-c3b752244875', 'volume_name': 'volume-379ac367-357c-402f-9bd9-c3b752244875', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:56 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-623e98aa-9047-4031-9cf3-2514693102dc tempest-CreateVolumesFromImageTest-1183687806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ad2f1ab-de68-4bc7-bfae-30a592eb72bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:56 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-623e98aa-9047-4031-9cf3-2514693102dc tempest-CreateVolumesFromImageTest-1183687806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ad2f1ab-de68-4bc7-bfae-30a592eb72bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:56 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-623e98aa-9047-4031-9cf3-2514693102dc tempest-CreateVolumesFromImageTest-1183687806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e38689e-148c-4832-aa0a-77aed6f3b399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:56 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-623e98aa-9047-4031-9cf3-2514693102dc tempest-CreateVolumesFromImageTest-1183687806 None] Volume 379ac367-357c-402f-9bd9-c3b752244875: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-379ac367-357c-402f-9bd9-c3b752244875', 'volume_size': 1} Jul 30 17:08:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-623e98aa-9047-4031-9cf3-2514693102dc tempest-CreateVolumesFromImageTest-1183687806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:08:56 devstack sudo[107299]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-edfac99e-20f7-48a2-b0b4-6ae1981c9ba8 tempest-CreateVolumesFromImageTest-1183687806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d00ad682-e9f0-4b58-a036-226c7f0d40e2" returned: 0 in 0.278s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:56 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-edfac99e-20f7-48a2-b0b4-6ae1981c9ba8 tempest-CreateVolumesFromImageTest-1183687806 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:08:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-edfac99e-20f7-48a2-b0b4-6ae1981c9ba8 tempest-CreateVolumesFromImageTest-1183687806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:08:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-6368290b-7d86-45d5-b72d-b04a53e190b4 tempest-CreateVolumesFromImageTest-1183687806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.459s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:08:56 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-6368290b-7d86-45d5-b72d-b04a53e190b4 tempest-CreateVolumesFromImageTest-1183687806 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1369040709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05a34f2e-a465-49e4-bb2c-51d8e9d315fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ec94787266a421bbf14792cec9c84ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:08:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:08:56Z,use_quota=True,user_id='36960985b04c44e5ad3ff5aefd9017aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:08:56 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-6368290b-7d86-45d5-b72d-b04a53e190b4 tempest-CreateVolumesFromImageTest-1183687806 None] Creating volume 05a34f2e-a465-49e4-bb2c-51d8e9d315fe {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:08:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-6368290b-7d86-45d5-b72d-b04a53e190b4 tempest-CreateVolumesFromImageTest-1183687806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:08:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-6368290b-7d86-45d5-b72d-b04a53e190b4 tempest-CreateVolumesFromImageTest-1183687806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:08:56 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-6368290b-7d86-45d5-b72d-b04a53e190b4 tempest-CreateVolumesFromImageTest-1183687806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:08:56 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-6368290b-7d86-45d5-b72d-b04a53e190b4 tempest-CreateVolumesFromImageTest-1183687806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:08:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-6368290b-7d86-45d5-b72d-b04a53e190b4 tempest-CreateVolumesFromImageTest-1183687806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:08:56 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-6368290b-7d86-45d5-b72d-b04a53e190b4 tempest-CreateVolumesFromImageTest-1183687806 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:08:56 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-6368290b-7d86-45d5-b72d-b04a53e190b4 tempest-CreateVolumesFromImageTest-1183687806 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:08:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-6368290b-7d86-45d5-b72d-b04a53e190b4 tempest-CreateVolumesFromImageTest-1183687806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-05a34f2e-a465-49e4-bb2c-51d8e9d315fe 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:56 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-edfac99e-20f7-48a2-b0b4-6ae1981c9ba8 tempest-CreateVolumesFromImageTest-1183687806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff881302-0ed1-4eaa-a9ac-4b24ca080a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d00ad682-e9f0-4b58-a036-226c7f0d40e2', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:56 devstack sudo[107302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-05a34f2e-a465-49e4-bb2c-51d8e9d315fe 1073741824 Jul 30 17:08:56 devstack sudo[107302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:56 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-edfac99e-20f7-48a2-b0b4-6ae1981c9ba8 tempest-CreateVolumesFromImageTest-1183687806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4a105d6-ae30-42d8-bc40-47c02606c902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:56 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-edfac99e-20f7-48a2-b0b4-6ae1981c9ba8 tempest-CreateVolumesFromImageTest-1183687806 None] Volume volume-d00ad682-e9f0-4b58-a036-226c7f0d40e2 (d00ad682-e9f0-4b58-a036-226c7f0d40e2): created successfully Jul 30 17:08:56 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-edfac99e-20f7-48a2-b0b4-6ae1981c9ba8 tempest-CreateVolumesFromImageTest-1183687806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4a105d6-ae30-42d8-bc40-47c02606c902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:56 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-edfac99e-20f7-48a2-b0b4-6ae1981c9ba8 tempest-CreateVolumesFromImageTest-1183687806 None] Flow 'volume_create_manager' (24516b89-d094-4f44-bf6a-2e67b344d76c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:08:57 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-edfac99e-20f7-48a2-b0b4-6ae1981c9ba8 tempest-CreateVolumesFromImageTest-1183687806 None] Created volume successfully. Jul 30 17:08:57 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a25cf4c-52be-4156-be6c-ac59e461de1a tempest-CreateVolumesFromImageTest-1183687806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:08:57 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1a25cf4c-52be-4156-be6c-ac59e461de1a tempest-CreateVolumesFromImageTest-1183687806 None] Flow 'volume_create_manager' (0f201734-1d30-44c1-9d0c-6483e33c3c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:08:57 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1a25cf4c-52be-4156-be6c-ac59e461de1a tempest-CreateVolumesFromImageTest-1183687806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92bb937e-39ab-4fba-a7e3-3ccc1373f595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:57 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1a25cf4c-52be-4156-be6c-ac59e461de1a tempest-CreateVolumesFromImageTest-1183687806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92bb937e-39ab-4fba-a7e3-3ccc1373f595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:08:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-841722058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5567677-3aca-4d4e-afd9-9e42f8482799,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ec94787266a421bbf14792cec9c84ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:08:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:08:57Z,use_quota=True,user_id='36960985b04c44e5ad3ff5aefd9017aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:57 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1a25cf4c-52be-4156-be6c-ac59e461de1a tempest-CreateVolumesFromImageTest-1183687806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a6281d0-cf47-4009-9678-620c2a3df732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:57 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1a25cf4c-52be-4156-be6c-ac59e461de1a tempest-CreateVolumesFromImageTest-1183687806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a6281d0-cf47-4009-9678-620c2a3df732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:57 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1a25cf4c-52be-4156-be6c-ac59e461de1a tempest-CreateVolumesFromImageTest-1183687806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (862adb48-193c-408c-a1b3-1c573ecb5157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:57 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1a25cf4c-52be-4156-be6c-ac59e461de1a tempest-CreateVolumesFromImageTest-1183687806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (862adb48-193c-408c-a1b3-1c573ecb5157) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5567677-3aca-4d4e-afd9-9e42f8482799', 'volume_name': 'volume-a5567677-3aca-4d4e-afd9-9e42f8482799', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:57 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1a25cf4c-52be-4156-be6c-ac59e461de1a tempest-CreateVolumesFromImageTest-1183687806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (813db024-c216-4b77-9b01-0ec235c816d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:57 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1a25cf4c-52be-4156-be6c-ac59e461de1a tempest-CreateVolumesFromImageTest-1183687806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (813db024-c216-4b77-9b01-0ec235c816d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:57 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1a25cf4c-52be-4156-be6c-ac59e461de1a tempest-CreateVolumesFromImageTest-1183687806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e716fa2e-ca96-4010-a607-a362cff2d48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:57 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-1a25cf4c-52be-4156-be6c-ac59e461de1a tempest-CreateVolumesFromImageTest-1183687806 None] Volume a5567677-3aca-4d4e-afd9-9e42f8482799: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5567677-3aca-4d4e-afd9-9e42f8482799', 'volume_size': 1} Jul 30 17:08:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-1a25cf4c-52be-4156-be6c-ac59e461de1a tempest-CreateVolumesFromImageTest-1183687806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:08:57 devstack sudo[107302]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-6368290b-7d86-45d5-b72d-b04a53e190b4 tempest-CreateVolumesFromImageTest-1183687806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-05a34f2e-a465-49e4-bb2c-51d8e9d315fe 1073741824" returned: 0 in 0.552s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-6368290b-7d86-45d5-b72d-b04a53e190b4 tempest-CreateVolumesFromImageTest-1183687806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-05a34f2e-a465-49e4-bb2c-51d8e9d315fe {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:57 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-35956525-602a-463d-9573-9c18a130414d tempest-CreateVolumesFromImageTest-1183687806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:08:57 devstack sudo[107307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-05a34f2e-a465-49e4-bb2c-51d8e9d315fe Jul 30 17:08:57 devstack sudo[107307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:57 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-35956525-602a-463d-9573-9c18a130414d tempest-CreateVolumesFromImageTest-1183687806 None] Flow 'volume_create_manager' (9501b4d9-ca1e-4f43-94c7-a941272c42d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:08:57 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-35956525-602a-463d-9573-9c18a130414d tempest-CreateVolumesFromImageTest-1183687806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03e7653a-0cf1-415a-bdc4-d6e27bc41e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:57 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-35956525-602a-463d-9573-9c18a130414d tempest-CreateVolumesFromImageTest-1183687806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03e7653a-0cf1-415a-bdc4-d6e27bc41e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:08:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1432647463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96a8e839-db9d-4afa-80f3-7286009ab09f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ec94787266a421bbf14792cec9c84ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:08:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:08:57Z,use_quota=True,user_id='36960985b04c44e5ad3ff5aefd9017aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:57 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-35956525-602a-463d-9573-9c18a130414d tempest-CreateVolumesFromImageTest-1183687806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00241d43-9acc-46ce-b690-c35f9a41f240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:57 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-35956525-602a-463d-9573-9c18a130414d tempest-CreateVolumesFromImageTest-1183687806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00241d43-9acc-46ce-b690-c35f9a41f240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:57 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-35956525-602a-463d-9573-9c18a130414d tempest-CreateVolumesFromImageTest-1183687806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63ab34e8-a025-46c9-9470-11a2ea29af01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:57 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-35956525-602a-463d-9573-9c18a130414d tempest-CreateVolumesFromImageTest-1183687806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63ab34e8-a025-46c9-9470-11a2ea29af01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96a8e839-db9d-4afa-80f3-7286009ab09f', 'volume_name': 'volume-96a8e839-db9d-4afa-80f3-7286009ab09f', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:57 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-35956525-602a-463d-9573-9c18a130414d tempest-CreateVolumesFromImageTest-1183687806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e38ce2ef-022f-44cb-b944-3cb14764cd16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:57 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-35956525-602a-463d-9573-9c18a130414d tempest-CreateVolumesFromImageTest-1183687806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e38ce2ef-022f-44cb-b944-3cb14764cd16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:57 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-35956525-602a-463d-9573-9c18a130414d tempest-CreateVolumesFromImageTest-1183687806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90fef229-2948-4900-9ed9-3f1d52942b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:57 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-35956525-602a-463d-9573-9c18a130414d tempest-CreateVolumesFromImageTest-1183687806 None] Volume 96a8e839-db9d-4afa-80f3-7286009ab09f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96a8e839-db9d-4afa-80f3-7286009ab09f', 'volume_size': 1} Jul 30 17:08:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-35956525-602a-463d-9573-9c18a130414d tempest-CreateVolumesFromImageTest-1183687806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:08:57 devstack sudo[107307]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-6368290b-7d86-45d5-b72d-b04a53e190b4 tempest-CreateVolumesFromImageTest-1183687806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-05a34f2e-a465-49e4-bb2c-51d8e9d315fe" returned: 0 in 0.239s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:57 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-6368290b-7d86-45d5-b72d-b04a53e190b4 tempest-CreateVolumesFromImageTest-1183687806 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:08:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-6368290b-7d86-45d5-b72d-b04a53e190b4 tempest-CreateVolumesFromImageTest-1183687806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:08:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-623e98aa-9047-4031-9cf3-2514693102dc tempest-CreateVolumesFromImageTest-1183687806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.979s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:08:57 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-623e98aa-9047-4031-9cf3-2514693102dc tempest-CreateVolumesFromImageTest-1183687806 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1496107258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=379ac367-357c-402f-9bd9-c3b752244875,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ec94787266a421bbf14792cec9c84ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:08:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:08:57Z,use_quota=True,user_id='36960985b04c44e5ad3ff5aefd9017aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:08:57 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-623e98aa-9047-4031-9cf3-2514693102dc tempest-CreateVolumesFromImageTest-1183687806 None] Creating volume 379ac367-357c-402f-9bd9-c3b752244875 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:08:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-623e98aa-9047-4031-9cf3-2514693102dc tempest-CreateVolumesFromImageTest-1183687806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:08:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-623e98aa-9047-4031-9cf3-2514693102dc tempest-CreateVolumesFromImageTest-1183687806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:08:57 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-623e98aa-9047-4031-9cf3-2514693102dc tempest-CreateVolumesFromImageTest-1183687806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:08:57 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-623e98aa-9047-4031-9cf3-2514693102dc tempest-CreateVolumesFromImageTest-1183687806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:08:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-623e98aa-9047-4031-9cf3-2514693102dc tempest-CreateVolumesFromImageTest-1183687806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:08:57 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-623e98aa-9047-4031-9cf3-2514693102dc tempest-CreateVolumesFromImageTest-1183687806 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:08:57 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-623e98aa-9047-4031-9cf3-2514693102dc tempest-CreateVolumesFromImageTest-1183687806 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:08:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-623e98aa-9047-4031-9cf3-2514693102dc tempest-CreateVolumesFromImageTest-1183687806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-379ac367-357c-402f-9bd9-c3b752244875 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:57 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-6368290b-7d86-45d5-b72d-b04a53e190b4 tempest-CreateVolumesFromImageTest-1183687806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9028ce4f-296f-4e9c-b774-480259cdad6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05a34f2e-a465-49e4-bb2c-51d8e9d315fe', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:57 devstack sudo[107310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-379ac367-357c-402f-9bd9-c3b752244875 1073741824 Jul 30 17:08:57 devstack sudo[107310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:57 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-6368290b-7d86-45d5-b72d-b04a53e190b4 tempest-CreateVolumesFromImageTest-1183687806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (079b2f06-7120-4b28-9a87-4fe20d0fa7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:57 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-6368290b-7d86-45d5-b72d-b04a53e190b4 tempest-CreateVolumesFromImageTest-1183687806 None] Volume volume-05a34f2e-a465-49e4-bb2c-51d8e9d315fe (05a34f2e-a465-49e4-bb2c-51d8e9d315fe): created successfully Jul 30 17:08:57 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-6368290b-7d86-45d5-b72d-b04a53e190b4 tempest-CreateVolumesFromImageTest-1183687806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (079b2f06-7120-4b28-9a87-4fe20d0fa7ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:57 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-6368290b-7d86-45d5-b72d-b04a53e190b4 tempest-CreateVolumesFromImageTest-1183687806 None] Flow 'volume_create_manager' (67df9a47-0540-46d6-974d-27b088fa5f57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:08:57 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-6368290b-7d86-45d5-b72d-b04a53e190b4 tempest-CreateVolumesFromImageTest-1183687806 None] Created volume successfully. Jul 30 17:08:58 devstack sudo[107310]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-623e98aa-9047-4031-9cf3-2514693102dc tempest-CreateVolumesFromImageTest-1183687806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-379ac367-357c-402f-9bd9-c3b752244875 1073741824" returned: 0 in 0.416s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-623e98aa-9047-4031-9cf3-2514693102dc tempest-CreateVolumesFromImageTest-1183687806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-379ac367-357c-402f-9bd9-c3b752244875 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:58 devstack sudo[107316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-379ac367-357c-402f-9bd9-c3b752244875 Jul 30 17:08:58 devstack sudo[107316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:58 devstack sudo[107316]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-623e98aa-9047-4031-9cf3-2514693102dc tempest-CreateVolumesFromImageTest-1183687806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-379ac367-357c-402f-9bd9-c3b752244875" returned: 0 in 0.262s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:58 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-623e98aa-9047-4031-9cf3-2514693102dc tempest-CreateVolumesFromImageTest-1183687806 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:08:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-623e98aa-9047-4031-9cf3-2514693102dc tempest-CreateVolumesFromImageTest-1183687806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:08:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-1a25cf4c-52be-4156-be6c-ac59e461de1a tempest-CreateVolumesFromImageTest-1183687806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.233s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:08:58 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-1a25cf4c-52be-4156-be6c-ac59e461de1a tempest-CreateVolumesFromImageTest-1183687806 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:08:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-841722058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5567677-3aca-4d4e-afd9-9e42f8482799,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ec94787266a421bbf14792cec9c84ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:08:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:08:57Z,use_quota=True,user_id='36960985b04c44e5ad3ff5aefd9017aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:08:58 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-1a25cf4c-52be-4156-be6c-ac59e461de1a tempest-CreateVolumesFromImageTest-1183687806 None] Creating volume a5567677-3aca-4d4e-afd9-9e42f8482799 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:08:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-1a25cf4c-52be-4156-be6c-ac59e461de1a tempest-CreateVolumesFromImageTest-1183687806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:08:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-1a25cf4c-52be-4156-be6c-ac59e461de1a tempest-CreateVolumesFromImageTest-1183687806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:08:58 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-1a25cf4c-52be-4156-be6c-ac59e461de1a tempest-CreateVolumesFromImageTest-1183687806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:08:58 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-1a25cf4c-52be-4156-be6c-ac59e461de1a tempest-CreateVolumesFromImageTest-1183687806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:08:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-1a25cf4c-52be-4156-be6c-ac59e461de1a tempest-CreateVolumesFromImageTest-1183687806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:08:58 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-1a25cf4c-52be-4156-be6c-ac59e461de1a tempest-CreateVolumesFromImageTest-1183687806 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:08:58 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-1a25cf4c-52be-4156-be6c-ac59e461de1a tempest-CreateVolumesFromImageTest-1183687806 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:08:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-1a25cf4c-52be-4156-be6c-ac59e461de1a tempest-CreateVolumesFromImageTest-1183687806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-a5567677-3aca-4d4e-afd9-9e42f8482799 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:58 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-623e98aa-9047-4031-9cf3-2514693102dc tempest-CreateVolumesFromImageTest-1183687806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e38689e-148c-4832-aa0a-77aed6f3b399) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-379ac367-357c-402f-9bd9-c3b752244875', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:58 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-623e98aa-9047-4031-9cf3-2514693102dc tempest-CreateVolumesFromImageTest-1183687806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (807eac04-b415-497b-af68-da56f92e1341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:58 devstack sudo[107319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-a5567677-3aca-4d4e-afd9-9e42f8482799 1073741824 Jul 30 17:08:58 devstack sudo[107319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:58 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-623e98aa-9047-4031-9cf3-2514693102dc tempest-CreateVolumesFromImageTest-1183687806 None] Volume volume-379ac367-357c-402f-9bd9-c3b752244875 (379ac367-357c-402f-9bd9-c3b752244875): created successfully Jul 30 17:08:58 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-623e98aa-9047-4031-9cf3-2514693102dc tempest-CreateVolumesFromImageTest-1183687806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (807eac04-b415-497b-af68-da56f92e1341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:58 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-623e98aa-9047-4031-9cf3-2514693102dc tempest-CreateVolumesFromImageTest-1183687806 None] Flow 'volume_create_manager' (17cbff84-ce57-4a44-ba62-6bc6648d2e22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:08:58 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-623e98aa-9047-4031-9cf3-2514693102dc tempest-CreateVolumesFromImageTest-1183687806 None] Created volume successfully. Jul 30 17:08:58 devstack sudo[107319]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-1a25cf4c-52be-4156-be6c-ac59e461de1a tempest-CreateVolumesFromImageTest-1183687806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-a5567677-3aca-4d4e-afd9-9e42f8482799 1073741824" returned: 0 in 0.427s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-1a25cf4c-52be-4156-be6c-ac59e461de1a tempest-CreateVolumesFromImageTest-1183687806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-a5567677-3aca-4d4e-afd9-9e42f8482799 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:58 devstack sudo[107326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-a5567677-3aca-4d4e-afd9-9e42f8482799 Jul 30 17:08:58 devstack sudo[107326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:59 devstack sudo[107326]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-1a25cf4c-52be-4156-be6c-ac59e461de1a tempest-CreateVolumesFromImageTest-1183687806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-a5567677-3aca-4d4e-afd9-9e42f8482799" returned: 0 in 0.239s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:59 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-1a25cf4c-52be-4156-be6c-ac59e461de1a tempest-CreateVolumesFromImageTest-1183687806 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:08:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-1a25cf4c-52be-4156-be6c-ac59e461de1a tempest-CreateVolumesFromImageTest-1183687806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:08:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-35956525-602a-463d-9573-9c18a130414d tempest-CreateVolumesFromImageTest-1183687806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.582s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:08:59 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-35956525-602a-463d-9573-9c18a130414d tempest-CreateVolumesFromImageTest-1183687806 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:08:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1432647463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96a8e839-db9d-4afa-80f3-7286009ab09f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ec94787266a421bbf14792cec9c84ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:08:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:08:57Z,use_quota=True,user_id='36960985b04c44e5ad3ff5aefd9017aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:08:59 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-35956525-602a-463d-9573-9c18a130414d tempest-CreateVolumesFromImageTest-1183687806 None] Creating volume 96a8e839-db9d-4afa-80f3-7286009ab09f {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:08:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-35956525-602a-463d-9573-9c18a130414d tempest-CreateVolumesFromImageTest-1183687806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:08:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-35956525-602a-463d-9573-9c18a130414d tempest-CreateVolumesFromImageTest-1183687806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:08:59 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-35956525-602a-463d-9573-9c18a130414d tempest-CreateVolumesFromImageTest-1183687806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:08:59 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-35956525-602a-463d-9573-9c18a130414d tempest-CreateVolumesFromImageTest-1183687806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:08:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-35956525-602a-463d-9573-9c18a130414d tempest-CreateVolumesFromImageTest-1183687806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:08:59 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-35956525-602a-463d-9573-9c18a130414d tempest-CreateVolumesFromImageTest-1183687806 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:08:59 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-35956525-602a-463d-9573-9c18a130414d tempest-CreateVolumesFromImageTest-1183687806 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:08:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-35956525-602a-463d-9573-9c18a130414d tempest-CreateVolumesFromImageTest-1183687806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-96a8e839-db9d-4afa-80f3-7286009ab09f 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:59 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1a25cf4c-52be-4156-be6c-ac59e461de1a tempest-CreateVolumesFromImageTest-1183687806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e716fa2e-ca96-4010-a607-a362cff2d48e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5567677-3aca-4d4e-afd9-9e42f8482799', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:59 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1a25cf4c-52be-4156-be6c-ac59e461de1a tempest-CreateVolumesFromImageTest-1183687806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d179cbb-ace2-4f8f-8f03-cbc9e00f008d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:59 devstack sudo[107329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-96a8e839-db9d-4afa-80f3-7286009ab09f 1073741824 Jul 30 17:08:59 devstack sudo[107329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:59 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-1a25cf4c-52be-4156-be6c-ac59e461de1a tempest-CreateVolumesFromImageTest-1183687806 None] Volume volume-a5567677-3aca-4d4e-afd9-9e42f8482799 (a5567677-3aca-4d4e-afd9-9e42f8482799): created successfully Jul 30 17:08:59 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1a25cf4c-52be-4156-be6c-ac59e461de1a tempest-CreateVolumesFromImageTest-1183687806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d179cbb-ace2-4f8f-8f03-cbc9e00f008d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:59 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1a25cf4c-52be-4156-be6c-ac59e461de1a tempest-CreateVolumesFromImageTest-1183687806 None] Flow 'volume_create_manager' (0f201734-1d30-44c1-9d0c-6483e33c3c6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:08:59 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-1a25cf4c-52be-4156-be6c-ac59e461de1a tempest-CreateVolumesFromImageTest-1183687806 None] Created volume successfully. Jul 30 17:08:59 devstack sudo[107329]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-35956525-602a-463d-9573-9c18a130414d tempest-CreateVolumesFromImageTest-1183687806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-96a8e839-db9d-4afa-80f3-7286009ab09f 1073741824" returned: 0 in 0.410s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-35956525-602a-463d-9573-9c18a130414d tempest-CreateVolumesFromImageTest-1183687806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-96a8e839-db9d-4afa-80f3-7286009ab09f {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:59 devstack sudo[107335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-96a8e839-db9d-4afa-80f3-7286009ab09f Jul 30 17:08:59 devstack sudo[107335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:59 devstack sudo[107335]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-35956525-602a-463d-9573-9c18a130414d tempest-CreateVolumesFromImageTest-1183687806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-96a8e839-db9d-4afa-80f3-7286009ab09f" returned: 0 in 0.238s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:59 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-35956525-602a-463d-9573-9c18a130414d tempest-CreateVolumesFromImageTest-1183687806 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:08:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-35956525-602a-463d-9573-9c18a130414d tempest-CreateVolumesFromImageTest-1183687806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:08:59 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-35956525-602a-463d-9573-9c18a130414d tempest-CreateVolumesFromImageTest-1183687806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90fef229-2948-4900-9ed9-3f1d52942b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96a8e839-db9d-4afa-80f3-7286009ab09f', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:59 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-35956525-602a-463d-9573-9c18a130414d tempest-CreateVolumesFromImageTest-1183687806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f295e70-d01f-48ce-89f9-2b6c198c81e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:59 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-35956525-602a-463d-9573-9c18a130414d tempest-CreateVolumesFromImageTest-1183687806 None] Volume volume-96a8e839-db9d-4afa-80f3-7286009ab09f (96a8e839-db9d-4afa-80f3-7286009ab09f): created successfully Jul 30 17:08:59 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-35956525-602a-463d-9573-9c18a130414d tempest-CreateVolumesFromImageTest-1183687806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f295e70-d01f-48ce-89f9-2b6c198c81e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:59 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-35956525-602a-463d-9573-9c18a130414d tempest-CreateVolumesFromImageTest-1183687806 None] Flow 'volume_create_manager' (9501b4d9-ca1e-4f43-94c7-a941272c42d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:08:59 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-35956525-602a-463d-9573-9c18a130414d tempest-CreateVolumesFromImageTest-1183687806 None] Created volume successfully. Jul 30 17:09:00 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-cc47f79e-e7e1-4100-ad5b-71f537c93985 tempest-CreateVolumesFromImageTest-1183687806 None] Acquiring lock "cinder-96a8e839-db9d-4afa-80f3-7286009ab09f-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:00 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-cc47f79e-e7e1-4100-ad5b-71f537c93985 tempest-CreateVolumesFromImageTest-1183687806 None] Lock "cinder-96a8e839-db9d-4afa-80f3-7286009ab09f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:00 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-cc47f79e-e7e1-4100-ad5b-71f537c93985 tempest-CreateVolumesFromImageTest-1183687806 None] Acquiring lock "cinder-quobyte-96a8e839-db9d-4afa-80f3-7286009ab09f" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:00 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-cc47f79e-e7e1-4100-ad5b-71f537c93985 tempest-CreateVolumesFromImageTest-1183687806 None] Lock "cinder-quobyte-96a8e839-db9d-4afa-80f3-7286009ab09f" acquired by "delete_volume" :: waited 0.014s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:00 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a49386e-efca-40fc-b7ef-d8120ce698b1]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:09:00 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-cc47f79e-e7e1-4100-ad5b-71f537c93985 tempest-CreateVolumesFromImageTest-1183687806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-96a8e839-db9d-4afa-80f3-7286009ab09f {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:01 devstack sudo[107338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-96a8e839-db9d-4afa-80f3-7286009ab09f Jul 30 17:09:01 devstack sudo[107338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:01 devstack sudo[107338]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-cc47f79e-e7e1-4100-ad5b-71f537c93985 tempest-CreateVolumesFromImageTest-1183687806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-96a8e839-db9d-4afa-80f3-7286009ab09f" returned: 0 in 0.361s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-cc47f79e-e7e1-4100-ad5b-71f537c93985 tempest-CreateVolumesFromImageTest-1183687806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-96a8e839-db9d-4afa-80f3-7286009ab09f {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:01 devstack sudo[107343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-96a8e839-db9d-4afa-80f3-7286009ab09f Jul 30 17:09:01 devstack sudo[107343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:01 devstack sudo[107343]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-cc47f79e-e7e1-4100-ad5b-71f537c93985 tempest-CreateVolumesFromImageTest-1183687806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-96a8e839-db9d-4afa-80f3-7286009ab09f" returned: 0 in 0.240s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:01 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-cc47f79e-e7e1-4100-ad5b-71f537c93985 tempest-CreateVolumesFromImageTest-1183687806 None] Lock "cinder-quobyte-96a8e839-db9d-4afa-80f3-7286009ab09f" released by "delete_volume" :: held 0.646s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:01 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-cc47f79e-e7e1-4100-ad5b-71f537c93985 tempest-CreateVolumesFromImageTest-1183687806 None] Created reservations ['9c78be01-842c-4c78-b012-e0424c4c1f5f', 'a78528c8-014a-45bc-beb1-f9eecdc5ef4e', 'bf4fbfd2-f36c-4b49-b016-894e4388efcd', '2872a4c7-d66a-4a84-9886-b40b73e22c55'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:09:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-cc47f79e-e7e1-4100-ad5b-71f537c93985 tempest-CreateVolumesFromImageTest-1183687806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-cc47f79e-e7e1-4100-ad5b-71f537c93985 tempest-CreateVolumesFromImageTest-1183687806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:01 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-cc47f79e-e7e1-4100-ad5b-71f537c93985 tempest-CreateVolumesFromImageTest-1183687806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:09:01 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-cc47f79e-e7e1-4100-ad5b-71f537c93985 tempest-CreateVolumesFromImageTest-1183687806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:09:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-cc47f79e-e7e1-4100-ad5b-71f537c93985 tempest-CreateVolumesFromImageTest-1183687806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-cc47f79e-e7e1-4100-ad5b-71f537c93985 tempest-CreateVolumesFromImageTest-1183687806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:01 devstack sudo[107346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:09:01 devstack sudo[107346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:01 devstack sudo[107346]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-cc47f79e-e7e1-4100-ad5b-71f537c93985 tempest-CreateVolumesFromImageTest-1183687806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.240s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:01 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-cc47f79e-e7e1-4100-ad5b-71f537c93985 tempest-CreateVolumesFromImageTest-1183687806 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:09:01 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-cc47f79e-e7e1-4100-ad5b-71f537c93985 tempest-CreateVolumesFromImageTest-1183687806 None] Deleted volume successfully. Jul 30 17:09:01 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-cc47f79e-e7e1-4100-ad5b-71f537c93985 tempest-CreateVolumesFromImageTest-1183687806 None] Lock "cinder-96a8e839-db9d-4afa-80f3-7286009ab09f-delete_volume" released by "delete_volume" :: held 1.067s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:01 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-f3f66926-6582-4b4e-8ec8-0a2c212ad50f tempest-CreateVolumesFromImageTest-1183687806 None] Acquiring lock "cinder-a5567677-3aca-4d4e-afd9-9e42f8482799-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:02 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-f3f66926-6582-4b4e-8ec8-0a2c212ad50f tempest-CreateVolumesFromImageTest-1183687806 None] Lock "cinder-a5567677-3aca-4d4e-afd9-9e42f8482799-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:02 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-f3f66926-6582-4b4e-8ec8-0a2c212ad50f tempest-CreateVolumesFromImageTest-1183687806 None] Acquiring lock "cinder-quobyte-a5567677-3aca-4d4e-afd9-9e42f8482799" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:02 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-f3f66926-6582-4b4e-8ec8-0a2c212ad50f tempest-CreateVolumesFromImageTest-1183687806 None] Lock "cinder-quobyte-a5567677-3aca-4d4e-afd9-9e42f8482799" acquired by "delete_volume" :: waited 0.015s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:02 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[455a621e-17ea-4026-b89d-f53d5ce1d44d]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:09:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f3f66926-6582-4b4e-8ec8-0a2c212ad50f tempest-CreateVolumesFromImageTest-1183687806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-a5567677-3aca-4d4e-afd9-9e42f8482799 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:02 devstack sudo[107349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-a5567677-3aca-4d4e-afd9-9e42f8482799 Jul 30 17:09:02 devstack sudo[107349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:02 devstack sudo[107349]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f3f66926-6582-4b4e-8ec8-0a2c212ad50f tempest-CreateVolumesFromImageTest-1183687806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-a5567677-3aca-4d4e-afd9-9e42f8482799" returned: 0 in 0.367s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f3f66926-6582-4b4e-8ec8-0a2c212ad50f tempest-CreateVolumesFromImageTest-1183687806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-a5567677-3aca-4d4e-afd9-9e42f8482799 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:02 devstack sudo[107354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-a5567677-3aca-4d4e-afd9-9e42f8482799 Jul 30 17:09:02 devstack sudo[107354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:02 devstack sudo[107354]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f3f66926-6582-4b4e-8ec8-0a2c212ad50f tempest-CreateVolumesFromImageTest-1183687806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-a5567677-3aca-4d4e-afd9-9e42f8482799" returned: 0 in 0.242s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:02 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-f3f66926-6582-4b4e-8ec8-0a2c212ad50f tempest-CreateVolumesFromImageTest-1183687806 None] Lock "cinder-quobyte-a5567677-3aca-4d4e-afd9-9e42f8482799" released by "delete_volume" :: held 0.646s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:02 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-f3f66926-6582-4b4e-8ec8-0a2c212ad50f tempest-CreateVolumesFromImageTest-1183687806 None] Created reservations ['f0c5b1aa-3718-4e16-944c-500b01b4462a', 'a61e4e69-f0f5-452d-990b-69a8b45c67a9', '3e1868ac-c2d1-496a-86f9-149ff42b4bfd', '4fb1224f-1d58-472e-a726-cf9cf367e0b0'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:09:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-f3f66926-6582-4b4e-8ec8-0a2c212ad50f tempest-CreateVolumesFromImageTest-1183687806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-f3f66926-6582-4b4e-8ec8-0a2c212ad50f tempest-CreateVolumesFromImageTest-1183687806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:02 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-f3f66926-6582-4b4e-8ec8-0a2c212ad50f tempest-CreateVolumesFromImageTest-1183687806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:09:02 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-f3f66926-6582-4b4e-8ec8-0a2c212ad50f tempest-CreateVolumesFromImageTest-1183687806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:09:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-f3f66926-6582-4b4e-8ec8-0a2c212ad50f tempest-CreateVolumesFromImageTest-1183687806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f3f66926-6582-4b4e-8ec8-0a2c212ad50f tempest-CreateVolumesFromImageTest-1183687806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:02 devstack sudo[107357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:09:02 devstack sudo[107357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:03 devstack sudo[107357]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f3f66926-6582-4b4e-8ec8-0a2c212ad50f tempest-CreateVolumesFromImageTest-1183687806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.242s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:03 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-f3f66926-6582-4b4e-8ec8-0a2c212ad50f tempest-CreateVolumesFromImageTest-1183687806 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:09:03 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-f3f66926-6582-4b4e-8ec8-0a2c212ad50f tempest-CreateVolumesFromImageTest-1183687806 None] Deleted volume successfully. Jul 30 17:09:03 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-f3f66926-6582-4b4e-8ec8-0a2c212ad50f tempest-CreateVolumesFromImageTest-1183687806 None] Lock "cinder-a5567677-3aca-4d4e-afd9-9e42f8482799-delete_volume" released by "delete_volume" :: held 1.081s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:03 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-2816723b-7e16-4099-aead-2e0d178af11c tempest-CreateVolumesFromImageTest-1183687806 None] Acquiring lock "cinder-379ac367-357c-402f-9bd9-c3b752244875-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:03 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-2816723b-7e16-4099-aead-2e0d178af11c tempest-CreateVolumesFromImageTest-1183687806 None] Lock "cinder-379ac367-357c-402f-9bd9-c3b752244875-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:03 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-2816723b-7e16-4099-aead-2e0d178af11c tempest-CreateVolumesFromImageTest-1183687806 None] Acquiring lock "cinder-quobyte-379ac367-357c-402f-9bd9-c3b752244875" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:03 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-2816723b-7e16-4099-aead-2e0d178af11c tempest-CreateVolumesFromImageTest-1183687806 None] Lock "cinder-quobyte-379ac367-357c-402f-9bd9-c3b752244875" acquired by "delete_volume" :: waited 0.015s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:03 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[32aee71c-ca04-4df5-a313-2b3c41f097a0]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:09:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2816723b-7e16-4099-aead-2e0d178af11c tempest-CreateVolumesFromImageTest-1183687806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-379ac367-357c-402f-9bd9-c3b752244875 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:03 devstack sudo[107360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-379ac367-357c-402f-9bd9-c3b752244875 Jul 30 17:09:03 devstack sudo[107360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:03 devstack sudo[107360]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2816723b-7e16-4099-aead-2e0d178af11c tempest-CreateVolumesFromImageTest-1183687806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-379ac367-357c-402f-9bd9-c3b752244875" returned: 0 in 0.348s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2816723b-7e16-4099-aead-2e0d178af11c tempest-CreateVolumesFromImageTest-1183687806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-379ac367-357c-402f-9bd9-c3b752244875 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:03 devstack sudo[107365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-379ac367-357c-402f-9bd9-c3b752244875 Jul 30 17:09:03 devstack sudo[107365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:03 devstack sudo[107365]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2816723b-7e16-4099-aead-2e0d178af11c tempest-CreateVolumesFromImageTest-1183687806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-379ac367-357c-402f-9bd9-c3b752244875" returned: 0 in 0.251s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:03 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-2816723b-7e16-4099-aead-2e0d178af11c tempest-CreateVolumesFromImageTest-1183687806 None] Lock "cinder-quobyte-379ac367-357c-402f-9bd9-c3b752244875" released by "delete_volume" :: held 0.638s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:03 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-2816723b-7e16-4099-aead-2e0d178af11c tempest-CreateVolumesFromImageTest-1183687806 None] Created reservations ['70033c0c-88b0-45b9-aaab-52fcd294e11c', '959d0123-0b41-48bf-853e-3375cd931fdd', '22f0784b-98ba-4f5d-9b24-5b21fc233ec0', '6c445088-6f0d-4fde-91bd-06b1f90c0e54'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:09:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-2816723b-7e16-4099-aead-2e0d178af11c tempest-CreateVolumesFromImageTest-1183687806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-2816723b-7e16-4099-aead-2e0d178af11c tempest-CreateVolumesFromImageTest-1183687806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:03 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-2816723b-7e16-4099-aead-2e0d178af11c tempest-CreateVolumesFromImageTest-1183687806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:09:03 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-2816723b-7e16-4099-aead-2e0d178af11c tempest-CreateVolumesFromImageTest-1183687806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:09:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-2816723b-7e16-4099-aead-2e0d178af11c tempest-CreateVolumesFromImageTest-1183687806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2816723b-7e16-4099-aead-2e0d178af11c tempest-CreateVolumesFromImageTest-1183687806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:03 devstack sudo[107368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:09:03 devstack sudo[107368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:04 devstack sudo[107368]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2816723b-7e16-4099-aead-2e0d178af11c tempest-CreateVolumesFromImageTest-1183687806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.241s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:04 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-2816723b-7e16-4099-aead-2e0d178af11c tempest-CreateVolumesFromImageTest-1183687806 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:09:04 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-2816723b-7e16-4099-aead-2e0d178af11c tempest-CreateVolumesFromImageTest-1183687806 None] Deleted volume successfully. Jul 30 17:09:04 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-2816723b-7e16-4099-aead-2e0d178af11c tempest-CreateVolumesFromImageTest-1183687806 None] Lock "cinder-379ac367-357c-402f-9bd9-c3b752244875-delete_volume" released by "delete_volume" :: held 1.080s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:04 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-56067dfd-5b6b-48de-8aa8-5904107502e9 tempest-CreateVolumesFromImageTest-1183687806 None] Acquiring lock "cinder-05a34f2e-a465-49e4-bb2c-51d8e9d315fe-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:04 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-56067dfd-5b6b-48de-8aa8-5904107502e9 tempest-CreateVolumesFromImageTest-1183687806 None] Lock "cinder-05a34f2e-a465-49e4-bb2c-51d8e9d315fe-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:04 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-56067dfd-5b6b-48de-8aa8-5904107502e9 tempest-CreateVolumesFromImageTest-1183687806 None] Acquiring lock "cinder-quobyte-05a34f2e-a465-49e4-bb2c-51d8e9d315fe" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:04 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-56067dfd-5b6b-48de-8aa8-5904107502e9 tempest-CreateVolumesFromImageTest-1183687806 None] Lock "cinder-quobyte-05a34f2e-a465-49e4-bb2c-51d8e9d315fe" acquired by "delete_volume" :: waited 0.012s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:04 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b5cc8c-80d4-47dd-93fe-64b243f18109]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:09:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-56067dfd-5b6b-48de-8aa8-5904107502e9 tempest-CreateVolumesFromImageTest-1183687806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-05a34f2e-a465-49e4-bb2c-51d8e9d315fe {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:04 devstack sudo[107371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-05a34f2e-a465-49e4-bb2c-51d8e9d315fe Jul 30 17:09:04 devstack sudo[107371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:04 devstack sudo[107371]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-56067dfd-5b6b-48de-8aa8-5904107502e9 tempest-CreateVolumesFromImageTest-1183687806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-05a34f2e-a465-49e4-bb2c-51d8e9d315fe" returned: 0 in 0.350s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-56067dfd-5b6b-48de-8aa8-5904107502e9 tempest-CreateVolumesFromImageTest-1183687806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-05a34f2e-a465-49e4-bb2c-51d8e9d315fe {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:04 devstack sudo[107376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-05a34f2e-a465-49e4-bb2c-51d8e9d315fe Jul 30 17:09:04 devstack sudo[107376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:04 devstack sudo[107376]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-56067dfd-5b6b-48de-8aa8-5904107502e9 tempest-CreateVolumesFromImageTest-1183687806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-05a34f2e-a465-49e4-bb2c-51d8e9d315fe" returned: 0 in 0.255s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:05 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-56067dfd-5b6b-48de-8aa8-5904107502e9 tempest-CreateVolumesFromImageTest-1183687806 None] Lock "cinder-quobyte-05a34f2e-a465-49e4-bb2c-51d8e9d315fe" released by "delete_volume" :: held 0.644s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:05 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-56067dfd-5b6b-48de-8aa8-5904107502e9 tempest-CreateVolumesFromImageTest-1183687806 None] Created reservations ['02a87281-c436-407e-b365-d1e2f2cc42d6', '20eb9175-6f93-4457-bbd2-7d7b89170da6', '7aa2d7bb-1a7b-4ed8-a5ca-f10dc7153eeb', '496381a8-c22e-42b5-8af2-dd3767035376'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:09:05 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-56067dfd-5b6b-48de-8aa8-5904107502e9 tempest-CreateVolumesFromImageTest-1183687806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:05 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-56067dfd-5b6b-48de-8aa8-5904107502e9 tempest-CreateVolumesFromImageTest-1183687806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:05 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-56067dfd-5b6b-48de-8aa8-5904107502e9 tempest-CreateVolumesFromImageTest-1183687806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:09:05 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-56067dfd-5b6b-48de-8aa8-5904107502e9 tempest-CreateVolumesFromImageTest-1183687806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:09:05 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-56067dfd-5b6b-48de-8aa8-5904107502e9 tempest-CreateVolumesFromImageTest-1183687806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:05 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-56067dfd-5b6b-48de-8aa8-5904107502e9 tempest-CreateVolumesFromImageTest-1183687806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:05 devstack sudo[107380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:09:05 devstack sudo[107380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:05 devstack sudo[107380]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:05 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-56067dfd-5b6b-48de-8aa8-5904107502e9 tempest-CreateVolumesFromImageTest-1183687806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.236s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:05 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-56067dfd-5b6b-48de-8aa8-5904107502e9 tempest-CreateVolumesFromImageTest-1183687806 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:09:05 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-56067dfd-5b6b-48de-8aa8-5904107502e9 tempest-CreateVolumesFromImageTest-1183687806 None] Deleted volume successfully. Jul 30 17:09:05 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-56067dfd-5b6b-48de-8aa8-5904107502e9 tempest-CreateVolumesFromImageTest-1183687806 None] Lock "cinder-05a34f2e-a465-49e4-bb2c-51d8e9d315fe-delete_volume" released by "delete_volume" :: held 1.079s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:05 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-4fe98fc8-7c20-46f2-972a-b4f59db1ff24 tempest-CreateVolumesFromImageTest-1183687806 None] Acquiring lock "cinder-d00ad682-e9f0-4b58-a036-226c7f0d40e2-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:05 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-4fe98fc8-7c20-46f2-972a-b4f59db1ff24 tempest-CreateVolumesFromImageTest-1183687806 None] Lock "cinder-d00ad682-e9f0-4b58-a036-226c7f0d40e2-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:05 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-4fe98fc8-7c20-46f2-972a-b4f59db1ff24 tempest-CreateVolumesFromImageTest-1183687806 None] Acquiring lock "cinder-quobyte-d00ad682-e9f0-4b58-a036-226c7f0d40e2" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:05 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-4fe98fc8-7c20-46f2-972a-b4f59db1ff24 tempest-CreateVolumesFromImageTest-1183687806 None] Lock "cinder-quobyte-d00ad682-e9f0-4b58-a036-226c7f0d40e2" acquired by "delete_volume" :: waited 0.016s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:05 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[38bf62ba-fb64-4fe5-a5d1-cb0091526a94]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:09:05 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-4fe98fc8-7c20-46f2-972a-b4f59db1ff24 tempest-CreateVolumesFromImageTest-1183687806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d00ad682-e9f0-4b58-a036-226c7f0d40e2 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:05 devstack sudo[107383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d00ad682-e9f0-4b58-a036-226c7f0d40e2 Jul 30 17:09:05 devstack sudo[107383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:05 devstack sudo[107383]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:05 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-4fe98fc8-7c20-46f2-972a-b4f59db1ff24 tempest-CreateVolumesFromImageTest-1183687806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d00ad682-e9f0-4b58-a036-226c7f0d40e2" returned: 0 in 0.360s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:05 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-4fe98fc8-7c20-46f2-972a-b4f59db1ff24 tempest-CreateVolumesFromImageTest-1183687806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d00ad682-e9f0-4b58-a036-226c7f0d40e2 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:05 devstack sudo[107388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d00ad682-e9f0-4b58-a036-226c7f0d40e2 Jul 30 17:09:05 devstack sudo[107388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:06 devstack sudo[107388]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-4fe98fc8-7c20-46f2-972a-b4f59db1ff24 tempest-CreateVolumesFromImageTest-1183687806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d00ad682-e9f0-4b58-a036-226c7f0d40e2" returned: 0 in 0.243s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:06 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-4fe98fc8-7c20-46f2-972a-b4f59db1ff24 tempest-CreateVolumesFromImageTest-1183687806 None] Lock "cinder-quobyte-d00ad682-e9f0-4b58-a036-226c7f0d40e2" released by "delete_volume" :: held 0.645s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:06 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-4fe98fc8-7c20-46f2-972a-b4f59db1ff24 tempest-CreateVolumesFromImageTest-1183687806 None] Created reservations ['84e3b34d-ad82-453d-bac9-659b1bc7f166', '3c36770c-307e-45e1-a1e7-8900b78e803c', 'fe0dd306-1f93-4bb0-85e8-4c3c73806d51', '83316b0f-a89c-44ee-ae94-a04e417b3780'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:09:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-4fe98fc8-7c20-46f2-972a-b4f59db1ff24 tempest-CreateVolumesFromImageTest-1183687806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-4fe98fc8-7c20-46f2-972a-b4f59db1ff24 tempest-CreateVolumesFromImageTest-1183687806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:06 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-4fe98fc8-7c20-46f2-972a-b4f59db1ff24 tempest-CreateVolumesFromImageTest-1183687806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:09:06 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-4fe98fc8-7c20-46f2-972a-b4f59db1ff24 tempest-CreateVolumesFromImageTest-1183687806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:09:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-4fe98fc8-7c20-46f2-972a-b4f59db1ff24 tempest-CreateVolumesFromImageTest-1183687806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-4fe98fc8-7c20-46f2-972a-b4f59db1ff24 tempest-CreateVolumesFromImageTest-1183687806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:06 devstack sudo[107391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:09:06 devstack sudo[107391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:06 devstack sudo[107391]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-4fe98fc8-7c20-46f2-972a-b4f59db1ff24 tempest-CreateVolumesFromImageTest-1183687806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.251s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:06 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-4fe98fc8-7c20-46f2-972a-b4f59db1ff24 tempest-CreateVolumesFromImageTest-1183687806 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:09:06 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-4fe98fc8-7c20-46f2-972a-b4f59db1ff24 tempest-CreateVolumesFromImageTest-1183687806 None] Deleted volume successfully. Jul 30 17:09:06 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-4fe98fc8-7c20-46f2-972a-b4f59db1ff24 tempest-CreateVolumesFromImageTest-1183687806 None] Lock "cinder-d00ad682-e9f0-4b58-a036-226c7f0d40e2-delete_volume" released by "delete_volume" :: held 1.091s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:09 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-762e4b52-d45e-47d1-95ff-157b6445f71f tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:09:09 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-762e4b52-d45e-47d1-95ff-157b6445f71f tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Flow 'volume_create_manager' (5e58a4bb-843d-4815-a2e8-8d89ec0ad8fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:09:09 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-762e4b52-d45e-47d1-95ff-157b6445f71f tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43881e39-5678-45a4-b1bc-3c7d8d54a058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:09 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-762e4b52-d45e-47d1-95ff-157b6445f71f tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43881e39-5678-45a4-b1bc-3c7d8d54a058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:09:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-960542125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f54395b8-e9a8-430b-a17d-624d4dfe95af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65d5ac424f0740648ea187005a08d7cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:09:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:09:09Z,use_quota=True,user_id='53f420968a414070b5f9540c1b5facd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:09 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-762e4b52-d45e-47d1-95ff-157b6445f71f tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86a1c5d0-32f6-435d-84c8-31b6bea38946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:09 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-762e4b52-d45e-47d1-95ff-157b6445f71f tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86a1c5d0-32f6-435d-84c8-31b6bea38946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:09 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-762e4b52-d45e-47d1-95ff-157b6445f71f tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd27cbb8-15b9-4131-a9d1-926597ac8102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:09 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-762e4b52-d45e-47d1-95ff-157b6445f71f tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd27cbb8-15b9-4131-a9d1-926597ac8102) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f54395b8-e9a8-430b-a17d-624d4dfe95af', 'volume_name': 'volume-f54395b8-e9a8-430b-a17d-624d4dfe95af', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:09 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-762e4b52-d45e-47d1-95ff-157b6445f71f tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8562ef21-573e-4b14-b757-da15c78791d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:09 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-762e4b52-d45e-47d1-95ff-157b6445f71f tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8562ef21-573e-4b14-b757-da15c78791d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:09 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-762e4b52-d45e-47d1-95ff-157b6445f71f tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47c7d538-195d-40fc-ae81-7f92ada56371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:09 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-762e4b52-d45e-47d1-95ff-157b6445f71f tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Volume f54395b8-e9a8-430b-a17d-624d4dfe95af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f54395b8-e9a8-430b-a17d-624d4dfe95af', 'volume_size': 1} Jul 30 17:09:09 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-762e4b52-d45e-47d1-95ff-157b6445f71f tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:09 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-762e4b52-d45e-47d1-95ff-157b6445f71f tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:09 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-762e4b52-d45e-47d1-95ff-157b6445f71f tempest-CreateVolumesFromSourceVolumeTest-935563814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:09:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-960542125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f54395b8-e9a8-430b-a17d-624d4dfe95af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65d5ac424f0740648ea187005a08d7cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:09:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:09:09Z,use_quota=True,user_id='53f420968a414070b5f9540c1b5facd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:09:09 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-762e4b52-d45e-47d1-95ff-157b6445f71f tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Creating volume f54395b8-e9a8-430b-a17d-624d4dfe95af {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:09:09 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-762e4b52-d45e-47d1-95ff-157b6445f71f tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:09 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-762e4b52-d45e-47d1-95ff-157b6445f71f tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:09 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-762e4b52-d45e-47d1-95ff-157b6445f71f tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:09:09 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-762e4b52-d45e-47d1-95ff-157b6445f71f tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:09:09 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-762e4b52-d45e-47d1-95ff-157b6445f71f tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:09 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-762e4b52-d45e-47d1-95ff-157b6445f71f tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:09:09 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-762e4b52-d45e-47d1-95ff-157b6445f71f tempest-CreateVolumesFromSourceVolumeTest-935563814 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:09:09 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-762e4b52-d45e-47d1-95ff-157b6445f71f tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f54395b8-e9a8-430b-a17d-624d4dfe95af 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:09 devstack sudo[107396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f54395b8-e9a8-430b-a17d-624d4dfe95af 1073741824 Jul 30 17:09:09 devstack sudo[107396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:10 devstack sudo[107396]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:10 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-762e4b52-d45e-47d1-95ff-157b6445f71f tempest-CreateVolumesFromSourceVolumeTest-935563814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f54395b8-e9a8-430b-a17d-624d4dfe95af 1073741824" returned: 0 in 0.438s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:10 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-762e4b52-d45e-47d1-95ff-157b6445f71f tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f54395b8-e9a8-430b-a17d-624d4dfe95af {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:10 devstack sudo[107401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f54395b8-e9a8-430b-a17d-624d4dfe95af Jul 30 17:09:10 devstack sudo[107401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:10 devstack sudo[107401]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:10 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-762e4b52-d45e-47d1-95ff-157b6445f71f tempest-CreateVolumesFromSourceVolumeTest-935563814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f54395b8-e9a8-430b-a17d-624d4dfe95af" returned: 0 in 0.250s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:10 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-762e4b52-d45e-47d1-95ff-157b6445f71f tempest-CreateVolumesFromSourceVolumeTest-935563814 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:09:10 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-762e4b52-d45e-47d1-95ff-157b6445f71f tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:10 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-762e4b52-d45e-47d1-95ff-157b6445f71f tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47c7d538-195d-40fc-ae81-7f92ada56371) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f54395b8-e9a8-430b-a17d-624d4dfe95af', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:10 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-762e4b52-d45e-47d1-95ff-157b6445f71f tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cd16b58-14fb-4632-8f42-0b7b399c1e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:10 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-762e4b52-d45e-47d1-95ff-157b6445f71f tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Volume volume-f54395b8-e9a8-430b-a17d-624d4dfe95af (f54395b8-e9a8-430b-a17d-624d4dfe95af): created successfully Jul 30 17:09:10 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-762e4b52-d45e-47d1-95ff-157b6445f71f tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cd16b58-14fb-4632-8f42-0b7b399c1e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:10 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-762e4b52-d45e-47d1-95ff-157b6445f71f tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Flow 'volume_create_manager' (5e58a4bb-843d-4815-a2e8-8d89ec0ad8fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:09:10 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-762e4b52-d45e-47d1-95ff-157b6445f71f tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Created volume successfully. Jul 30 17:09:10 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b4ae1c9-2cfc-4e65-a149-cf258712704c tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:09:10 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8b4ae1c9-2cfc-4e65-a149-cf258712704c tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Flow 'volume_create_manager' (f4b04faf-0e81-45c6-ab01-f097bb6a9dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:09:10 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8b4ae1c9-2cfc-4e65-a149-cf258712704c tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c297dab4-d576-4d2d-b9ac-a059151db6c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:10 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8b4ae1c9-2cfc-4e65-a149-cf258712704c tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c297dab4-d576-4d2d-b9ac-a059151db6c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:09:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-557357515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=010a1ba8-c712-4fd8-a0b5-a310908b91dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65d5ac424f0740648ea187005a08d7cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:09:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:09:11Z,use_quota=True,user_id='53f420968a414070b5f9540c1b5facd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:10 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8b4ae1c9-2cfc-4e65-a149-cf258712704c tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a070f93-7987-471f-abd6-d668297d2f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:10 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8b4ae1c9-2cfc-4e65-a149-cf258712704c tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a070f93-7987-471f-abd6-d668297d2f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:10 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8b4ae1c9-2cfc-4e65-a149-cf258712704c tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92796ab2-83cc-414c-ba76-fc3d2d1cc801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:10 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8b4ae1c9-2cfc-4e65-a149-cf258712704c tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92796ab2-83cc-414c-ba76-fc3d2d1cc801) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '010a1ba8-c712-4fd8-a0b5-a310908b91dc', 'volume_name': 'volume-010a1ba8-c712-4fd8-a0b5-a310908b91dc', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:10 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8b4ae1c9-2cfc-4e65-a149-cf258712704c tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31f9f0fb-8a79-49be-a200-dd1b20b08c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:10 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8b4ae1c9-2cfc-4e65-a149-cf258712704c tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31f9f0fb-8a79-49be-a200-dd1b20b08c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:11 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8b4ae1c9-2cfc-4e65-a149-cf258712704c tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25b4dda9-6c2b-45a9-bada-2ce39e63ed36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:11 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-8b4ae1c9-2cfc-4e65-a149-cf258712704c tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Volume 010a1ba8-c712-4fd8-a0b5-a310908b91dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-010a1ba8-c712-4fd8-a0b5-a310908b91dc', 'volume_size': 1} Jul 30 17:09:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-8b4ae1c9-2cfc-4e65-a149-cf258712704c tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-8b4ae1c9-2cfc-4e65-a149-cf258712704c tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:11 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-8b4ae1c9-2cfc-4e65-a149-cf258712704c tempest-CreateVolumesFromSourceVolumeTest-935563814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:09:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-557357515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=010a1ba8-c712-4fd8-a0b5-a310908b91dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65d5ac424f0740648ea187005a08d7cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:09:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:09:11Z,use_quota=True,user_id='53f420968a414070b5f9540c1b5facd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:09:11 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-8b4ae1c9-2cfc-4e65-a149-cf258712704c tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Creating volume 010a1ba8-c712-4fd8-a0b5-a310908b91dc {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:09:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-8b4ae1c9-2cfc-4e65-a149-cf258712704c tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-8b4ae1c9-2cfc-4e65-a149-cf258712704c tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:11 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-8b4ae1c9-2cfc-4e65-a149-cf258712704c tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:09:11 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-8b4ae1c9-2cfc-4e65-a149-cf258712704c tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:09:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-8b4ae1c9-2cfc-4e65-a149-cf258712704c tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:11 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-8b4ae1c9-2cfc-4e65-a149-cf258712704c tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:09:11 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-8b4ae1c9-2cfc-4e65-a149-cf258712704c tempest-CreateVolumesFromSourceVolumeTest-935563814 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:09:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8b4ae1c9-2cfc-4e65-a149-cf258712704c tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-010a1ba8-c712-4fd8-a0b5-a310908b91dc 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:11 devstack sudo[107405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-010a1ba8-c712-4fd8-a0b5-a310908b91dc 1073741824 Jul 30 17:09:11 devstack sudo[107405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:11 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf389464-a55b-4e7e-ab3e-5261010e8710 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:09:11 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-cf389464-a55b-4e7e-ab3e-5261010e8710 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Flow 'volume_create_manager' (96749dcb-e94d-4c93-a520-4278d1fac79f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:09:11 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-cf389464-a55b-4e7e-ab3e-5261010e8710 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd3516b0-9c30-47ae-8f4e-5cf33e1ea0bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:11 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-cf389464-a55b-4e7e-ab3e-5261010e8710 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd3516b0-9c30-47ae-8f4e-5cf33e1ea0bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:09:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-872752257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3e766aa-1593-4c79-9b8b-76fb5f79a7f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65d5ac424f0740648ea187005a08d7cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:09:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:09:11Z,use_quota=True,user_id='53f420968a414070b5f9540c1b5facd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:11 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-cf389464-a55b-4e7e-ab3e-5261010e8710 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (835a53e5-1272-4a78-8978-0edc6b2126d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:11 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-cf389464-a55b-4e7e-ab3e-5261010e8710 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (835a53e5-1272-4a78-8978-0edc6b2126d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:11 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-cf389464-a55b-4e7e-ab3e-5261010e8710 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d7ce4e6-e2ba-446b-afab-cd61736dc40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:11 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-cf389464-a55b-4e7e-ab3e-5261010e8710 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d7ce4e6-e2ba-446b-afab-cd61736dc40b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3e766aa-1593-4c79-9b8b-76fb5f79a7f7', 'volume_name': 'volume-e3e766aa-1593-4c79-9b8b-76fb5f79a7f7', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:11 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-cf389464-a55b-4e7e-ab3e-5261010e8710 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1f1b21b-6d8e-45e7-a761-b2f9b306acdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:11 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-cf389464-a55b-4e7e-ab3e-5261010e8710 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1f1b21b-6d8e-45e7-a761-b2f9b306acdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:11 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-cf389464-a55b-4e7e-ab3e-5261010e8710 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cda7606-ea68-43a8-b6ad-2b768a647753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:11 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-cf389464-a55b-4e7e-ab3e-5261010e8710 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Volume e3e766aa-1593-4c79-9b8b-76fb5f79a7f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3e766aa-1593-4c79-9b8b-76fb5f79a7f7', 'volume_size': 1} Jul 30 17:09:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-cf389464-a55b-4e7e-ab3e-5261010e8710 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:11 devstack sudo[107405]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8b4ae1c9-2cfc-4e65-a149-cf258712704c tempest-CreateVolumesFromSourceVolumeTest-935563814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-010a1ba8-c712-4fd8-a0b5-a310908b91dc 1073741824" returned: 0 in 0.513s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8b4ae1c9-2cfc-4e65-a149-cf258712704c tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-010a1ba8-c712-4fd8-a0b5-a310908b91dc {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:11 devstack sudo[107411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-010a1ba8-c712-4fd8-a0b5-a310908b91dc Jul 30 17:09:11 devstack sudo[107411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:11 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b591696-4ae9-448b-be21-5fcca24d2ef1 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:09:11 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-6b591696-4ae9-448b-be21-5fcca24d2ef1 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Flow 'volume_create_manager' (ac020380-ebb5-4b89-9553-c6507e1f2978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:09:11 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-6b591696-4ae9-448b-be21-5fcca24d2ef1 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59d8da88-63a2-4b16-ab7e-75fd1b5edf3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:11 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-6b591696-4ae9-448b-be21-5fcca24d2ef1 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59d8da88-63a2-4b16-ab7e-75fd1b5edf3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:09:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1306857550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ab1bc3f-6a67-451b-a0c6-4b43776c7a52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65d5ac424f0740648ea187005a08d7cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:09:12Z,use_quota=True,user_id='53f420968a414070b5f9540c1b5facd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:11 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-6b591696-4ae9-448b-be21-5fcca24d2ef1 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (802d7524-6940-40a9-925a-347e4ada251b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:11 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-6b591696-4ae9-448b-be21-5fcca24d2ef1 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (802d7524-6940-40a9-925a-347e4ada251b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:11 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-6b591696-4ae9-448b-be21-5fcca24d2ef1 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f94fa48-8599-4bed-ae8f-84cb27aa5f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:11 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-6b591696-4ae9-448b-be21-5fcca24d2ef1 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f94fa48-8599-4bed-ae8f-84cb27aa5f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ab1bc3f-6a67-451b-a0c6-4b43776c7a52', 'volume_name': 'volume-7ab1bc3f-6a67-451b-a0c6-4b43776c7a52', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:11 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-6b591696-4ae9-448b-be21-5fcca24d2ef1 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dabc529-c38d-4412-a8fd-707a988006de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:11 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-6b591696-4ae9-448b-be21-5fcca24d2ef1 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dabc529-c38d-4412-a8fd-707a988006de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:11 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-6b591696-4ae9-448b-be21-5fcca24d2ef1 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6774d56-956e-4cc8-ae49-3ec78cd32e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:11 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-6b591696-4ae9-448b-be21-5fcca24d2ef1 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Volume 7ab1bc3f-6a67-451b-a0c6-4b43776c7a52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ab1bc3f-6a67-451b-a0c6-4b43776c7a52', 'volume_size': 1} Jul 30 17:09:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-6b591696-4ae9-448b-be21-5fcca24d2ef1 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:11 devstack sudo[107411]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8b4ae1c9-2cfc-4e65-a149-cf258712704c tempest-CreateVolumesFromSourceVolumeTest-935563814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-010a1ba8-c712-4fd8-a0b5-a310908b91dc" returned: 0 in 0.312s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:11 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-8b4ae1c9-2cfc-4e65-a149-cf258712704c tempest-CreateVolumesFromSourceVolumeTest-935563814 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:09:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-8b4ae1c9-2cfc-4e65-a149-cf258712704c tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-cf389464-a55b-4e7e-ab3e-5261010e8710 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.538s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:11 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-cf389464-a55b-4e7e-ab3e-5261010e8710 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:09:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-872752257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3e766aa-1593-4c79-9b8b-76fb5f79a7f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65d5ac424f0740648ea187005a08d7cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:09:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:09:11Z,use_quota=True,user_id='53f420968a414070b5f9540c1b5facd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:09:11 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-cf389464-a55b-4e7e-ab3e-5261010e8710 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Creating volume e3e766aa-1593-4c79-9b8b-76fb5f79a7f7 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:09:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-cf389464-a55b-4e7e-ab3e-5261010e8710 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-cf389464-a55b-4e7e-ab3e-5261010e8710 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:11 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-cf389464-a55b-4e7e-ab3e-5261010e8710 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:09:11 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-cf389464-a55b-4e7e-ab3e-5261010e8710 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:09:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-cf389464-a55b-4e7e-ab3e-5261010e8710 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:11 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-cf389464-a55b-4e7e-ab3e-5261010e8710 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:09:11 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-cf389464-a55b-4e7e-ab3e-5261010e8710 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:09:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-cf389464-a55b-4e7e-ab3e-5261010e8710 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e3e766aa-1593-4c79-9b8b-76fb5f79a7f7 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:11 devstack sudo[107414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e3e766aa-1593-4c79-9b8b-76fb5f79a7f7 1073741824 Jul 30 17:09:11 devstack sudo[107414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:11 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8b4ae1c9-2cfc-4e65-a149-cf258712704c tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25b4dda9-6c2b-45a9-bada-2ce39e63ed36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-010a1ba8-c712-4fd8-a0b5-a310908b91dc', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:11 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8b4ae1c9-2cfc-4e65-a149-cf258712704c tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6140b12-562a-4584-a232-44f5a7193491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:11 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-8b4ae1c9-2cfc-4e65-a149-cf258712704c tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Volume volume-010a1ba8-c712-4fd8-a0b5-a310908b91dc (010a1ba8-c712-4fd8-a0b5-a310908b91dc): created successfully Jul 30 17:09:11 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8b4ae1c9-2cfc-4e65-a149-cf258712704c tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6140b12-562a-4584-a232-44f5a7193491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:11 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8b4ae1c9-2cfc-4e65-a149-cf258712704c tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Flow 'volume_create_manager' (f4b04faf-0e81-45c6-ab01-f097bb6a9dd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:09:12 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-8b4ae1c9-2cfc-4e65-a149-cf258712704c tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Created volume successfully. Jul 30 17:09:12 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-a778d75c-d004-40d2-9f1d-a373c43c9abe tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:09:12 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a778d75c-d004-40d2-9f1d-a373c43c9abe tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Flow 'volume_create_manager' (ae3bb5b4-5bcb-4131-a230-da934c12e9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:09:12 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a778d75c-d004-40d2-9f1d-a373c43c9abe tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96a01e38-5b35-4a53-b3aa-e827760bfa6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:12 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a778d75c-d004-40d2-9f1d-a373c43c9abe tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96a01e38-5b35-4a53-b3aa-e827760bfa6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1823541781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=816dd1bd-d3a0-442e-a479-1857bd8834d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65d5ac424f0740648ea187005a08d7cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:09:12Z,use_quota=True,user_id='53f420968a414070b5f9540c1b5facd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:12 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a778d75c-d004-40d2-9f1d-a373c43c9abe tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa8652ac-d16a-47c9-9668-667756136402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:12 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a778d75c-d004-40d2-9f1d-a373c43c9abe tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa8652ac-d16a-47c9-9668-667756136402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:12 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a778d75c-d004-40d2-9f1d-a373c43c9abe tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1945b23-afcc-492e-af35-6e84d57f95a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:12 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a778d75c-d004-40d2-9f1d-a373c43c9abe tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1945b23-afcc-492e-af35-6e84d57f95a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '816dd1bd-d3a0-442e-a479-1857bd8834d0', 'volume_name': 'volume-816dd1bd-d3a0-442e-a479-1857bd8834d0', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:12 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a778d75c-d004-40d2-9f1d-a373c43c9abe tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e181e504-323b-4567-a1d6-1b245f959b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:12 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a778d75c-d004-40d2-9f1d-a373c43c9abe tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e181e504-323b-4567-a1d6-1b245f959b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:12 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a778d75c-d004-40d2-9f1d-a373c43c9abe tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (882ee609-a066-4f2c-b14d-8ea15d9118c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:12 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-a778d75c-d004-40d2-9f1d-a373c43c9abe tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Volume 816dd1bd-d3a0-442e-a479-1857bd8834d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-816dd1bd-d3a0-442e-a479-1857bd8834d0', 'volume_size': 1} Jul 30 17:09:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a778d75c-d004-40d2-9f1d-a373c43c9abe tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:12 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fd1da44-3d67-4aa6-978a-df3e70879c3f tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:09:12 devstack sudo[107414]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:12 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1fd1da44-3d67-4aa6-978a-df3e70879c3f tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Flow 'volume_create_manager' (499f013a-5527-4327-a7aa-33504e7b1b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:09:12 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1fd1da44-3d67-4aa6-978a-df3e70879c3f tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fd06c92-02ea-4cca-ae4c-64d318c3b0a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-cf389464-a55b-4e7e-ab3e-5261010e8710 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e3e766aa-1593-4c79-9b8b-76fb5f79a7f7 1073741824" returned: 0 in 0.534s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:12 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1fd1da44-3d67-4aa6-978a-df3e70879c3f tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fd06c92-02ea-4cca-ae4c-64d318c3b0a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-426743347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61d88803-a26f-40f9-9abc-cf115d117afe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65d5ac424f0740648ea187005a08d7cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:09:12Z,use_quota=True,user_id='53f420968a414070b5f9540c1b5facd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:12 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1fd1da44-3d67-4aa6-978a-df3e70879c3f tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d11abb2-6f56-401b-b43a-a06fdee9b4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:12 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1fd1da44-3d67-4aa6-978a-df3e70879c3f tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d11abb2-6f56-401b-b43a-a06fdee9b4f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:12 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1fd1da44-3d67-4aa6-978a-df3e70879c3f tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edf7d9e8-831c-4999-a0ed-58177a71b19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:12 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1fd1da44-3d67-4aa6-978a-df3e70879c3f tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edf7d9e8-831c-4999-a0ed-58177a71b19a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61d88803-a26f-40f9-9abc-cf115d117afe', 'volume_name': 'volume-61d88803-a26f-40f9-9abc-cf115d117afe', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:12 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1fd1da44-3d67-4aa6-978a-df3e70879c3f tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1829fa8f-d9e3-4fdd-ae33-5ea087b932f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:12 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1fd1da44-3d67-4aa6-978a-df3e70879c3f tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1829fa8f-d9e3-4fdd-ae33-5ea087b932f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:12 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1fd1da44-3d67-4aa6-978a-df3e70879c3f tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1625b30a-c4ed-4764-a53f-be13bef89e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:12 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-1fd1da44-3d67-4aa6-978a-df3e70879c3f tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Volume 61d88803-a26f-40f9-9abc-cf115d117afe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61d88803-a26f-40f9-9abc-cf115d117afe', 'volume_size': 1} Jul 30 17:09:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-1fd1da44-3d67-4aa6-978a-df3e70879c3f tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-cf389464-a55b-4e7e-ab3e-5261010e8710 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e3e766aa-1593-4c79-9b8b-76fb5f79a7f7 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:12 devstack sudo[107420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e3e766aa-1593-4c79-9b8b-76fb5f79a7f7 Jul 30 17:09:12 devstack sudo[107420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:12 devstack sudo[107420]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-cf389464-a55b-4e7e-ab3e-5261010e8710 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e3e766aa-1593-4c79-9b8b-76fb5f79a7f7" returned: 0 in 0.238s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:12 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-cf389464-a55b-4e7e-ab3e-5261010e8710 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:09:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-cf389464-a55b-4e7e-ab3e-5261010e8710 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-6b591696-4ae9-448b-be21-5fcca24d2ef1 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.028s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:12 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-6b591696-4ae9-448b-be21-5fcca24d2ef1 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:09:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1306857550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ab1bc3f-6a67-451b-a0c6-4b43776c7a52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65d5ac424f0740648ea187005a08d7cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:09:12Z,use_quota=True,user_id='53f420968a414070b5f9540c1b5facd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:09:12 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-6b591696-4ae9-448b-be21-5fcca24d2ef1 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Creating volume 7ab1bc3f-6a67-451b-a0c6-4b43776c7a52 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:09:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-6b591696-4ae9-448b-be21-5fcca24d2ef1 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-6b591696-4ae9-448b-be21-5fcca24d2ef1 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:12 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-6b591696-4ae9-448b-be21-5fcca24d2ef1 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:09:12 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-6b591696-4ae9-448b-be21-5fcca24d2ef1 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:09:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-6b591696-4ae9-448b-be21-5fcca24d2ef1 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:12 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-6b591696-4ae9-448b-be21-5fcca24d2ef1 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:09:12 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-6b591696-4ae9-448b-be21-5fcca24d2ef1 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:09:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-6b591696-4ae9-448b-be21-5fcca24d2ef1 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7ab1bc3f-6a67-451b-a0c6-4b43776c7a52 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:12 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-cf389464-a55b-4e7e-ab3e-5261010e8710 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cda7606-ea68-43a8-b6ad-2b768a647753) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3e766aa-1593-4c79-9b8b-76fb5f79a7f7', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:12 devstack sudo[107425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7ab1bc3f-6a67-451b-a0c6-4b43776c7a52 1073741824 Jul 30 17:09:12 devstack sudo[107425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:12 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-cf389464-a55b-4e7e-ab3e-5261010e8710 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9a92c1a-384f-4e27-81a7-cba14901542f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:12 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-cf389464-a55b-4e7e-ab3e-5261010e8710 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Volume volume-e3e766aa-1593-4c79-9b8b-76fb5f79a7f7 (e3e766aa-1593-4c79-9b8b-76fb5f79a7f7): created successfully Jul 30 17:09:12 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-cf389464-a55b-4e7e-ab3e-5261010e8710 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9a92c1a-384f-4e27-81a7-cba14901542f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:12 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-cf389464-a55b-4e7e-ab3e-5261010e8710 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Flow 'volume_create_manager' (96749dcb-e94d-4c93-a520-4278d1fac79f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:09:12 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-cf389464-a55b-4e7e-ab3e-5261010e8710 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Created volume successfully. Jul 30 17:09:13 devstack sudo[107425]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-6b591696-4ae9-448b-be21-5fcca24d2ef1 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7ab1bc3f-6a67-451b-a0c6-4b43776c7a52 1073741824" returned: 0 in 0.443s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-6b591696-4ae9-448b-be21-5fcca24d2ef1 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7ab1bc3f-6a67-451b-a0c6-4b43776c7a52 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:13 devstack sudo[107431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7ab1bc3f-6a67-451b-a0c6-4b43776c7a52 Jul 30 17:09:13 devstack sudo[107431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:13 devstack sudo[107431]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-6b591696-4ae9-448b-be21-5fcca24d2ef1 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7ab1bc3f-6a67-451b-a0c6-4b43776c7a52" returned: 0 in 0.251s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:13 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-6b591696-4ae9-448b-be21-5fcca24d2ef1 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:09:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-6b591696-4ae9-448b-be21-5fcca24d2ef1 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a778d75c-d004-40d2-9f1d-a373c43c9abe tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.405s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:13 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-a778d75c-d004-40d2-9f1d-a373c43c9abe tempest-CreateVolumesFromSourceVolumeTest-935563814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1823541781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=816dd1bd-d3a0-442e-a479-1857bd8834d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65d5ac424f0740648ea187005a08d7cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:09:12Z,use_quota=True,user_id='53f420968a414070b5f9540c1b5facd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:09:13 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-a778d75c-d004-40d2-9f1d-a373c43c9abe tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Creating volume 816dd1bd-d3a0-442e-a479-1857bd8834d0 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:09:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a778d75c-d004-40d2-9f1d-a373c43c9abe tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a778d75c-d004-40d2-9f1d-a373c43c9abe tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:13 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-a778d75c-d004-40d2-9f1d-a373c43c9abe tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:09:13 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-a778d75c-d004-40d2-9f1d-a373c43c9abe tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:09:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a778d75c-d004-40d2-9f1d-a373c43c9abe tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:13 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-a778d75c-d004-40d2-9f1d-a373c43c9abe tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:09:13 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-a778d75c-d004-40d2-9f1d-a373c43c9abe tempest-CreateVolumesFromSourceVolumeTest-935563814 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:09:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a778d75c-d004-40d2-9f1d-a373c43c9abe tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-816dd1bd-d3a0-442e-a479-1857bd8834d0 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:13 devstack sudo[107434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-816dd1bd-d3a0-442e-a479-1857bd8834d0 1073741824 Jul 30 17:09:13 devstack sudo[107434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:13 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-6b591696-4ae9-448b-be21-5fcca24d2ef1 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6774d56-956e-4cc8-ae49-3ec78cd32e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ab1bc3f-6a67-451b-a0c6-4b43776c7a52', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:13 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-6b591696-4ae9-448b-be21-5fcca24d2ef1 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c5d2de5-0850-4ab3-a188-6074fec636c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:13 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-6b591696-4ae9-448b-be21-5fcca24d2ef1 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Volume volume-7ab1bc3f-6a67-451b-a0c6-4b43776c7a52 (7ab1bc3f-6a67-451b-a0c6-4b43776c7a52): created successfully Jul 30 17:09:13 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-6b591696-4ae9-448b-be21-5fcca24d2ef1 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c5d2de5-0850-4ab3-a188-6074fec636c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:13 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-6b591696-4ae9-448b-be21-5fcca24d2ef1 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Flow 'volume_create_manager' (ac020380-ebb5-4b89-9553-c6507e1f2978) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:09:13 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-6b591696-4ae9-448b-be21-5fcca24d2ef1 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Created volume successfully. Jul 30 17:09:13 devstack sudo[107434]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a778d75c-d004-40d2-9f1d-a373c43c9abe tempest-CreateVolumesFromSourceVolumeTest-935563814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-816dd1bd-d3a0-442e-a479-1857bd8834d0 1073741824" returned: 0 in 0.420s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a778d75c-d004-40d2-9f1d-a373c43c9abe tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-816dd1bd-d3a0-442e-a479-1857bd8834d0 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:13 devstack sudo[107439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-816dd1bd-d3a0-442e-a479-1857bd8834d0 Jul 30 17:09:13 devstack sudo[107439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:14 devstack sudo[107439]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a778d75c-d004-40d2-9f1d-a373c43c9abe tempest-CreateVolumesFromSourceVolumeTest-935563814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-816dd1bd-d3a0-442e-a479-1857bd8834d0" returned: 0 in 0.258s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:14 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-a778d75c-d004-40d2-9f1d-a373c43c9abe tempest-CreateVolumesFromSourceVolumeTest-935563814 None] <== create_volume: return (721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:09:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a778d75c-d004-40d2-9f1d-a373c43c9abe tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-1fd1da44-3d67-4aa6-978a-df3e70879c3f tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.739s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:14 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-1fd1da44-3d67-4aa6-978a-df3e70879c3f tempest-CreateVolumesFromSourceVolumeTest-935563814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-426743347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61d88803-a26f-40f9-9abc-cf115d117afe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65d5ac424f0740648ea187005a08d7cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:09:12Z,use_quota=True,user_id='53f420968a414070b5f9540c1b5facd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:09:14 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-1fd1da44-3d67-4aa6-978a-df3e70879c3f tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Creating volume 61d88803-a26f-40f9-9abc-cf115d117afe {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:09:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-1fd1da44-3d67-4aa6-978a-df3e70879c3f tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-1fd1da44-3d67-4aa6-978a-df3e70879c3f tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:14 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-1fd1da44-3d67-4aa6-978a-df3e70879c3f tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:09:14 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-1fd1da44-3d67-4aa6-978a-df3e70879c3f tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:09:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-1fd1da44-3d67-4aa6-978a-df3e70879c3f tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:14 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-1fd1da44-3d67-4aa6-978a-df3e70879c3f tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:09:14 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-1fd1da44-3d67-4aa6-978a-df3e70879c3f tempest-CreateVolumesFromSourceVolumeTest-935563814 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:09:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-1fd1da44-3d67-4aa6-978a-df3e70879c3f tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-61d88803-a26f-40f9-9abc-cf115d117afe 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:14 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a778d75c-d004-40d2-9f1d-a373c43c9abe tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (882ee609-a066-4f2c-b14d-8ea15d9118c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-816dd1bd-d3a0-442e-a479-1857bd8834d0', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:14 devstack sudo[107442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-61d88803-a26f-40f9-9abc-cf115d117afe 1073741824 Jul 30 17:09:14 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a778d75c-d004-40d2-9f1d-a373c43c9abe tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11c7ea51-795a-441d-bfa7-bb5d09e51db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:14 devstack sudo[107442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:14 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-a778d75c-d004-40d2-9f1d-a373c43c9abe tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Volume volume-816dd1bd-d3a0-442e-a479-1857bd8834d0 (816dd1bd-d3a0-442e-a479-1857bd8834d0): created successfully Jul 30 17:09:14 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a778d75c-d004-40d2-9f1d-a373c43c9abe tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11c7ea51-795a-441d-bfa7-bb5d09e51db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:14 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a778d75c-d004-40d2-9f1d-a373c43c9abe tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Flow 'volume_create_manager' (ae3bb5b4-5bcb-4131-a230-da934c12e9d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:09:14 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-a778d75c-d004-40d2-9f1d-a373c43c9abe tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Created volume successfully. Jul 30 17:09:14 devstack sudo[107442]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-1fd1da44-3d67-4aa6-978a-df3e70879c3f tempest-CreateVolumesFromSourceVolumeTest-935563814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-61d88803-a26f-40f9-9abc-cf115d117afe 1073741824" returned: 0 in 0.450s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-1fd1da44-3d67-4aa6-978a-df3e70879c3f tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-61d88803-a26f-40f9-9abc-cf115d117afe {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:14 devstack sudo[107448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-61d88803-a26f-40f9-9abc-cf115d117afe Jul 30 17:09:14 devstack sudo[107448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:14 devstack sudo[107448]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-1fd1da44-3d67-4aa6-978a-df3e70879c3f tempest-CreateVolumesFromSourceVolumeTest-935563814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-61d88803-a26f-40f9-9abc-cf115d117afe" returned: 0 in 0.259s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:14 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-1fd1da44-3d67-4aa6-978a-df3e70879c3f tempest-CreateVolumesFromSourceVolumeTest-935563814 None] <== create_volume: return (745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:09:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-1fd1da44-3d67-4aa6-978a-df3e70879c3f tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:14 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1fd1da44-3d67-4aa6-978a-df3e70879c3f tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1625b30a-c4ed-4764-a53f-be13bef89e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61d88803-a26f-40f9-9abc-cf115d117afe', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:14 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1fd1da44-3d67-4aa6-978a-df3e70879c3f tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf0c09a3-e054-43fa-868b-90e8a130dcb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:15 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-1fd1da44-3d67-4aa6-978a-df3e70879c3f tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Volume volume-61d88803-a26f-40f9-9abc-cf115d117afe (61d88803-a26f-40f9-9abc-cf115d117afe): created successfully Jul 30 17:09:15 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1fd1da44-3d67-4aa6-978a-df3e70879c3f tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf0c09a3-e054-43fa-868b-90e8a130dcb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:15 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1fd1da44-3d67-4aa6-978a-df3e70879c3f tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Flow 'volume_create_manager' (499f013a-5527-4327-a7aa-33504e7b1b1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:09:15 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-1fd1da44-3d67-4aa6-978a-df3e70879c3f tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Created volume successfully. Jul 30 17:09:15 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-bc4ddd44-922a-4d79-a747-334ee00b31bd tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Acquiring lock "cinder-61d88803-a26f-40f9-9abc-cf115d117afe-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:15 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-bc4ddd44-922a-4d79-a747-334ee00b31bd tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Lock "cinder-61d88803-a26f-40f9-9abc-cf115d117afe-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:15 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-bc4ddd44-922a-4d79-a747-334ee00b31bd tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Acquiring lock "cinder-quobyte-61d88803-a26f-40f9-9abc-cf115d117afe" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:15 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-bc4ddd44-922a-4d79-a747-334ee00b31bd tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Lock "cinder-quobyte-61d88803-a26f-40f9-9abc-cf115d117afe" acquired by "delete_volume" :: waited 0.016s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:15 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ff98b3-ef96-4970-bfd7-e060566491da]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:09:15 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-bc4ddd44-922a-4d79-a747-334ee00b31bd tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-61d88803-a26f-40f9-9abc-cf115d117afe {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:15 devstack sudo[107452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-61d88803-a26f-40f9-9abc-cf115d117afe Jul 30 17:09:15 devstack sudo[107452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:16 devstack sudo[107452]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:16 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-bc4ddd44-922a-4d79-a747-334ee00b31bd tempest-CreateVolumesFromSourceVolumeTest-935563814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-61d88803-a26f-40f9-9abc-cf115d117afe" returned: 0 in 0.351s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:16 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-bc4ddd44-922a-4d79-a747-334ee00b31bd tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-61d88803-a26f-40f9-9abc-cf115d117afe {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:16 devstack sudo[107457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-61d88803-a26f-40f9-9abc-cf115d117afe Jul 30 17:09:16 devstack sudo[107457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:16 devstack sudo[107457]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:16 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-bc4ddd44-922a-4d79-a747-334ee00b31bd tempest-CreateVolumesFromSourceVolumeTest-935563814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-61d88803-a26f-40f9-9abc-cf115d117afe" returned: 0 in 0.255s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:16 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-bc4ddd44-922a-4d79-a747-334ee00b31bd tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Lock "cinder-quobyte-61d88803-a26f-40f9-9abc-cf115d117afe" released by "delete_volume" :: held 0.645s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:16 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-bc4ddd44-922a-4d79-a747-334ee00b31bd tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Created reservations ['435e9b63-7f45-43c5-ba88-00f3081e1639', 'a3bac161-5771-454e-b93e-93366b7c0f1b', '0a907f69-af88-4608-9f06-666fa6ad72f5', '1723f89c-a08b-47bb-88a4-b5e0b047a91f'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:09:16 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-bc4ddd44-922a-4d79-a747-334ee00b31bd tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:16 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-bc4ddd44-922a-4d79-a747-334ee00b31bd tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:16 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-bc4ddd44-922a-4d79-a747-334ee00b31bd tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:09:16 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-bc4ddd44-922a-4d79-a747-334ee00b31bd tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:09:16 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-bc4ddd44-922a-4d79-a747-334ee00b31bd tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:16 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-bc4ddd44-922a-4d79-a747-334ee00b31bd tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:16 devstack sudo[107460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:09:16 devstack sudo[107460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:16 devstack sudo[107460]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:16 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-bc4ddd44-922a-4d79-a747-334ee00b31bd tempest-CreateVolumesFromSourceVolumeTest-935563814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.262s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:16 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-bc4ddd44-922a-4d79-a747-334ee00b31bd tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:09:16 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-bc4ddd44-922a-4d79-a747-334ee00b31bd tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Deleted volume successfully. Jul 30 17:09:16 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-bc4ddd44-922a-4d79-a747-334ee00b31bd tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Lock "cinder-61d88803-a26f-40f9-9abc-cf115d117afe-delete_volume" released by "delete_volume" :: held 1.106s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:16 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-f225dee1-58a6-4006-a0a9-179c6b97f95c tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Acquiring lock "cinder-816dd1bd-d3a0-442e-a479-1857bd8834d0-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:16 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-f225dee1-58a6-4006-a0a9-179c6b97f95c tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Lock "cinder-816dd1bd-d3a0-442e-a479-1857bd8834d0-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:16 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-f225dee1-58a6-4006-a0a9-179c6b97f95c tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Acquiring lock "cinder-quobyte-816dd1bd-d3a0-442e-a479-1857bd8834d0" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:17 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-f225dee1-58a6-4006-a0a9-179c6b97f95c tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Lock "cinder-quobyte-816dd1bd-d3a0-442e-a479-1857bd8834d0" acquired by "delete_volume" :: waited 0.014s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:17 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[b728ba47-4f85-472c-9df0-b1bb4bb67bb9]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:09:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f225dee1-58a6-4006-a0a9-179c6b97f95c tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-816dd1bd-d3a0-442e-a479-1857bd8834d0 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:17 devstack sudo[107463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-816dd1bd-d3a0-442e-a479-1857bd8834d0 Jul 30 17:09:17 devstack sudo[107463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:17 devstack sudo[107463]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f225dee1-58a6-4006-a0a9-179c6b97f95c tempest-CreateVolumesFromSourceVolumeTest-935563814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-816dd1bd-d3a0-442e-a479-1857bd8834d0" returned: 0 in 0.349s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f225dee1-58a6-4006-a0a9-179c6b97f95c tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-816dd1bd-d3a0-442e-a479-1857bd8834d0 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:17 devstack sudo[107468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-816dd1bd-d3a0-442e-a479-1857bd8834d0 Jul 30 17:09:17 devstack sudo[107468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:17 devstack sudo[107468]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f225dee1-58a6-4006-a0a9-179c6b97f95c tempest-CreateVolumesFromSourceVolumeTest-935563814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-816dd1bd-d3a0-442e-a479-1857bd8834d0" returned: 0 in 0.233s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:17 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-f225dee1-58a6-4006-a0a9-179c6b97f95c tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Lock "cinder-quobyte-816dd1bd-d3a0-442e-a479-1857bd8834d0" released by "delete_volume" :: held 0.618s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:17 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-f225dee1-58a6-4006-a0a9-179c6b97f95c tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Created reservations ['dbe21e81-cc64-4ba2-bdd7-4512fa0077fe', 'b2301918-4708-4596-bfd7-619f1f514844', '0cb6a236-b142-4790-8e59-bd41b46c2e07', '85adc1f0-48a2-49f1-9db1-0f30dbf323d6'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:09:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-f225dee1-58a6-4006-a0a9-179c6b97f95c tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-f225dee1-58a6-4006-a0a9-179c6b97f95c tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:17 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-f225dee1-58a6-4006-a0a9-179c6b97f95c tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:09:17 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-f225dee1-58a6-4006-a0a9-179c6b97f95c tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:09:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-f225dee1-58a6-4006-a0a9-179c6b97f95c tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f225dee1-58a6-4006-a0a9-179c6b97f95c tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:17 devstack sudo[107471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:09:17 devstack sudo[107471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:17 devstack sudo[107471]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f225dee1-58a6-4006-a0a9-179c6b97f95c tempest-CreateVolumesFromSourceVolumeTest-935563814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.238s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:17 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-f225dee1-58a6-4006-a0a9-179c6b97f95c tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:09:17 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-f225dee1-58a6-4006-a0a9-179c6b97f95c tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Deleted volume successfully. Jul 30 17:09:17 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-f225dee1-58a6-4006-a0a9-179c6b97f95c tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Lock "cinder-816dd1bd-d3a0-442e-a479-1857bd8834d0-delete_volume" released by "delete_volume" :: held 1.039s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:18 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-4c4b989d-3b45-4435-b909-a29b92694fc6 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Acquiring lock "cinder-7ab1bc3f-6a67-451b-a0c6-4b43776c7a52-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:18 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-4c4b989d-3b45-4435-b909-a29b92694fc6 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Lock "cinder-7ab1bc3f-6a67-451b-a0c6-4b43776c7a52-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:18 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-4c4b989d-3b45-4435-b909-a29b92694fc6 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Acquiring lock "cinder-quobyte-7ab1bc3f-6a67-451b-a0c6-4b43776c7a52" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:18 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-4c4b989d-3b45-4435-b909-a29b92694fc6 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Lock "cinder-quobyte-7ab1bc3f-6a67-451b-a0c6-4b43776c7a52" acquired by "delete_volume" :: waited 0.013s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:18 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[e829d1f4-765b-4716-90a3-8f7263666822]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:09:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-4c4b989d-3b45-4435-b909-a29b92694fc6 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7ab1bc3f-6a67-451b-a0c6-4b43776c7a52 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:18 devstack sudo[107474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7ab1bc3f-6a67-451b-a0c6-4b43776c7a52 Jul 30 17:09:18 devstack sudo[107474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:18 devstack sudo[107474]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-4c4b989d-3b45-4435-b909-a29b92694fc6 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7ab1bc3f-6a67-451b-a0c6-4b43776c7a52" returned: 0 in 0.351s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-4c4b989d-3b45-4435-b909-a29b92694fc6 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7ab1bc3f-6a67-451b-a0c6-4b43776c7a52 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:18 devstack sudo[107479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7ab1bc3f-6a67-451b-a0c6-4b43776c7a52 Jul 30 17:09:18 devstack sudo[107479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:18 devstack sudo[107479]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-4c4b989d-3b45-4435-b909-a29b92694fc6 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7ab1bc3f-6a67-451b-a0c6-4b43776c7a52" returned: 0 in 0.253s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:18 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-4c4b989d-3b45-4435-b909-a29b92694fc6 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Lock "cinder-quobyte-7ab1bc3f-6a67-451b-a0c6-4b43776c7a52" released by "delete_volume" :: held 0.645s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:18 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-4c4b989d-3b45-4435-b909-a29b92694fc6 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Created reservations ['63257b09-1613-4a63-8c87-ef3fba97277e', '77264799-d67a-4037-8978-93826ab31e12', '49db5682-a423-40ef-abc5-278022b3966f', 'e04fe4bc-05e7-46f7-a1dd-a952b2e2d803'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:09:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-4c4b989d-3b45-4435-b909-a29b92694fc6 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-4c4b989d-3b45-4435-b909-a29b92694fc6 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:18 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-4c4b989d-3b45-4435-b909-a29b92694fc6 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:09:18 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-4c4b989d-3b45-4435-b909-a29b92694fc6 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:09:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-4c4b989d-3b45-4435-b909-a29b92694fc6 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-4c4b989d-3b45-4435-b909-a29b92694fc6 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:18 devstack sudo[107482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:09:18 devstack sudo[107482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:19 devstack sudo[107482]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:19 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-4c4b989d-3b45-4435-b909-a29b92694fc6 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.237s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:19 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-4c4b989d-3b45-4435-b909-a29b92694fc6 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:09:19 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-4c4b989d-3b45-4435-b909-a29b92694fc6 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Deleted volume successfully. Jul 30 17:09:19 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-4c4b989d-3b45-4435-b909-a29b92694fc6 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Lock "cinder-7ab1bc3f-6a67-451b-a0c6-4b43776c7a52-delete_volume" released by "delete_volume" :: held 1.072s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:19 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-0c84b6e0-d919-4399-923a-b5e2b6415747 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Acquiring lock "cinder-e3e766aa-1593-4c79-9b8b-76fb5f79a7f7-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:19 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-0c84b6e0-d919-4399-923a-b5e2b6415747 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Lock "cinder-e3e766aa-1593-4c79-9b8b-76fb5f79a7f7-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:19 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-0c84b6e0-d919-4399-923a-b5e2b6415747 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Acquiring lock "cinder-quobyte-e3e766aa-1593-4c79-9b8b-76fb5f79a7f7" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:19 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-0c84b6e0-d919-4399-923a-b5e2b6415747 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Lock "cinder-quobyte-e3e766aa-1593-4c79-9b8b-76fb5f79a7f7" acquired by "delete_volume" :: waited 0.013s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:19 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd4b9cca-6dfb-440d-bfa4-c19cb66c9db1]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:09:19 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0c84b6e0-d919-4399-923a-b5e2b6415747 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e3e766aa-1593-4c79-9b8b-76fb5f79a7f7 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:19 devstack sudo[107485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e3e766aa-1593-4c79-9b8b-76fb5f79a7f7 Jul 30 17:09:19 devstack sudo[107485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:19 devstack sudo[107485]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:19 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0c84b6e0-d919-4399-923a-b5e2b6415747 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e3e766aa-1593-4c79-9b8b-76fb5f79a7f7" returned: 0 in 0.344s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:19 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0c84b6e0-d919-4399-923a-b5e2b6415747 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e3e766aa-1593-4c79-9b8b-76fb5f79a7f7 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:19 devstack sudo[107490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e3e766aa-1593-4c79-9b8b-76fb5f79a7f7 Jul 30 17:09:19 devstack sudo[107490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:19 devstack sudo[107490]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:19 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0c84b6e0-d919-4399-923a-b5e2b6415747 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e3e766aa-1593-4c79-9b8b-76fb5f79a7f7" returned: 0 in 0.241s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:19 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-0c84b6e0-d919-4399-923a-b5e2b6415747 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Lock "cinder-quobyte-e3e766aa-1593-4c79-9b8b-76fb5f79a7f7" released by "delete_volume" :: held 0.620s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:19 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-0c84b6e0-d919-4399-923a-b5e2b6415747 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Created reservations ['046e0cc2-9d46-4e79-ad6b-1b14049e3b9c', '6dbe3fd9-5335-461a-b3f0-0bbd603867b8', 'a7b34c7b-dfbd-497e-a4ba-9c1c22c481ba', 'f1679b57-be72-430d-a12d-12f931785c92'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:09:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-0c84b6e0-d919-4399-923a-b5e2b6415747 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-0c84b6e0-d919-4399-923a-b5e2b6415747 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:20 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-0c84b6e0-d919-4399-923a-b5e2b6415747 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:09:20 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-0c84b6e0-d919-4399-923a-b5e2b6415747 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:09:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-0c84b6e0-d919-4399-923a-b5e2b6415747 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0c84b6e0-d919-4399-923a-b5e2b6415747 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:20 devstack sudo[107493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:09:20 devstack sudo[107493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:20 devstack sudo[107493]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0c84b6e0-d919-4399-923a-b5e2b6415747 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.249s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:20 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-0c84b6e0-d919-4399-923a-b5e2b6415747 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:09:20 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-0c84b6e0-d919-4399-923a-b5e2b6415747 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Deleted volume successfully. Jul 30 17:09:20 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-0c84b6e0-d919-4399-923a-b5e2b6415747 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Lock "cinder-e3e766aa-1593-4c79-9b8b-76fb5f79a7f7-delete_volume" released by "delete_volume" :: held 1.045s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:20 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-db9093da-e100-49c9-8721-991cd095e772 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Acquiring lock "cinder-010a1ba8-c712-4fd8-a0b5-a310908b91dc-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:20 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-db9093da-e100-49c9-8721-991cd095e772 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Lock "cinder-010a1ba8-c712-4fd8-a0b5-a310908b91dc-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:20 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-db9093da-e100-49c9-8721-991cd095e772 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Acquiring lock "cinder-quobyte-010a1ba8-c712-4fd8-a0b5-a310908b91dc" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:20 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-db9093da-e100-49c9-8721-991cd095e772 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Lock "cinder-quobyte-010a1ba8-c712-4fd8-a0b5-a310908b91dc" acquired by "delete_volume" :: waited 0.015s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:20 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[cccc22ac-da9f-4846-8c3d-03c23e897471]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:09:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-db9093da-e100-49c9-8721-991cd095e772 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-010a1ba8-c712-4fd8-a0b5-a310908b91dc {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:20 devstack sudo[107496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-010a1ba8-c712-4fd8-a0b5-a310908b91dc Jul 30 17:09:20 devstack sudo[107496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:20 devstack sudo[107496]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-db9093da-e100-49c9-8721-991cd095e772 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-010a1ba8-c712-4fd8-a0b5-a310908b91dc" returned: 0 in 0.359s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-db9093da-e100-49c9-8721-991cd095e772 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-010a1ba8-c712-4fd8-a0b5-a310908b91dc {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:20 devstack sudo[107501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-010a1ba8-c712-4fd8-a0b5-a310908b91dc Jul 30 17:09:20 devstack sudo[107501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:21 devstack sudo[107501]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:21 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-db9093da-e100-49c9-8721-991cd095e772 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-010a1ba8-c712-4fd8-a0b5-a310908b91dc" returned: 0 in 0.248s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:21 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-db9093da-e100-49c9-8721-991cd095e772 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Lock "cinder-quobyte-010a1ba8-c712-4fd8-a0b5-a310908b91dc" released by "delete_volume" :: held 0.642s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:21 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-db9093da-e100-49c9-8721-991cd095e772 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Created reservations ['20552388-ba93-44ff-a34e-86617624c3a2', '6a74e288-21b0-492c-bd91-be13cbce4e6f', 'adafa3b8-dc3e-4312-a5bd-d4830735b24e', '096cc0c4-1608-4db5-b757-efb7bd6d7106'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:09:21 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-db9093da-e100-49c9-8721-991cd095e772 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:21 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-db9093da-e100-49c9-8721-991cd095e772 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:21 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-db9093da-e100-49c9-8721-991cd095e772 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:09:21 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-db9093da-e100-49c9-8721-991cd095e772 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:09:21 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-db9093da-e100-49c9-8721-991cd095e772 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:21 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-db9093da-e100-49c9-8721-991cd095e772 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:21 devstack sudo[107504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:09:21 devstack sudo[107504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:21 devstack sudo[107504]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:21 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-db9093da-e100-49c9-8721-991cd095e772 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.245s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:21 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-db9093da-e100-49c9-8721-991cd095e772 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:09:21 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-db9093da-e100-49c9-8721-991cd095e772 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Deleted volume successfully. Jul 30 17:09:21 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-db9093da-e100-49c9-8721-991cd095e772 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Lock "cinder-010a1ba8-c712-4fd8-a0b5-a310908b91dc-delete_volume" released by "delete_volume" :: held 1.088s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:21 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-51b0cb24-ee37-4262-b956-3d6c16d7e6c6 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Acquiring lock "cinder-f54395b8-e9a8-430b-a17d-624d4dfe95af-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:21 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-51b0cb24-ee37-4262-b956-3d6c16d7e6c6 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Lock "cinder-f54395b8-e9a8-430b-a17d-624d4dfe95af-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:21 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-51b0cb24-ee37-4262-b956-3d6c16d7e6c6 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Acquiring lock "cinder-quobyte-f54395b8-e9a8-430b-a17d-624d4dfe95af" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:21 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-51b0cb24-ee37-4262-b956-3d6c16d7e6c6 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Lock "cinder-quobyte-f54395b8-e9a8-430b-a17d-624d4dfe95af" acquired by "delete_volume" :: waited 0.014s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:21 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[96483699-85ce-4da4-bc37-49e12cf6313c]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:09:21 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-51b0cb24-ee37-4262-b956-3d6c16d7e6c6 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f54395b8-e9a8-430b-a17d-624d4dfe95af {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:21 devstack sudo[107507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f54395b8-e9a8-430b-a17d-624d4dfe95af Jul 30 17:09:21 devstack sudo[107507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:21 devstack sudo[107507]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:21 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-51b0cb24-ee37-4262-b956-3d6c16d7e6c6 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f54395b8-e9a8-430b-a17d-624d4dfe95af" returned: 0 in 0.349s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:21 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-51b0cb24-ee37-4262-b956-3d6c16d7e6c6 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f54395b8-e9a8-430b-a17d-624d4dfe95af {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:22 devstack sudo[107512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f54395b8-e9a8-430b-a17d-624d4dfe95af Jul 30 17:09:22 devstack sudo[107512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:22 devstack sudo[107512]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:22 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-51b0cb24-ee37-4262-b956-3d6c16d7e6c6 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f54395b8-e9a8-430b-a17d-624d4dfe95af" returned: 0 in 0.246s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:22 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-51b0cb24-ee37-4262-b956-3d6c16d7e6c6 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Lock "cinder-quobyte-f54395b8-e9a8-430b-a17d-624d4dfe95af" released by "delete_volume" :: held 0.633s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:22 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-51b0cb24-ee37-4262-b956-3d6c16d7e6c6 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Created reservations ['3aad6cda-0ae8-4b1e-92bb-950c963e7fe3', '3ae9ea99-9e03-4fa2-ac08-8a5b37ae0afb', 'd5c25d78-d086-4303-9131-6572728a9879', 'a338ed5c-a21a-4a02-9a11-6efca78380fd'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:09:22 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-51b0cb24-ee37-4262-b956-3d6c16d7e6c6 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:22 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-51b0cb24-ee37-4262-b956-3d6c16d7e6c6 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:22 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-51b0cb24-ee37-4262-b956-3d6c16d7e6c6 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:09:22 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-51b0cb24-ee37-4262-b956-3d6c16d7e6c6 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:09:22 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-51b0cb24-ee37-4262-b956-3d6c16d7e6c6 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:22 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-51b0cb24-ee37-4262-b956-3d6c16d7e6c6 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:22 devstack sudo[107515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:09:22 devstack sudo[107515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:22 devstack sudo[107515]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:22 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-51b0cb24-ee37-4262-b956-3d6c16d7e6c6 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.238s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:22 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-51b0cb24-ee37-4262-b956-3d6c16d7e6c6 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:09:22 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-51b0cb24-ee37-4262-b956-3d6c16d7e6c6 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Deleted volume successfully. Jul 30 17:09:22 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-51b0cb24-ee37-4262-b956-3d6c16d7e6c6 tempest-CreateVolumesFromSourceVolumeTest-935563814 None] Lock "cinder-f54395b8-e9a8-430b-a17d-624d4dfe95af-delete_volume" released by "delete_volume" :: held 1.066s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:32 devstack cinder-volume[88568]: DEBUG dbcounter [-] [88568] Writing DB stats cinder:SELECT=73,cinder:INSERT=29,cinder:UPDATE=133,cinder:DELETE=14 {{(pid=88568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 17:09:32 devstack cinder-volume[88568]: DEBUG dbcounter [-] [88568] Writing DB stats cinder:SELECT=94,cinder:UPDATE=126,cinder:INSERT=30,cinder:DELETE=9 {{(pid=88568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 17:09:48 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-def6f069-ceb9-42d7-b49a-27eafd2de59a tempest-SnapshotDependencyTests-2006895361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:09:48 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-def6f069-ceb9-42d7-b49a-27eafd2de59a tempest-SnapshotDependencyTests-2006895361 None] Flow 'volume_create_manager' (4f420296-c05b-47ab-bf35-ad2674ae64d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:09:48 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-def6f069-ceb9-42d7-b49a-27eafd2de59a tempest-SnapshotDependencyTests-2006895361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (906e7048-68f7-417c-a71d-1fcd848501ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:48 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-def6f069-ceb9-42d7-b49a-27eafd2de59a tempest-SnapshotDependencyTests-2006895361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (906e7048-68f7-417c-a71d-1fcd848501ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:09:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1344997117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62de100b-2d51-41e8-92de-f10580a257df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4be0d2ac1ad42eabe3deaf28f274c5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:09:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:09:49Z,use_quota=True,user_id='7ca35ff42c0c41528750d85f9f9650cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:48 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-def6f069-ceb9-42d7-b49a-27eafd2de59a tempest-SnapshotDependencyTests-2006895361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c02514a-4404-436a-ad97-86a21fe21582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:48 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-def6f069-ceb9-42d7-b49a-27eafd2de59a tempest-SnapshotDependencyTests-2006895361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c02514a-4404-436a-ad97-86a21fe21582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:48 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-def6f069-ceb9-42d7-b49a-27eafd2de59a tempest-SnapshotDependencyTests-2006895361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17047a25-4d5f-46c1-8278-c1263a3b8283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:48 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-def6f069-ceb9-42d7-b49a-27eafd2de59a tempest-SnapshotDependencyTests-2006895361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17047a25-4d5f-46c1-8278-c1263a3b8283) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62de100b-2d51-41e8-92de-f10580a257df', 'volume_name': 'volume-62de100b-2d51-41e8-92de-f10580a257df', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:48 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-def6f069-ceb9-42d7-b49a-27eafd2de59a tempest-SnapshotDependencyTests-2006895361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95a011da-bfb2-4454-ba06-d6b1190df661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:48 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-def6f069-ceb9-42d7-b49a-27eafd2de59a tempest-SnapshotDependencyTests-2006895361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95a011da-bfb2-4454-ba06-d6b1190df661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:48 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-def6f069-ceb9-42d7-b49a-27eafd2de59a tempest-SnapshotDependencyTests-2006895361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd0467d4-0644-408c-b3bc-a52c1bf24337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:48 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-def6f069-ceb9-42d7-b49a-27eafd2de59a tempest-SnapshotDependencyTests-2006895361 None] Volume 62de100b-2d51-41e8-92de-f10580a257df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62de100b-2d51-41e8-92de-f10580a257df', 'volume_size': 1} Jul 30 17:09:48 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-def6f069-ceb9-42d7-b49a-27eafd2de59a tempest-SnapshotDependencyTests-2006895361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:48 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-def6f069-ceb9-42d7-b49a-27eafd2de59a tempest-SnapshotDependencyTests-2006895361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:48 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-def6f069-ceb9-42d7-b49a-27eafd2de59a tempest-SnapshotDependencyTests-2006895361 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:09:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1344997117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62de100b-2d51-41e8-92de-f10580a257df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4be0d2ac1ad42eabe3deaf28f274c5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:09:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:09:49Z,use_quota=True,user_id='7ca35ff42c0c41528750d85f9f9650cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:09:48 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-def6f069-ceb9-42d7-b49a-27eafd2de59a tempest-SnapshotDependencyTests-2006895361 None] Creating volume 62de100b-2d51-41e8-92de-f10580a257df {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:09:48 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-def6f069-ceb9-42d7-b49a-27eafd2de59a tempest-SnapshotDependencyTests-2006895361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:48 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-def6f069-ceb9-42d7-b49a-27eafd2de59a tempest-SnapshotDependencyTests-2006895361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:48 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-def6f069-ceb9-42d7-b49a-27eafd2de59a tempest-SnapshotDependencyTests-2006895361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:09:48 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-def6f069-ceb9-42d7-b49a-27eafd2de59a tempest-SnapshotDependencyTests-2006895361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:09:48 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-def6f069-ceb9-42d7-b49a-27eafd2de59a tempest-SnapshotDependencyTests-2006895361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:48 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-def6f069-ceb9-42d7-b49a-27eafd2de59a tempest-SnapshotDependencyTests-2006895361 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:09:48 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-def6f069-ceb9-42d7-b49a-27eafd2de59a tempest-SnapshotDependencyTests-2006895361 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:09:48 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-def6f069-ceb9-42d7-b49a-27eafd2de59a tempest-SnapshotDependencyTests-2006895361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-62de100b-2d51-41e8-92de-f10580a257df 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:48 devstack sudo[107566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-62de100b-2d51-41e8-92de-f10580a257df 1073741824 Jul 30 17:09:48 devstack sudo[107566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:49 devstack sudo[107566]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:49 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-def6f069-ceb9-42d7-b49a-27eafd2de59a tempest-SnapshotDependencyTests-2006895361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-62de100b-2d51-41e8-92de-f10580a257df 1073741824" returned: 0 in 0.407s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:49 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-def6f069-ceb9-42d7-b49a-27eafd2de59a tempest-SnapshotDependencyTests-2006895361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-62de100b-2d51-41e8-92de-f10580a257df {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:49 devstack sudo[107571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-62de100b-2d51-41e8-92de-f10580a257df Jul 30 17:09:49 devstack sudo[107571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:49 devstack sudo[107571]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:49 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-def6f069-ceb9-42d7-b49a-27eafd2de59a tempest-SnapshotDependencyTests-2006895361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-62de100b-2d51-41e8-92de-f10580a257df" returned: 0 in 0.242s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:49 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-def6f069-ceb9-42d7-b49a-27eafd2de59a tempest-SnapshotDependencyTests-2006895361 None] <== create_volume: return (690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:09:49 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-def6f069-ceb9-42d7-b49a-27eafd2de59a tempest-SnapshotDependencyTests-2006895361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.692s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:49 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-def6f069-ceb9-42d7-b49a-27eafd2de59a tempest-SnapshotDependencyTests-2006895361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd0467d4-0644-408c-b3bc-a52c1bf24337) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62de100b-2d51-41e8-92de-f10580a257df', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:49 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-def6f069-ceb9-42d7-b49a-27eafd2de59a tempest-SnapshotDependencyTests-2006895361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac51a95f-60ea-4356-9387-5d90f6c8717f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:49 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-def6f069-ceb9-42d7-b49a-27eafd2de59a tempest-SnapshotDependencyTests-2006895361 None] Volume volume-62de100b-2d51-41e8-92de-f10580a257df (62de100b-2d51-41e8-92de-f10580a257df): created successfully Jul 30 17:09:49 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-def6f069-ceb9-42d7-b49a-27eafd2de59a tempest-SnapshotDependencyTests-2006895361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac51a95f-60ea-4356-9387-5d90f6c8717f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:49 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-def6f069-ceb9-42d7-b49a-27eafd2de59a tempest-SnapshotDependencyTests-2006895361 None] Flow 'volume_create_manager' (4f420296-c05b-47ab-bf35-ad2674ae64d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:09:49 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-def6f069-ceb9-42d7-b49a-27eafd2de59a tempest-SnapshotDependencyTests-2006895361 None] Created volume successfully. Jul 30 17:09:49 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-2687280e-f68a-475e-a3b0-1f9a639ef6ff tempest-SnapshotDependencyTests-2006895361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:49 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-2687280e-f68a-475e-a3b0-1f9a639ef6ff tempest-SnapshotDependencyTests-2006895361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:49 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-2687280e-f68a-475e-a3b0-1f9a639ef6ff tempest-SnapshotDependencyTests-2006895361 None] Creating offline snapshot f939f874-636a-4118-b9cc-5d0f8e422c37 of volume 62de100b-2d51-41e8-92de-f10580a257df {{(pid=88568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:09:49 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd74e610-e251-41da-a10b-f0d91f04a6a8]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:09:49 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2687280e-f68a-475e-a3b0-1f9a639ef6ff tempest-SnapshotDependencyTests-2006895361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-62de100b-2d51-41e8-92de-f10580a257df {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:50 devstack sudo[107574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-62de100b-2d51-41e8-92de-f10580a257df Jul 30 17:09:50 devstack sudo[107574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:50 devstack sudo[107574]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2687280e-f68a-475e-a3b0-1f9a639ef6ff tempest-SnapshotDependencyTests-2006895361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-62de100b-2d51-41e8-92de-f10580a257df" returned: 0 in 0.347s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2687280e-f68a-475e-a3b0-1f9a639ef6ff tempest-SnapshotDependencyTests-2006895361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-62de100b-2d51-41e8-92de-f10580a257df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-62de100b-2d51-41e8-92de-f10580a257df.f939f874-636a-4118-b9cc-5d0f8e422c37 1G {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:50 devstack sudo[107579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-62de100b-2d51-41e8-92de-f10580a257df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-62de100b-2d51-41e8-92de-f10580a257df.f939f874-636a-4118-b9cc-5d0f8e422c37 1G Jul 30 17:09:50 devstack sudo[107579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:50 devstack sudo[107579]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2687280e-f68a-475e-a3b0-1f9a639ef6ff tempest-SnapshotDependencyTests-2006895361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-62de100b-2d51-41e8-92de-f10580a257df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-62de100b-2d51-41e8-92de-f10580a257df.f939f874-636a-4118-b9cc-5d0f8e422c37 1G" returned: 0 in 0.385s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2687280e-f68a-475e-a3b0-1f9a639ef6ff tempest-SnapshotDependencyTests-2006895361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62de100b-2d51-41e8-92de-f10580a257df -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-62de100b-2d51-41e8-92de-f10580a257df.f939f874-636a-4118-b9cc-5d0f8e422c37 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:50 devstack sudo[107584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62de100b-2d51-41e8-92de-f10580a257df -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-62de100b-2d51-41e8-92de-f10580a257df.f939f874-636a-4118-b9cc-5d0f8e422c37 Jul 30 17:09:50 devstack sudo[107584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:50 devstack sudo[107584]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2687280e-f68a-475e-a3b0-1f9a639ef6ff tempest-SnapshotDependencyTests-2006895361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62de100b-2d51-41e8-92de-f10580a257df -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-62de100b-2d51-41e8-92de-f10580a257df.f939f874-636a-4118-b9cc-5d0f8e422c37" returned: 0 in 0.293s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:50 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-2687280e-f68a-475e-a3b0-1f9a639ef6ff tempest-SnapshotDependencyTests-2006895361 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-62de100b-2d51-41e8-92de-f10580a257df.f939f874-636a-4118-b9cc-5d0f8e422c37 is being set with open permissions: ugo+rw Jul 30 17:09:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2687280e-f68a-475e-a3b0-1f9a639ef6ff tempest-SnapshotDependencyTests-2006895361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-62de100b-2d51-41e8-92de-f10580a257df.f939f874-636a-4118-b9cc-5d0f8e422c37 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:50 devstack sudo[107590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-62de100b-2d51-41e8-92de-f10580a257df.f939f874-636a-4118-b9cc-5d0f8e422c37 Jul 30 17:09:50 devstack sudo[107590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:51 devstack sudo[107590]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2687280e-f68a-475e-a3b0-1f9a639ef6ff tempest-SnapshotDependencyTests-2006895361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-62de100b-2d51-41e8-92de-f10580a257df.f939f874-636a-4118-b9cc-5d0f8e422c37" returned: 0 in 0.260s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2687280e-f68a-475e-a3b0-1f9a639ef6ff tempest-SnapshotDependencyTests-2006895361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-62de100b-2d51-41e8-92de-f10580a257df.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:51 devstack sudo[107593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-62de100b-2d51-41e8-92de-f10580a257df.info Jul 30 17:09:51 devstack sudo[107593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:51 devstack sudo[107593]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2687280e-f68a-475e-a3b0-1f9a639ef6ff tempest-SnapshotDependencyTests-2006895361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-62de100b-2d51-41e8-92de-f10580a257df.info" returned: 0 in 0.248s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:51 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-2687280e-f68a-475e-a3b0-1f9a639ef6ff tempest-SnapshotDependencyTests-2006895361 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-62de100b-2d51-41e8-92de-f10580a257df.info is being set with open permissions: ugo+rw Jul 30 17:09:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2687280e-f68a-475e-a3b0-1f9a639ef6ff tempest-SnapshotDependencyTests-2006895361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-62de100b-2d51-41e8-92de-f10580a257df.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:51 devstack sudo[107596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-62de100b-2d51-41e8-92de-f10580a257df.info Jul 30 17:09:51 devstack sudo[107596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:51 devstack sudo[107596]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2687280e-f68a-475e-a3b0-1f9a639ef6ff tempest-SnapshotDependencyTests-2006895361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-62de100b-2d51-41e8-92de-f10580a257df.info" returned: 0 in 0.238s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-2687280e-f68a-475e-a3b0-1f9a639ef6ff tempest-SnapshotDependencyTests-2006895361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.854s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:51 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-2687280e-f68a-475e-a3b0-1f9a639ef6ff tempest-SnapshotDependencyTests-2006895361 None] Create snapshot completed successfully Jul 30 17:09:52 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-08e38d19-3d3c-4e94-9d9c-75ee8c1a017a tempest-SnapshotDependencyTests-2006895361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:09:52 devstack cinder-volume[88568]: DEBUG oslo_service.periodic_task [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 17:09:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:52 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:09:52 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:09:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:52 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-08e38d19-3d3c-4e94-9d9c-75ee8c1a017a tempest-SnapshotDependencyTests-2006895361 None] Flow 'volume_create_manager' (994ebb65-218f-4ce1-8413-b7da720fc54a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:09:52 devstack sudo[107599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:09:52 devstack sudo[107599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:52 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-08e38d19-3d3c-4e94-9d9c-75ee8c1a017a tempest-SnapshotDependencyTests-2006895361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ace8e30-2638-4d9a-823a-dae3024c7f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:52 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-08e38d19-3d3c-4e94-9d9c-75ee8c1a017a tempest-SnapshotDependencyTests-2006895361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ace8e30-2638-4d9a-823a-dae3024c7f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:09:52Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=911967a2-5688-4a53-a4df-9479431f4b65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4be0d2ac1ad42eabe3deaf28f274c5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:09:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f939f874-636a-4118-b9cc-5d0f8e422c37,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:09:52Z,use_quota=True,user_id='7ca35ff42c0c41528750d85f9f9650cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:52 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-08e38d19-3d3c-4e94-9d9c-75ee8c1a017a tempest-SnapshotDependencyTests-2006895361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cdf84bd-9890-418a-9dc8-6ed0d08a6e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:52 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-08e38d19-3d3c-4e94-9d9c-75ee8c1a017a tempest-SnapshotDependencyTests-2006895361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cdf84bd-9890-418a-9dc8-6ed0d08a6e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:52 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-08e38d19-3d3c-4e94-9d9c-75ee8c1a017a tempest-SnapshotDependencyTests-2006895361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98f2e41c-4042-4d0d-91ce-6e97d2c01478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:52 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-08e38d19-3d3c-4e94-9d9c-75ee8c1a017a tempest-SnapshotDependencyTests-2006895361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98f2e41c-4042-4d0d-91ce-6e97d2c01478) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '911967a2-5688-4a53-a4df-9479431f4b65', 'volume_name': 'volume-911967a2-5688-4a53-a4df-9479431f4b65', 'volume_size': 1, 'snapshot_id': 'f939f874-636a-4118-b9cc-5d0f8e422c37'}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:52 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-08e38d19-3d3c-4e94-9d9c-75ee8c1a017a tempest-SnapshotDependencyTests-2006895361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eccc37ab-f802-4e80-80ce-6a9b50c105bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:52 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-08e38d19-3d3c-4e94-9d9c-75ee8c1a017a tempest-SnapshotDependencyTests-2006895361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eccc37ab-f802-4e80-80ce-6a9b50c105bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:52 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-08e38d19-3d3c-4e94-9d9c-75ee8c1a017a tempest-SnapshotDependencyTests-2006895361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6443f308-0ebf-44ed-90ec-758f6fbdc5d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:52 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-08e38d19-3d3c-4e94-9d9c-75ee8c1a017a tempest-SnapshotDependencyTests-2006895361 None] Volume 911967a2-5688-4a53-a4df-9479431f4b65: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-911967a2-5688-4a53-a4df-9479431f4b65', 'volume_size': 1, 'snapshot_id': 'f939f874-636a-4118-b9cc-5d0f8e422c37'} Jul 30 17:09:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-08e38d19-3d3c-4e94-9d9c-75ee8c1a017a tempest-SnapshotDependencyTests-2006895361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-08e38d19-3d3c-4e94-9d9c-75ee8c1a017a tempest-SnapshotDependencyTests-2006895361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:52 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-08e38d19-3d3c-4e94-9d9c-75ee8c1a017a tempest-SnapshotDependencyTests-2006895361 None] Acquiring lock "cinder-quobyte-f939f874-636a-4118-b9cc-5d0f8e422c37-911967a2-5688-4a53-a4df-9479431f4b65" by "_create_volume_from_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:52 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-08e38d19-3d3c-4e94-9d9c-75ee8c1a017a tempest-SnapshotDependencyTests-2006895361 None] Lock "cinder-quobyte-f939f874-636a-4118-b9cc-5d0f8e422c37-911967a2-5688-4a53-a4df-9479431f4b65" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:52 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-08e38d19-3d3c-4e94-9d9c-75ee8c1a017a tempest-SnapshotDependencyTests-2006895361 None] Creating volume 911967a2-5688-4a53-a4df-9479431f4b65 from snapshot f939f874-636a-4118-b9cc-5d0f8e422c37 {{(pid=88568) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 30 17:09:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-08e38d19-3d3c-4e94-9d9c-75ee8c1a017a tempest-SnapshotDependencyTests-2006895361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-08e38d19-3d3c-4e94-9d9c-75ee8c1a017a tempest-SnapshotDependencyTests-2006895361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:52 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-08e38d19-3d3c-4e94-9d9c-75ee8c1a017a tempest-SnapshotDependencyTests-2006895361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:09:52 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-08e38d19-3d3c-4e94-9d9c-75ee8c1a017a tempest-SnapshotDependencyTests-2006895361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:09:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-08e38d19-3d3c-4e94-9d9c-75ee8c1a017a tempest-SnapshotDependencyTests-2006895361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:52 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-08e38d19-3d3c-4e94-9d9c-75ee8c1a017a tempest-SnapshotDependencyTests-2006895361 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:09:52 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-08e38d19-3d3c-4e94-9d9c-75ee8c1a017a tempest-SnapshotDependencyTests-2006895361 None] Acquiring lock "cinder-quobyte-911967a2-5688-4a53-a4df-9479431f4b65" by "_copy_volume_from_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:52 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-08e38d19-3d3c-4e94-9d9c-75ee8c1a017a tempest-SnapshotDependencyTests-2006895361 None] Lock "cinder-quobyte-911967a2-5688-4a53-a4df-9479431f4b65" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:52 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-08e38d19-3d3c-4e94-9d9c-75ee8c1a017a tempest-SnapshotDependencyTests-2006895361 None] snapshot: f939f874-636a-4118-b9cc-5d0f8e422c37, volume: 911967a2-5688-4a53-a4df-9479431f4b65, {{(pid=88568) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 30 17:09:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-08e38d19-3d3c-4e94-9d9c-75ee8c1a017a tempest-SnapshotDependencyTests-2006895361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-08e38d19-3d3c-4e94-9d9c-75ee8c1a017a tempest-SnapshotDependencyTests-2006895361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:52 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-08e38d19-3d3c-4e94-9d9c-75ee8c1a017a tempest-SnapshotDependencyTests-2006895361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:09:52 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-08e38d19-3d3c-4e94-9d9c-75ee8c1a017a tempest-SnapshotDependencyTests-2006895361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:09:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-08e38d19-3d3c-4e94-9d9c-75ee8c1a017a tempest-SnapshotDependencyTests-2006895361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:52 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[34bb7e2a-6501-486f-a4f6-b301ac615c11]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:09:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-08e38d19-3d3c-4e94-9d9c-75ee8c1a017a tempest-SnapshotDependencyTests-2006895361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-62de100b-2d51-41e8-92de-f10580a257df.f939f874-636a-4118-b9cc-5d0f8e422c37 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:52 devstack sudo[107599]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.248s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:52 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:09:52 devstack cinder-volume[88568]: DEBUG oslo_service.periodic_task [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Running periodic task VolumeManager._thread_info {{(pid=88568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 17:09:52 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] thread count: 28 {{(pid=88568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 17:09:52 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] thread info: [<_MainThread(MainThread, started 127406866608256)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 17:09:52 devstack sudo[107602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-62de100b-2d51-41e8-92de-f10580a257df.f939f874-636a-4118-b9cc-5d0f8e422c37 Jul 30 17:09:52 devstack sudo[107602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:53 devstack sudo[107602]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:53 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-08e38d19-3d3c-4e94-9d9c-75ee8c1a017a tempest-SnapshotDependencyTests-2006895361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-62de100b-2d51-41e8-92de-f10580a257df.f939f874-636a-4118-b9cc-5d0f8e422c37" returned: 0 in 0.355s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:53 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-08e38d19-3d3c-4e94-9d9c-75ee8c1a017a tempest-SnapshotDependencyTests-2006895361 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62de100b-2d51-41e8-92de-f10580a257df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:09:53 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b8ec71-bc9d-4e10-9142-cf478592de36]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:09:53 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-08e38d19-3d3c-4e94-9d9c-75ee8c1a017a tempest-SnapshotDependencyTests-2006895361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-62de100b-2d51-41e8-92de-f10580a257df {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:53 devstack sudo[107607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-62de100b-2d51-41e8-92de-f10580a257df Jul 30 17:09:53 devstack sudo[107607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:53 devstack sudo[107607]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:53 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-08e38d19-3d3c-4e94-9d9c-75ee8c1a017a tempest-SnapshotDependencyTests-2006895361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-62de100b-2d51-41e8-92de-f10580a257df" returned: 0 in 0.359s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:53 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-08e38d19-3d3c-4e94-9d9c-75ee8c1a017a tempest-SnapshotDependencyTests-2006895361 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-62de100b-2d51-41e8-92de-f10580a257df {{(pid=88568) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 30 17:09:53 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-08e38d19-3d3c-4e94-9d9c-75ee8c1a017a tempest-SnapshotDependencyTests-2006895361 None] Creating direct copy from snapshot {{(pid=88568) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 30 17:09:53 devstack cinder-volume[88568]: DEBUG cinder.utils [None req-08e38d19-3d3c-4e94-9d9c-75ee8c1a017a tempest-SnapshotDependencyTests-2006895361 None] Path /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-911967a2-5688-4a53-a4df-9479431f4b65 not found in is_blk_device check {{(pid=88568) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 30 17:09:53 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-08e38d19-3d3c-4e94-9d9c-75ee8c1a017a tempest-SnapshotDependencyTests-2006895361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-62de100b-2d51-41e8-92de-f10580a257df /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-911967a2-5688-4a53-a4df-9479431f4b65 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:53 devstack sudo[107612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-62de100b-2d51-41e8-92de-f10580a257df /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-911967a2-5688-4a53-a4df-9479431f4b65 Jul 30 17:09:53 devstack sudo[107612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:57 devstack sudo[107612]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-08e38d19-3d3c-4e94-9d9c-75ee8c1a017a tempest-SnapshotDependencyTests-2006895361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-62de100b-2d51-41e8-92de-f10580a257df /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-911967a2-5688-4a53-a4df-9479431f4b65" returned: 0 in 4.102s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:57 devstack cinder-volume[88568]: DEBUG cinder.image.image_utils [None req-08e38d19-3d3c-4e94-9d9c-75ee8c1a017a tempest-SnapshotDependencyTests-2006895361 None] Image conversion details: src /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-62de100b-2d51-41e8-92de-f10580a257df, size 1024.00 MB, duration 4.10 sec, destination /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-911967a2-5688-4a53-a4df-9479431f4b65 {{(pid=88568) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 17:09:57 devstack cinder-volume[88568]: INFO cinder.image.image_utils [None req-08e38d19-3d3c-4e94-9d9c-75ee8c1a017a tempest-SnapshotDependencyTests-2006895361 None] Converted 1024.00 MB image at 249.48 MB/s Jul 30 17:09:57 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-08e38d19-3d3c-4e94-9d9c-75ee8c1a017a tempest-SnapshotDependencyTests-2006895361 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-911967a2-5688-4a53-a4df-9479431f4b65 is being set with open permissions: ugo+rw Jul 30 17:09:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-08e38d19-3d3c-4e94-9d9c-75ee8c1a017a tempest-SnapshotDependencyTests-2006895361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-911967a2-5688-4a53-a4df-9479431f4b65 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:57 devstack sudo[107626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-911967a2-5688-4a53-a4df-9479431f4b65 Jul 30 17:09:57 devstack sudo[107626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:57 devstack sudo[107626]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-08e38d19-3d3c-4e94-9d9c-75ee8c1a017a tempest-SnapshotDependencyTests-2006895361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-911967a2-5688-4a53-a4df-9479431f4b65" returned: 0 in 0.239s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:57 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-08e38d19-3d3c-4e94-9d9c-75ee8c1a017a tempest-SnapshotDependencyTests-2006895361 None] Lock "cinder-quobyte-911967a2-5688-4a53-a4df-9479431f4b65" released by "_copy_volume_from_snapshot" :: held 5.138s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:57 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-08e38d19-3d3c-4e94-9d9c-75ee8c1a017a tempest-SnapshotDependencyTests-2006895361 None] Lock "cinder-quobyte-f939f874-636a-4118-b9cc-5d0f8e422c37-911967a2-5688-4a53-a4df-9479431f4b65" released by "_create_volume_from_snapshot" :: held 5.205s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-08e38d19-3d3c-4e94-9d9c-75ee8c1a017a tempest-SnapshotDependencyTests-2006895361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.228s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:57 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-08e38d19-3d3c-4e94-9d9c-75ee8c1a017a tempest-SnapshotDependencyTests-2006895361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6443f308-0ebf-44ed-90ec-758f6fbdc5d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-911967a2-5688-4a53-a4df-9479431f4b65', 'volume_size': 1, 'snapshot_id': 'f939f874-636a-4118-b9cc-5d0f8e422c37'}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:57 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-08e38d19-3d3c-4e94-9d9c-75ee8c1a017a tempest-SnapshotDependencyTests-2006895361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d90bb823-4297-4349-9f16-82783f926c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:57 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-08e38d19-3d3c-4e94-9d9c-75ee8c1a017a tempest-SnapshotDependencyTests-2006895361 None] Volume volume-911967a2-5688-4a53-a4df-9479431f4b65 (911967a2-5688-4a53-a4df-9479431f4b65): created successfully Jul 30 17:09:57 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-08e38d19-3d3c-4e94-9d9c-75ee8c1a017a tempest-SnapshotDependencyTests-2006895361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d90bb823-4297-4349-9f16-82783f926c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:57 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-08e38d19-3d3c-4e94-9d9c-75ee8c1a017a tempest-SnapshotDependencyTests-2006895361 None] Flow 'volume_create_manager' (994ebb65-218f-4ce1-8413-b7da720fc54a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:09:57 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-08e38d19-3d3c-4e94-9d9c-75ee8c1a017a tempest-SnapshotDependencyTests-2006895361 None] Created volume successfully. Jul 30 17:09:59 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-8b0b715c-0b0c-4c63-be65-5bfc0cb397e2 tempest-SnapshotDependencyTests-2006895361 None] Acquiring lock "cinder-f939f874-636a-4118-b9cc-5d0f8e422c37-delete_snapshot" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:59 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-8b0b715c-0b0c-4c63-be65-5bfc0cb397e2 tempest-SnapshotDependencyTests-2006895361 None] Lock "cinder-f939f874-636a-4118-b9cc-5d0f8e422c37-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:59 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-8b0b715c-0b0c-4c63-be65-5bfc0cb397e2 tempest-SnapshotDependencyTests-2006895361 None] Acquiring lock "cinder-quobyte-62de100b-2d51-41e8-92de-f10580a257df" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:59 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-8b0b715c-0b0c-4c63-be65-5bfc0cb397e2 tempest-SnapshotDependencyTests-2006895361 None] Lock "cinder-quobyte-62de100b-2d51-41e8-92de-f10580a257df" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:59 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-8b0b715c-0b0c-4c63-be65-5bfc0cb397e2 tempest-SnapshotDependencyTests-2006895361 None] Acquiring lock "cinder-quobyte-f939f874-636a-4118-b9cc-5d0f8e422c37" by "_delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:59 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-8b0b715c-0b0c-4c63-be65-5bfc0cb397e2 tempest-SnapshotDependencyTests-2006895361 None] Lock "cinder-quobyte-f939f874-636a-4118-b9cc-5d0f8e422c37" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:59 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-8b0b715c-0b0c-4c63-be65-5bfc0cb397e2 tempest-SnapshotDependencyTests-2006895361 None] Deleting offline snapshot f939f874-636a-4118-b9cc-5d0f8e422c37 of volume 62de100b-2d51-41e8-92de-f10580a257df {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:09:59 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-8b0b715c-0b0c-4c63-be65-5bfc0cb397e2 tempest-SnapshotDependencyTests-2006895361 None] snapshot_file for this snap is: volume-62de100b-2d51-41e8-92de-f10580a257df.f939f874-636a-4118-b9cc-5d0f8e422c37 {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:09:59 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb3b4883-c561-4b0d-83c1-8e3932aca44d]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:09:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8b0b715c-0b0c-4c63-be65-5bfc0cb397e2 tempest-SnapshotDependencyTests-2006895361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-62de100b-2d51-41e8-92de-f10580a257df.f939f874-636a-4118-b9cc-5d0f8e422c37 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:59 devstack sudo[107629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-62de100b-2d51-41e8-92de-f10580a257df.f939f874-636a-4118-b9cc-5d0f8e422c37 Jul 30 17:09:59 devstack sudo[107629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:59 devstack sudo[107629]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8b0b715c-0b0c-4c63-be65-5bfc0cb397e2 tempest-SnapshotDependencyTests-2006895361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-62de100b-2d51-41e8-92de-f10580a257df.f939f874-636a-4118-b9cc-5d0f8e422c37" returned: 0 in 0.341s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:59 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-8b0b715c-0b0c-4c63-be65-5bfc0cb397e2 tempest-SnapshotDependencyTests-2006895361 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62de100b-2d51-41e8-92de-f10580a257df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:09:59 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[e935e234-580f-49b7-93f6-5cc973143352]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:09:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8b0b715c-0b0c-4c63-be65-5bfc0cb397e2 tempest-SnapshotDependencyTests-2006895361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-62de100b-2d51-41e8-92de-f10580a257df {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:59 devstack sudo[107634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-62de100b-2d51-41e8-92de-f10580a257df Jul 30 17:09:59 devstack sudo[107634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:00 devstack sudo[107634]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:00 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8b0b715c-0b0c-4c63-be65-5bfc0cb397e2 tempest-SnapshotDependencyTests-2006895361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-62de100b-2d51-41e8-92de-f10580a257df" returned: 0 in 0.527s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:00 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8b0b715c-0b0c-4c63-be65-5bfc0cb397e2 tempest-SnapshotDependencyTests-2006895361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-62de100b-2d51-41e8-92de-f10580a257df.f939f874-636a-4118-b9cc-5d0f8e422c37 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:00 devstack sudo[107639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-62de100b-2d51-41e8-92de-f10580a257df.f939f874-636a-4118-b9cc-5d0f8e422c37 Jul 30 17:10:00 devstack sudo[107639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:00 devstack sudo[107639]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:00 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8b0b715c-0b0c-4c63-be65-5bfc0cb397e2 tempest-SnapshotDependencyTests-2006895361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-62de100b-2d51-41e8-92de-f10580a257df.f939f874-636a-4118-b9cc-5d0f8e422c37" returned: 0 in 0.316s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:00 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8b0b715c-0b0c-4c63-be65-5bfc0cb397e2 tempest-SnapshotDependencyTests-2006895361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-62de100b-2d51-41e8-92de-f10580a257df.f939f874-636a-4118-b9cc-5d0f8e422c37 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:00 devstack sudo[107644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-62de100b-2d51-41e8-92de-f10580a257df.f939f874-636a-4118-b9cc-5d0f8e422c37 Jul 30 17:10:00 devstack sudo[107644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:00 devstack sudo[107644]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:00 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8b0b715c-0b0c-4c63-be65-5bfc0cb397e2 tempest-SnapshotDependencyTests-2006895361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-62de100b-2d51-41e8-92de-f10580a257df.f939f874-636a-4118-b9cc-5d0f8e422c37" returned: 0 in 0.235s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:00 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-8b0b715c-0b0c-4c63-be65-5bfc0cb397e2 tempest-SnapshotDependencyTests-2006895361 None] Lock "cinder-quobyte-f939f874-636a-4118-b9cc-5d0f8e422c37" released by "_delete_snapshot" :: held 1.508s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:00 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-8b0b715c-0b0c-4c63-be65-5bfc0cb397e2 tempest-SnapshotDependencyTests-2006895361 None] Lock "cinder-quobyte-62de100b-2d51-41e8-92de-f10580a257df" released by "delete_snapshot" :: held 1.528s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:00 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-8b0b715c-0b0c-4c63-be65-5bfc0cb397e2 tempest-SnapshotDependencyTests-2006895361 None] Created reservations ['8d2205c8-bfa8-4076-a228-0aa0ebc4a52b', '5e2e8914-213f-49fd-a987-d8289e80d6fa', '9f0fe56c-d1e3-462e-b76d-7d821e3b9156', '33b5d346-fc7d-415d-8634-d24036ddf814'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:10:00 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-8b0b715c-0b0c-4c63-be65-5bfc0cb397e2 tempest-SnapshotDependencyTests-2006895361 None] Delete snapshot completed successfully. Jul 30 17:10:00 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-8b0b715c-0b0c-4c63-be65-5bfc0cb397e2 tempest-SnapshotDependencyTests-2006895361 None] Lock "cinder-f939f874-636a-4118-b9cc-5d0f8e422c37-delete_snapshot" released by "delete_snapshot" :: held 1.651s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:01 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-b45905c3-9d02-4566-a8e6-66de20b2655f tempest-SnapshotDependencyTests-2006895361 None] Acquiring lock "cinder-62de100b-2d51-41e8-92de-f10580a257df-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:01 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-b45905c3-9d02-4566-a8e6-66de20b2655f tempest-SnapshotDependencyTests-2006895361 None] Lock "cinder-62de100b-2d51-41e8-92de-f10580a257df-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:01 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-b45905c3-9d02-4566-a8e6-66de20b2655f tempest-SnapshotDependencyTests-2006895361 None] Acquiring lock "cinder-quobyte-62de100b-2d51-41e8-92de-f10580a257df" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:01 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-b45905c3-9d02-4566-a8e6-66de20b2655f tempest-SnapshotDependencyTests-2006895361 None] Lock "cinder-quobyte-62de100b-2d51-41e8-92de-f10580a257df" acquired by "delete_volume" :: waited 0.013s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:01 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e2887f-5acc-4f38-a21c-ad64fb536431]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:10:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-b45905c3-9d02-4566-a8e6-66de20b2655f tempest-SnapshotDependencyTests-2006895361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-62de100b-2d51-41e8-92de-f10580a257df {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:01 devstack sudo[107647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-62de100b-2d51-41e8-92de-f10580a257df Jul 30 17:10:01 devstack sudo[107647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:01 devstack sudo[107647]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-b45905c3-9d02-4566-a8e6-66de20b2655f tempest-SnapshotDependencyTests-2006895361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-62de100b-2d51-41e8-92de-f10580a257df" returned: 0 in 0.356s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-b45905c3-9d02-4566-a8e6-66de20b2655f tempest-SnapshotDependencyTests-2006895361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-62de100b-2d51-41e8-92de-f10580a257df {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:01 devstack sudo[107652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-62de100b-2d51-41e8-92de-f10580a257df Jul 30 17:10:01 devstack sudo[107652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:01 devstack sudo[107652]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-b45905c3-9d02-4566-a8e6-66de20b2655f tempest-SnapshotDependencyTests-2006895361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-62de100b-2d51-41e8-92de-f10580a257df" returned: 0 in 0.241s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:01 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-b45905c3-9d02-4566-a8e6-66de20b2655f tempest-SnapshotDependencyTests-2006895361 None] Lock "cinder-quobyte-62de100b-2d51-41e8-92de-f10580a257df" released by "delete_volume" :: held 0.654s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:01 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-b45905c3-9d02-4566-a8e6-66de20b2655f tempest-SnapshotDependencyTests-2006895361 None] Created reservations ['73377adf-c413-4e5a-9afe-8d4370cc8198', '8d4bd019-75cd-442b-a850-da6be5096dc2', '8cefd58b-0e43-40c7-9a6b-1d8be49d5733', '208c0b3f-1742-4d2c-a26b-f71963b840fb'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:10:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-b45905c3-9d02-4566-a8e6-66de20b2655f tempest-SnapshotDependencyTests-2006895361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-b45905c3-9d02-4566-a8e6-66de20b2655f tempest-SnapshotDependencyTests-2006895361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:02 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-b45905c3-9d02-4566-a8e6-66de20b2655f tempest-SnapshotDependencyTests-2006895361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:10:02 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-b45905c3-9d02-4566-a8e6-66de20b2655f tempest-SnapshotDependencyTests-2006895361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:10:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-b45905c3-9d02-4566-a8e6-66de20b2655f tempest-SnapshotDependencyTests-2006895361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-b45905c3-9d02-4566-a8e6-66de20b2655f tempest-SnapshotDependencyTests-2006895361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:02 devstack sudo[107655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:10:02 devstack sudo[107655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:02 devstack sudo[107655]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-b45905c3-9d02-4566-a8e6-66de20b2655f tempest-SnapshotDependencyTests-2006895361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.241s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:02 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-b45905c3-9d02-4566-a8e6-66de20b2655f tempest-SnapshotDependencyTests-2006895361 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:10:02 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-b45905c3-9d02-4566-a8e6-66de20b2655f tempest-SnapshotDependencyTests-2006895361 None] Deleted volume successfully. Jul 30 17:10:02 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-b45905c3-9d02-4566-a8e6-66de20b2655f tempest-SnapshotDependencyTests-2006895361 None] Lock "cinder-62de100b-2d51-41e8-92de-f10580a257df-delete_volume" released by "delete_volume" :: held 1.089s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:02 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-67759448-a02a-404d-8dca-c3d96938b57e tempest-SnapshotDependencyTests-2006895361 None] Acquiring lock "cinder-911967a2-5688-4a53-a4df-9479431f4b65-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:02 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-67759448-a02a-404d-8dca-c3d96938b57e tempest-SnapshotDependencyTests-2006895361 None] Lock "cinder-911967a2-5688-4a53-a4df-9479431f4b65-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:02 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-67759448-a02a-404d-8dca-c3d96938b57e tempest-SnapshotDependencyTests-2006895361 None] Acquiring lock "cinder-quobyte-911967a2-5688-4a53-a4df-9479431f4b65" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:02 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-67759448-a02a-404d-8dca-c3d96938b57e tempest-SnapshotDependencyTests-2006895361 None] Lock "cinder-quobyte-911967a2-5688-4a53-a4df-9479431f4b65" acquired by "delete_volume" :: waited 0.014s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:02 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a5d1f5-bd35-4d2c-8633-f7d2a6b974a0]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:10:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-67759448-a02a-404d-8dca-c3d96938b57e tempest-SnapshotDependencyTests-2006895361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-911967a2-5688-4a53-a4df-9479431f4b65 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:02 devstack sudo[107658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-911967a2-5688-4a53-a4df-9479431f4b65 Jul 30 17:10:02 devstack sudo[107658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:02 devstack sudo[107658]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-67759448-a02a-404d-8dca-c3d96938b57e tempest-SnapshotDependencyTests-2006895361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-911967a2-5688-4a53-a4df-9479431f4b65" returned: 0 in 0.357s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-67759448-a02a-404d-8dca-c3d96938b57e tempest-SnapshotDependencyTests-2006895361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-911967a2-5688-4a53-a4df-9479431f4b65 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:02 devstack sudo[107663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-911967a2-5688-4a53-a4df-9479431f4b65 Jul 30 17:10:02 devstack sudo[107663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:03 devstack sudo[107663]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-67759448-a02a-404d-8dca-c3d96938b57e tempest-SnapshotDependencyTests-2006895361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-911967a2-5688-4a53-a4df-9479431f4b65" returned: 0 in 0.247s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:03 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-67759448-a02a-404d-8dca-c3d96938b57e tempest-SnapshotDependencyTests-2006895361 None] Lock "cinder-quobyte-911967a2-5688-4a53-a4df-9479431f4b65" released by "delete_volume" :: held 0.644s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:03 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-67759448-a02a-404d-8dca-c3d96938b57e tempest-SnapshotDependencyTests-2006895361 None] Created reservations ['09ff1c4f-f0a7-4e0b-a576-650285c114b7', '0dcea5e6-b4fd-4e4f-ae6c-ec74fe3c2b87', 'a0e93b17-002c-4c84-820f-f4154aaf9b43', 'b371fca0-dab2-4169-bf8e-b7ebd58a81fc'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:10:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-67759448-a02a-404d-8dca-c3d96938b57e tempest-SnapshotDependencyTests-2006895361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-67759448-a02a-404d-8dca-c3d96938b57e tempest-SnapshotDependencyTests-2006895361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:03 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-67759448-a02a-404d-8dca-c3d96938b57e tempest-SnapshotDependencyTests-2006895361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:10:03 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-67759448-a02a-404d-8dca-c3d96938b57e tempest-SnapshotDependencyTests-2006895361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:10:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-67759448-a02a-404d-8dca-c3d96938b57e tempest-SnapshotDependencyTests-2006895361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-67759448-a02a-404d-8dca-c3d96938b57e tempest-SnapshotDependencyTests-2006895361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:03 devstack sudo[107666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:10:03 devstack sudo[107666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:03 devstack sudo[107666]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-67759448-a02a-404d-8dca-c3d96938b57e tempest-SnapshotDependencyTests-2006895361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.239s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:03 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-67759448-a02a-404d-8dca-c3d96938b57e tempest-SnapshotDependencyTests-2006895361 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:10:03 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-67759448-a02a-404d-8dca-c3d96938b57e tempest-SnapshotDependencyTests-2006895361 None] Deleted volume successfully. Jul 30 17:10:03 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-67759448-a02a-404d-8dca-c3d96938b57e tempest-SnapshotDependencyTests-2006895361 None] Lock "cinder-911967a2-5688-4a53-a4df-9479431f4b65-delete_volume" released by "delete_volume" :: held 1.076s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:13 devstack cinder-volume[88568]: DEBUG dbcounter [-] [88568] Writing DB stats cinder:SELECT=24,cinder:INSERT=10,cinder:UPDATE=29,cinder:DELETE=1 {{(pid=88568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 17:10:13 devstack cinder-volume[88568]: DEBUG dbcounter [-] [88568] Writing DB stats cinder:UPDATE=29,cinder:SELECT=25,cinder:DELETE=4,cinder:INSERT=5 {{(pid=88568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 17:10:23 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dc7f72d-65f7-4f06-929e-6ba502683902 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:10:23 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-2dc7f72d-65f7-4f06-929e-6ba502683902 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Flow 'volume_create_manager' (a3d87957-ac37-40b2-a42c-1ea3a8a8160f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:10:23 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-2dc7f72d-65f7-4f06-929e-6ba502683902 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5522d67c-6db6-47ca-a7b0-b0082ac42ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:23 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-2dc7f72d-65f7-4f06-929e-6ba502683902 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5522d67c-6db6-47ca-a7b0-b0082ac42ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:10:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1585120665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6f5647c-201c-4e7f-9044-c4cce0fb1ead,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='966adfc9a22049f1941971b527ef521c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:10:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:10:23Z,use_quota=True,user_id='0af5567b32ab4efaa072c0bc24984cc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:23 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-2dc7f72d-65f7-4f06-929e-6ba502683902 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1c25cde-2d42-46a8-b54e-5db30fda3672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:23 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-2dc7f72d-65f7-4f06-929e-6ba502683902 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1c25cde-2d42-46a8-b54e-5db30fda3672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:23 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-2dc7f72d-65f7-4f06-929e-6ba502683902 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b77e177f-bd63-44af-9c08-92e7e7e77666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:23 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-2dc7f72d-65f7-4f06-929e-6ba502683902 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b77e177f-bd63-44af-9c08-92e7e7e77666) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6f5647c-201c-4e7f-9044-c4cce0fb1ead', 'volume_name': 'volume-c6f5647c-201c-4e7f-9044-c4cce0fb1ead', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:23 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-2dc7f72d-65f7-4f06-929e-6ba502683902 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00eefe7e-36dd-4f9b-86dd-8416f0b7e026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:23 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-2dc7f72d-65f7-4f06-929e-6ba502683902 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00eefe7e-36dd-4f9b-86dd-8416f0b7e026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:23 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-2dc7f72d-65f7-4f06-929e-6ba502683902 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2c63098-5a93-43f6-8493-31c2ebcf09be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:23 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-2dc7f72d-65f7-4f06-929e-6ba502683902 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Volume c6f5647c-201c-4e7f-9044-c4cce0fb1ead: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6f5647c-201c-4e7f-9044-c4cce0fb1ead', 'volume_size': 1} Jul 30 17:10:23 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-2dc7f72d-65f7-4f06-929e-6ba502683902 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:23 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-2dc7f72d-65f7-4f06-929e-6ba502683902 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:23 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-2dc7f72d-65f7-4f06-929e-6ba502683902 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:10:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1585120665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6f5647c-201c-4e7f-9044-c4cce0fb1ead,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='966adfc9a22049f1941971b527ef521c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:10:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:10:23Z,use_quota=True,user_id='0af5567b32ab4efaa072c0bc24984cc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:10:23 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-2dc7f72d-65f7-4f06-929e-6ba502683902 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Creating volume c6f5647c-201c-4e7f-9044-c4cce0fb1ead {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:10:23 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-2dc7f72d-65f7-4f06-929e-6ba502683902 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:23 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-2dc7f72d-65f7-4f06-929e-6ba502683902 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:23 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-2dc7f72d-65f7-4f06-929e-6ba502683902 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:10:23 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-2dc7f72d-65f7-4f06-929e-6ba502683902 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:10:23 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-2dc7f72d-65f7-4f06-929e-6ba502683902 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:23 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-2dc7f72d-65f7-4f06-929e-6ba502683902 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:10:23 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-2dc7f72d-65f7-4f06-929e-6ba502683902 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:10:23 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2dc7f72d-65f7-4f06-929e-6ba502683902 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c6f5647c-201c-4e7f-9044-c4cce0fb1ead 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:23 devstack sudo[107717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c6f5647c-201c-4e7f-9044-c4cce0fb1ead 1073741824 Jul 30 17:10:23 devstack sudo[107717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:23 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-d297a20a-bd1f-4805-a12b-c887401d01da tempest-CreateVolumesFromSnapshotTest-1648007070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:10:23 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-d297a20a-bd1f-4805-a12b-c887401d01da tempest-CreateVolumesFromSnapshotTest-1648007070 None] Flow 'volume_create_manager' (2185dc1b-0207-4c7b-8d17-f063cb9f9219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:10:23 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-d297a20a-bd1f-4805-a12b-c887401d01da tempest-CreateVolumesFromSnapshotTest-1648007070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (078c1cd3-25fc-4980-84be-78f55c1b6184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:23 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-d297a20a-bd1f-4805-a12b-c887401d01da tempest-CreateVolumesFromSnapshotTest-1648007070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (078c1cd3-25fc-4980-84be-78f55c1b6184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:10:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1413810963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1d2cd2b-bc4e-4620-8e09-570c268e9240,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a1bfeeec4e441d0b285d4af6adeba66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:10:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:10:23Z,use_quota=True,user_id='42456a79f14e4e68b2d93c2b982eff90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:23 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-d297a20a-bd1f-4805-a12b-c887401d01da tempest-CreateVolumesFromSnapshotTest-1648007070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ae8e07d-9c99-46d2-a1b9-a5afa1fa8e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:23 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-d297a20a-bd1f-4805-a12b-c887401d01da tempest-CreateVolumesFromSnapshotTest-1648007070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ae8e07d-9c99-46d2-a1b9-a5afa1fa8e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:23 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-d297a20a-bd1f-4805-a12b-c887401d01da tempest-CreateVolumesFromSnapshotTest-1648007070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc6e1ac0-0196-482e-96ec-f45bc5324f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:23 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-d297a20a-bd1f-4805-a12b-c887401d01da tempest-CreateVolumesFromSnapshotTest-1648007070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc6e1ac0-0196-482e-96ec-f45bc5324f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1d2cd2b-bc4e-4620-8e09-570c268e9240', 'volume_name': 'volume-d1d2cd2b-bc4e-4620-8e09-570c268e9240', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:23 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-d297a20a-bd1f-4805-a12b-c887401d01da tempest-CreateVolumesFromSnapshotTest-1648007070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62a38bb2-56ab-4ecf-a314-f0b51e70bfdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:23 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-d297a20a-bd1f-4805-a12b-c887401d01da tempest-CreateVolumesFromSnapshotTest-1648007070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62a38bb2-56ab-4ecf-a314-f0b51e70bfdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:23 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-d297a20a-bd1f-4805-a12b-c887401d01da tempest-CreateVolumesFromSnapshotTest-1648007070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ae29740-8580-436e-bb85-89cec4f46c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:23 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-d297a20a-bd1f-4805-a12b-c887401d01da tempest-CreateVolumesFromSnapshotTest-1648007070 None] Volume d1d2cd2b-bc4e-4620-8e09-570c268e9240: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1d2cd2b-bc4e-4620-8e09-570c268e9240', 'volume_size': 1} Jul 30 17:10:23 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-d297a20a-bd1f-4805-a12b-c887401d01da tempest-CreateVolumesFromSnapshotTest-1648007070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:23 devstack sudo[107717]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:23 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2dc7f72d-65f7-4f06-929e-6ba502683902 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c6f5647c-201c-4e7f-9044-c4cce0fb1ead 1073741824" returned: 0 in 0.549s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:23 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2dc7f72d-65f7-4f06-929e-6ba502683902 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c6f5647c-201c-4e7f-9044-c4cce0fb1ead {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:23 devstack sudo[107723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c6f5647c-201c-4e7f-9044-c4cce0fb1ead Jul 30 17:10:23 devstack sudo[107723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:24 devstack sudo[107723]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2dc7f72d-65f7-4f06-929e-6ba502683902 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c6f5647c-201c-4e7f-9044-c4cce0fb1ead" returned: 0 in 0.289s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:24 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-2dc7f72d-65f7-4f06-929e-6ba502683902 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:10:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-2dc7f72d-65f7-4f06-929e-6ba502683902 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-d297a20a-bd1f-4805-a12b-c887401d01da tempest-CreateVolumesFromSnapshotTest-1648007070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.560s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:24 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-d297a20a-bd1f-4805-a12b-c887401d01da tempest-CreateVolumesFromSnapshotTest-1648007070 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:10:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1413810963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1d2cd2b-bc4e-4620-8e09-570c268e9240,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a1bfeeec4e441d0b285d4af6adeba66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:10:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:10:23Z,use_quota=True,user_id='42456a79f14e4e68b2d93c2b982eff90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:10:24 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-d297a20a-bd1f-4805-a12b-c887401d01da tempest-CreateVolumesFromSnapshotTest-1648007070 None] Creating volume d1d2cd2b-bc4e-4620-8e09-570c268e9240 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:10:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-d297a20a-bd1f-4805-a12b-c887401d01da tempest-CreateVolumesFromSnapshotTest-1648007070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-d297a20a-bd1f-4805-a12b-c887401d01da tempest-CreateVolumesFromSnapshotTest-1648007070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:24 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-d297a20a-bd1f-4805-a12b-c887401d01da tempest-CreateVolumesFromSnapshotTest-1648007070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:10:24 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-d297a20a-bd1f-4805-a12b-c887401d01da tempest-CreateVolumesFromSnapshotTest-1648007070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:10:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-d297a20a-bd1f-4805-a12b-c887401d01da tempest-CreateVolumesFromSnapshotTest-1648007070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:24 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-d297a20a-bd1f-4805-a12b-c887401d01da tempest-CreateVolumesFromSnapshotTest-1648007070 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:10:24 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-d297a20a-bd1f-4805-a12b-c887401d01da tempest-CreateVolumesFromSnapshotTest-1648007070 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:10:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d297a20a-bd1f-4805-a12b-c887401d01da tempest-CreateVolumesFromSnapshotTest-1648007070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d1d2cd2b-bc4e-4620-8e09-570c268e9240 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:24 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-2dc7f72d-65f7-4f06-929e-6ba502683902 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2c63098-5a93-43f6-8493-31c2ebcf09be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6f5647c-201c-4e7f-9044-c4cce0fb1ead', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:24 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-2dc7f72d-65f7-4f06-929e-6ba502683902 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18abede4-06bf-4912-a4df-49dd3dbc9628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:24 devstack sudo[107726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d1d2cd2b-bc4e-4620-8e09-570c268e9240 1073741824 Jul 30 17:10:24 devstack sudo[107726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:24 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-2dc7f72d-65f7-4f06-929e-6ba502683902 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Volume volume-c6f5647c-201c-4e7f-9044-c4cce0fb1ead (c6f5647c-201c-4e7f-9044-c4cce0fb1ead): created successfully Jul 30 17:10:24 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-2dc7f72d-65f7-4f06-929e-6ba502683902 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18abede4-06bf-4912-a4df-49dd3dbc9628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:24 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-2dc7f72d-65f7-4f06-929e-6ba502683902 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Flow 'volume_create_manager' (a3d87957-ac37-40b2-a42c-1ea3a8a8160f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:10:24 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-2dc7f72d-65f7-4f06-929e-6ba502683902 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Created volume successfully. Jul 30 17:10:24 devstack sudo[107726]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d297a20a-bd1f-4805-a12b-c887401d01da tempest-CreateVolumesFromSnapshotTest-1648007070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d1d2cd2b-bc4e-4620-8e09-570c268e9240 1073741824" returned: 0 in 0.534s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d297a20a-bd1f-4805-a12b-c887401d01da tempest-CreateVolumesFromSnapshotTest-1648007070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d1d2cd2b-bc4e-4620-8e09-570c268e9240 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:24 devstack sudo[107732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d1d2cd2b-bc4e-4620-8e09-570c268e9240 Jul 30 17:10:24 devstack sudo[107732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:24 devstack sudo[107732]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d297a20a-bd1f-4805-a12b-c887401d01da tempest-CreateVolumesFromSnapshotTest-1648007070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d1d2cd2b-bc4e-4620-8e09-570c268e9240" returned: 0 in 0.283s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:24 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-d297a20a-bd1f-4805-a12b-c887401d01da tempest-CreateVolumesFromSnapshotTest-1648007070 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:10:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-d297a20a-bd1f-4805-a12b-c887401d01da tempest-CreateVolumesFromSnapshotTest-1648007070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:24 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-d297a20a-bd1f-4805-a12b-c887401d01da tempest-CreateVolumesFromSnapshotTest-1648007070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ae29740-8580-436e-bb85-89cec4f46c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1d2cd2b-bc4e-4620-8e09-570c268e9240', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:24 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-d297a20a-bd1f-4805-a12b-c887401d01da tempest-CreateVolumesFromSnapshotTest-1648007070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7897a005-2989-458b-ae4d-5253bf42795f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:24 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-d297a20a-bd1f-4805-a12b-c887401d01da tempest-CreateVolumesFromSnapshotTest-1648007070 None] Volume volume-d1d2cd2b-bc4e-4620-8e09-570c268e9240 (d1d2cd2b-bc4e-4620-8e09-570c268e9240): created successfully Jul 30 17:10:25 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-d297a20a-bd1f-4805-a12b-c887401d01da tempest-CreateVolumesFromSnapshotTest-1648007070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7897a005-2989-458b-ae4d-5253bf42795f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:25 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-d297a20a-bd1f-4805-a12b-c887401d01da tempest-CreateVolumesFromSnapshotTest-1648007070 None] Flow 'volume_create_manager' (2185dc1b-0207-4c7b-8d17-f063cb9f9219) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:10:25 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-d297a20a-bd1f-4805-a12b-c887401d01da tempest-CreateVolumesFromSnapshotTest-1648007070 None] Created volume successfully. Jul 30 17:10:26 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd0227dc-d4bb-4e68-bb2c-4ac067323ba8 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:10:26 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-bd0227dc-d4bb-4e68-bb2c-4ac067323ba8 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Flow 'volume_create_manager' (c6401153-4146-4633-a56b-561892384682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:10:26 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-bd0227dc-d4bb-4e68-bb2c-4ac067323ba8 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc1b8755-86cb-4c0c-a50c-6bef42b36e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:26 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-bd0227dc-d4bb-4e68-bb2c-4ac067323ba8 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc1b8755-86cb-4c0c-a50c-6bef42b36e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:10:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1480137628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4398da83-d143-4062-bbba-12e2e73596b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='966adfc9a22049f1941971b527ef521c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:10:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:10:26Z,use_quota=True,user_id='0af5567b32ab4efaa072c0bc24984cc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:26 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-bd0227dc-d4bb-4e68-bb2c-4ac067323ba8 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0fb9ba1-13c5-4a2a-b65c-60463088df3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:26 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-bd0227dc-d4bb-4e68-bb2c-4ac067323ba8 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0fb9ba1-13c5-4a2a-b65c-60463088df3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:26 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-bd0227dc-d4bb-4e68-bb2c-4ac067323ba8 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a163fe41-8237-4ebe-bf2b-95328d2f4e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:26 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-bd0227dc-d4bb-4e68-bb2c-4ac067323ba8 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a163fe41-8237-4ebe-bf2b-95328d2f4e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4398da83-d143-4062-bbba-12e2e73596b3', 'volume_name': 'volume-4398da83-d143-4062-bbba-12e2e73596b3', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:26 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-bd0227dc-d4bb-4e68-bb2c-4ac067323ba8 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb757c1b-8967-470a-b34b-6cf7972d1741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:26 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-bd0227dc-d4bb-4e68-bb2c-4ac067323ba8 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb757c1b-8967-470a-b34b-6cf7972d1741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:26 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-bd0227dc-d4bb-4e68-bb2c-4ac067323ba8 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b7f6d65-9f13-469d-bf6b-e7132aaca8f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:26 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-bd0227dc-d4bb-4e68-bb2c-4ac067323ba8 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Volume 4398da83-d143-4062-bbba-12e2e73596b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4398da83-d143-4062-bbba-12e2e73596b3', 'volume_size': 1} Jul 30 17:10:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-bd0227dc-d4bb-4e68-bb2c-4ac067323ba8 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-bd0227dc-d4bb-4e68-bb2c-4ac067323ba8 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:26 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-bd0227dc-d4bb-4e68-bb2c-4ac067323ba8 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:10:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1480137628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4398da83-d143-4062-bbba-12e2e73596b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='966adfc9a22049f1941971b527ef521c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:10:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:10:26Z,use_quota=True,user_id='0af5567b32ab4efaa072c0bc24984cc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:10:26 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-bd0227dc-d4bb-4e68-bb2c-4ac067323ba8 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Creating volume 4398da83-d143-4062-bbba-12e2e73596b3 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:10:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-bd0227dc-d4bb-4e68-bb2c-4ac067323ba8 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-bd0227dc-d4bb-4e68-bb2c-4ac067323ba8 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:26 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-bd0227dc-d4bb-4e68-bb2c-4ac067323ba8 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:10:26 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-bd0227dc-d4bb-4e68-bb2c-4ac067323ba8 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:10:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-bd0227dc-d4bb-4e68-bb2c-4ac067323ba8 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:26 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-bd0227dc-d4bb-4e68-bb2c-4ac067323ba8 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:10:26 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-bd0227dc-d4bb-4e68-bb2c-4ac067323ba8 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:10:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-bd0227dc-d4bb-4e68-bb2c-4ac067323ba8 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4398da83-d143-4062-bbba-12e2e73596b3 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-78c3d302-55c3-4c0b-957e-46fa0ad311d4 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:26 devstack sudo[107737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4398da83-d143-4062-bbba-12e2e73596b3 1073741824 Jul 30 17:10:26 devstack sudo[107737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:26 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-493f50ef-51ff-4ece-82f1-40c5d5817d7b tempest-VolumeImageDependencyTests-418620943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:10:26 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-493f50ef-51ff-4ece-82f1-40c5d5817d7b tempest-VolumeImageDependencyTests-418620943 None] Flow 'volume_create_manager' (1bbf44a3-5d78-4643-8797-03f62c95a22d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:10:26 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-493f50ef-51ff-4ece-82f1-40c5d5817d7b tempest-VolumeImageDependencyTests-418620943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e34a70d7-1fab-48f4-b342-75bd72a71a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:26 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-493f50ef-51ff-4ece-82f1-40c5d5817d7b tempest-VolumeImageDependencyTests-418620943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e34a70d7-1fab-48f4-b342-75bd72a71a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:10:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01919c96-7ba3-4802-b03f-00413ce0183d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea282265e169485f8f81c8ad42213435',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:10:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:10:26Z,use_quota=True,user_id='abe5db238ac84699874b624100c83244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:26 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-493f50ef-51ff-4ece-82f1-40c5d5817d7b tempest-VolumeImageDependencyTests-418620943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d925f57-ca6d-47c1-a18b-548ef73894ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:26 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-493f50ef-51ff-4ece-82f1-40c5d5817d7b tempest-VolumeImageDependencyTests-418620943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d925f57-ca6d-47c1-a18b-548ef73894ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:26 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-493f50ef-51ff-4ece-82f1-40c5d5817d7b tempest-VolumeImageDependencyTests-418620943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc23fa87-1423-4043-8c3f-9b193530af49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:26 devstack cinder-volume[88568]: DEBUG cinder.image.glance [None req-493f50ef-51ff-4ece-82f1-40c5d5817d7b tempest-VolumeImageDependencyTests-418620943 None] Creating Keystone auth plugin from conf {{(pid=88568) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 30 17:10:26 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f5efd4b-720a-4764-a5ca-031b7e452bff tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:10:26 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9f5efd4b-720a-4764-a5ca-031b7e452bff tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Flow 'volume_create_manager' (27101d4b-812a-488b-b951-821abfb57f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:10:26 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9f5efd4b-720a-4764-a5ca-031b7e452bff tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bc8bc2f-c5be-4af4-b3df-817fea5e7f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:26 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9f5efd4b-720a-4764-a5ca-031b7e452bff tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bc8bc2f-c5be-4af4-b3df-817fea5e7f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:10:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1451864037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fb044fc-95ac-4d85-924d-6152b0d88de4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='966adfc9a22049f1941971b527ef521c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:10:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:10:26Z,use_quota=True,user_id='0af5567b32ab4efaa072c0bc24984cc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:26 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9f5efd4b-720a-4764-a5ca-031b7e452bff tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d136345f-dd44-4ea8-b2b0-5d0408fa667c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:26 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9f5efd4b-720a-4764-a5ca-031b7e452bff tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d136345f-dd44-4ea8-b2b0-5d0408fa667c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:26 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9f5efd4b-720a-4764-a5ca-031b7e452bff tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fc15f27-42cd-4853-b668-ac24d091181d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:26 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9f5efd4b-720a-4764-a5ca-031b7e452bff tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fc15f27-42cd-4853-b668-ac24d091181d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fb044fc-95ac-4d85-924d-6152b0d88de4', 'volume_name': 'volume-2fb044fc-95ac-4d85-924d-6152b0d88de4', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:26 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9f5efd4b-720a-4764-a5ca-031b7e452bff tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d0fede1-517c-452f-bba0-90651b8d7129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:26 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9f5efd4b-720a-4764-a5ca-031b7e452bff tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d0fede1-517c-452f-bba0-90651b8d7129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:26 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9f5efd4b-720a-4764-a5ca-031b7e452bff tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24374640-db40-4b3d-8924-c5dd65b89bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:26 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-9f5efd4b-720a-4764-a5ca-031b7e452bff tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Volume 2fb044fc-95ac-4d85-924d-6152b0d88de4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fb044fc-95ac-4d85-924d-6152b0d88de4', 'volume_size': 1} Jul 30 17:10:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-9f5efd4b-720a-4764-a5ca-031b7e452bff tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:26 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-daa15a97-cd32-43a7-a7a6-5b4dc775546a tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:10:26 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-daa15a97-cd32-43a7-a7a6-5b4dc775546a tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Flow 'volume_create_manager' (29d94d75-a2e2-48ec-b2ed-be29b36a6861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:10:26 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-daa15a97-cd32-43a7-a7a6-5b4dc775546a tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10fb5c10-f1e2-4df2-a242-6efb483e2ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:26 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-daa15a97-cd32-43a7-a7a6-5b4dc775546a tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10fb5c10-f1e2-4df2-a242-6efb483e2ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:10:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1922275487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6f84c02-20a0-4364-8589-c232dfd34474,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='966adfc9a22049f1941971b527ef521c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:10:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:10:27Z,use_quota=True,user_id='0af5567b32ab4efaa072c0bc24984cc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:26 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-daa15a97-cd32-43a7-a7a6-5b4dc775546a tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32aca984-7843-47a0-ac76-625c27a5b7a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:26 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-daa15a97-cd32-43a7-a7a6-5b4dc775546a tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32aca984-7843-47a0-ac76-625c27a5b7a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:26 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-daa15a97-cd32-43a7-a7a6-5b4dc775546a tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76dafa10-c20f-4a1a-9f69-9e2bab118694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:26 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-daa15a97-cd32-43a7-a7a6-5b4dc775546a tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76dafa10-c20f-4a1a-9f69-9e2bab118694) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6f84c02-20a0-4364-8589-c232dfd34474', 'volume_name': 'volume-e6f84c02-20a0-4364-8589-c232dfd34474', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:26 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-daa15a97-cd32-43a7-a7a6-5b4dc775546a tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (338a658b-23f9-436a-be80-67a4b5530e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:26 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-daa15a97-cd32-43a7-a7a6-5b4dc775546a tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (338a658b-23f9-436a-be80-67a4b5530e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:26 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-daa15a97-cd32-43a7-a7a6-5b4dc775546a tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac9811b8-855b-4339-bb0d-0cf8347f8ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:26 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-daa15a97-cd32-43a7-a7a6-5b4dc775546a tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Volume e6f84c02-20a0-4364-8589-c232dfd34474: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6f84c02-20a0-4364-8589-c232dfd34474', 'volume_size': 1} Jul 30 17:10:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-daa15a97-cd32-43a7-a7a6-5b4dc775546a tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:26 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-493f50ef-51ff-4ece-82f1-40c5d5817d7b tempest-VolumeImageDependencyTests-418620943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc23fa87-1423-4043-8c3f-9b193530af49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '01919c96-7ba3-4802-b03f-00413ce0183d', 'volume_name': 'volume-01919c96-7ba3-4802-b03f-00413ce0183d', 'volume_size': 1, 'image_id': 'c9603162-6489-4e7e-b109-aff864f9917c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c9603162-6489-4e7e-b109-aff864f9917c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd76cef1185cf06db33c6cde4bd83ba5d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ea282265e169485f8f81c8ad42213435', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '60f4fe4c8ccbfd6d027db038b5021f5dcc7095b432bbcacf5269b9447293b64ec3881117fb723c3accf1aa005d027e700c3c2b202a14a24b452b773a26b64e6d', 'id': 'c9603162-6489-4e7e-b109-aff864f9917c', 'created_at': datetime.datetime(2026, 7, 30, 15, 10, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 15, 10, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c9603162-6489-4e7e-b109-aff864f9917c/file', 'properties': {}}, 'image_service': }' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:26 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-493f50ef-51ff-4ece-82f1-40c5d5817d7b tempest-VolumeImageDependencyTests-418620943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c4bcc4e-43a6-495b-a690-5d0410523845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:26 devstack sudo[107737]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:26 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-493f50ef-51ff-4ece-82f1-40c5d5817d7b tempest-VolumeImageDependencyTests-418620943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c4bcc4e-43a6-495b-a690-5d0410523845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:26 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-493f50ef-51ff-4ece-82f1-40c5d5817d7b tempest-VolumeImageDependencyTests-418620943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f664b68-4f86-4651-9d63-07f55e397a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:26 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-493f50ef-51ff-4ece-82f1-40c5d5817d7b tempest-VolumeImageDependencyTests-418620943 None] Volume 01919c96-7ba3-4802-b03f-00413ce0183d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-01919c96-7ba3-4802-b03f-00413ce0183d', 'volume_size': 1, 'image_id': 'c9603162-6489-4e7e-b109-aff864f9917c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c9603162-6489-4e7e-b109-aff864f9917c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd76cef1185cf06db33c6cde4bd83ba5d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ea282265e169485f8f81c8ad42213435', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '60f4fe4c8ccbfd6d027db038b5021f5dcc7095b432bbcacf5269b9447293b64ec3881117fb723c3accf1aa005d027e700c3c2b202a14a24b452b773a26b64e6d', 'id': 'c9603162-6489-4e7e-b109-aff864f9917c', 'created_at': datetime.datetime(2026, 7, 30, 15, 10, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 15, 10, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c9603162-6489-4e7e-b109-aff864f9917c/file', 'properties': {}}, 'image_service': } Jul 30 17:10:26 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-493f50ef-51ff-4ece-82f1-40c5d5817d7b tempest-VolumeImageDependencyTests-418620943 None] Trying to clone 01919c96-7ba3-4802-b03f-00413ce0183d from image c9603162-6489-4e7e-b109-aff864f9917c at location (None, [{'url': 'file:///opt/stack/data/glance/images/c9603162-6489-4e7e-b109-aff864f9917c', 'metadata': {}}]). {{(pid=88568) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 30 17:10:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-bd0227dc-d4bb-4e68-bb2c-4ac067323ba8 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4398da83-d143-4062-bbba-12e2e73596b3 1073741824" returned: 0 in 0.785s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-bd0227dc-d4bb-4e68-bb2c-4ac067323ba8 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4398da83-d143-4062-bbba-12e2e73596b3 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:27 devstack sudo[107743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4398da83-d143-4062-bbba-12e2e73596b3 Jul 30 17:10:27 devstack sudo[107743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:27 devstack cinder-volume[88568]: DEBUG cinder.image.image_utils [None req-493f50ef-51ff-4ece-82f1-40c5d5817d7b tempest-VolumeImageDependencyTests-418620943 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c9603162-6489-4e7e-b109-aff864f9917c_3wtsdsohdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88568) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 30 17:10:27 devstack cinder-volume[88568]: INFO cinder.image.image_utils [None req-493f50ef-51ff-4ece-82f1-40c5d5817d7b tempest-VolumeImageDependencyTests-418620943 None] Image download 0.00 MB at 0.00 MB/s Jul 30 17:10:27 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f36fa18-5fd5-4688-9a74-eb7518e01bca]: (4, 'raw') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:10:27 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-493f50ef-51ff-4ece-82f1-40c5d5817d7b tempest-VolumeImageDependencyTests-418620943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c9603162-6489-4e7e-b109-aff864f9917c_3wtsdsohdevstack@QuobyteHD {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:27 devstack sudo[107745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c9603162-6489-4e7e-b109-aff864f9917c_3wtsdsohdevstack@QuobyteHD Jul 30 17:10:27 devstack sudo[107745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:27 devstack sudo[107743]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:27 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-bd0227dc-d4bb-4e68-bb2c-4ac067323ba8 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4398da83-d143-4062-bbba-12e2e73596b3" returned: 0 in 0.368s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:27 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-bd0227dc-d4bb-4e68-bb2c-4ac067323ba8 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] <== create_volume: return (1232ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:10:27 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-bd0227dc-d4bb-4e68-bb2c-4ac067323ba8 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.235s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:27 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-78c3d302-55c3-4c0b-957e-46fa0ad311d4 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.193s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:27 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-bd0227dc-d4bb-4e68-bb2c-4ac067323ba8 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b7f6d65-9f13-469d-bf6b-e7132aaca8f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4398da83-d143-4062-bbba-12e2e73596b3', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:27 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-bd0227dc-d4bb-4e68-bb2c-4ac067323ba8 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11dd8a9e-184d-4c09-87d4-c393d33e5b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:27 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-78c3d302-55c3-4c0b-957e-46fa0ad311d4 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Creating offline snapshot 4daaec3f-d8da-46cc-a15f-f8d434f3d0e4 of volume d1d2cd2b-bc4e-4620-8e09-570c268e9240 {{(pid=88568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:10:27 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-bd0227dc-d4bb-4e68-bb2c-4ac067323ba8 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Volume volume-4398da83-d143-4062-bbba-12e2e73596b3 (4398da83-d143-4062-bbba-12e2e73596b3): created successfully Jul 30 17:10:27 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-bd0227dc-d4bb-4e68-bb2c-4ac067323ba8 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11dd8a9e-184d-4c09-87d4-c393d33e5b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:27 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-bd0227dc-d4bb-4e68-bb2c-4ac067323ba8 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Flow 'volume_create_manager' (c6401153-4146-4633-a56b-561892384682) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:10:27 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ddf9ef-d660-4368-a5a7-fbbea1e94096]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:10:27 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-78c3d302-55c3-4c0b-957e-46fa0ad311d4 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d1d2cd2b-bc4e-4620-8e09-570c268e9240 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:27 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-13b78012-f341-44fd-b621-5318665582a3 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:10:27 devstack sudo[107745]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:27 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-13b78012-f341-44fd-b621-5318665582a3 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Flow 'volume_create_manager' (8ed768b4-8e43-45f1-a573-a55f0eaf9e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:10:27 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-13b78012-f341-44fd-b621-5318665582a3 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4851e52-e6e7-4cb4-b220-5c0e355d564d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:27 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-bd0227dc-d4bb-4e68-bb2c-4ac067323ba8 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Created volume successfully. Jul 30 17:10:27 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-493f50ef-51ff-4ece-82f1-40c5d5817d7b tempest-VolumeImageDependencyTests-418620943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c9603162-6489-4e7e-b109-aff864f9917c_3wtsdsohdevstack@QuobyteHD" returned: 0 in 0.452s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:27 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-493f50ef-51ff-4ece-82f1-40c5d5817d7b tempest-VolumeImageDependencyTests-418620943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9603162-6489-4e7e-b109-aff864f9917c_3wtsdsohdevstack@QuobyteHD {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:27 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-13b78012-f341-44fd-b621-5318665582a3 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4851e52-e6e7-4cb4-b220-5c0e355d564d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:10:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1673045784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c081c145-134f-4809-bc3c-a43d20ccc436,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='966adfc9a22049f1941971b527ef521c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:10:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:10:27Z,use_quota=True,user_id='0af5567b32ab4efaa072c0bc24984cc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:27 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-13b78012-f341-44fd-b621-5318665582a3 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5179992-cbe0-4149-9400-cf545ecb28c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:27 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-13b78012-f341-44fd-b621-5318665582a3 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5179992-cbe0-4149-9400-cf545ecb28c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:27 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-13b78012-f341-44fd-b621-5318665582a3 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d25a5a1c-d020-4bfb-ae3f-8883921c5d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:27 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-13b78012-f341-44fd-b621-5318665582a3 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d25a5a1c-d020-4bfb-ae3f-8883921c5d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c081c145-134f-4809-bc3c-a43d20ccc436', 'volume_name': 'volume-c081c145-134f-4809-bc3c-a43d20ccc436', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:27 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-13b78012-f341-44fd-b621-5318665582a3 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d8b1162-9373-46f6-81e1-8ac1df861330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:27 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-13b78012-f341-44fd-b621-5318665582a3 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d8b1162-9373-46f6-81e1-8ac1df861330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:27 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-13b78012-f341-44fd-b621-5318665582a3 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cd8b5c8-ddc5-4671-b8e3-562c64f4fd89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:27 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-13b78012-f341-44fd-b621-5318665582a3 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Volume c081c145-134f-4809-bc3c-a43d20ccc436: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c081c145-134f-4809-bc3c-a43d20ccc436', 'volume_size': 1} Jul 30 17:10:27 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-13b78012-f341-44fd-b621-5318665582a3 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:27 devstack sudo[107749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d1d2cd2b-bc4e-4620-8e09-570c268e9240 Jul 30 17:10:27 devstack sudo[107749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:27 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc618e01-2d85-4be2-ba5e-e9a8827b343c tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:10:27 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-dc618e01-2d85-4be2-ba5e-e9a8827b343c tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Flow 'volume_create_manager' (536e7014-b15e-4e23-b576-2ba1d7962a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:10:27 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-dc618e01-2d85-4be2-ba5e-e9a8827b343c tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28d97696-89ef-468a-8bf3-0396a2bb3dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:27 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f10da4e-4411-4ff5-a7f5-6de4e935d05a tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:10:27 devstack sudo[107751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9603162-6489-4e7e-b109-aff864f9917c_3wtsdsohdevstack@QuobyteHD Jul 30 17:10:27 devstack sudo[107751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:27 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9f10da4e-4411-4ff5-a7f5-6de4e935d05a tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] Flow 'volume_create_manager' (e89627a0-3718-4e92-ae8f-ae45c95b4d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:10:27 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9f10da4e-4411-4ff5-a7f5-6de4e935d05a tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ce2e4d1-86bd-4237-8f50-800fd3f97ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:27 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9f10da4e-4411-4ff5-a7f5-6de4e935d05a tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ce2e4d1-86bd-4237-8f50-800fd3f97ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:10:27Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98f74670-d5eb-4e3b-93fd-f27f66792f4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='916d6533ed214008ac358384ae464381',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:10:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:10:27Z,use_quota=True,user_id='f0e50b4878574e5ba94f504c0720c0ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60fc5722-9a66-4e80-91c6-50bfc51b10e5),volume_type_id=60fc5722-9a66-4e80-91c6-50bfc51b10e5)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:27 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9f10da4e-4411-4ff5-a7f5-6de4e935d05a tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (077fe5b5-e04b-4a95-bb47-88d5533941d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:27 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9f10da4e-4411-4ff5-a7f5-6de4e935d05a tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (077fe5b5-e04b-4a95-bb47-88d5533941d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:27 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9f10da4e-4411-4ff5-a7f5-6de4e935d05a tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (372fb673-f626-4ffa-a78c-f4d2649cdea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:27 devstack cinder-volume[88568]: DEBUG cinder.image.glance [None req-9f10da4e-4411-4ff5-a7f5-6de4e935d05a tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] Creating Keystone auth plugin from conf {{(pid=88568) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 30 17:10:27 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-dc618e01-2d85-4be2-ba5e-e9a8827b343c tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28d97696-89ef-468a-8bf3-0396a2bb3dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:10:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-202779798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b358a76-5c35-4f15-9c8d-ad3c833debf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='966adfc9a22049f1941971b527ef521c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:10:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:10:28Z,use_quota=True,user_id='0af5567b32ab4efaa072c0bc24984cc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:27 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-dc618e01-2d85-4be2-ba5e-e9a8827b343c tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48fcbab8-9c14-47c7-abc8-e9b11fb8d967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:27 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-dc618e01-2d85-4be2-ba5e-e9a8827b343c tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48fcbab8-9c14-47c7-abc8-e9b11fb8d967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:27 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-dc618e01-2d85-4be2-ba5e-e9a8827b343c tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b250937-d6dc-48e8-97cb-21a8565e8870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:27 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-dc618e01-2d85-4be2-ba5e-e9a8827b343c tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b250937-d6dc-48e8-97cb-21a8565e8870) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b358a76-5c35-4f15-9c8d-ad3c833debf7', 'volume_name': 'volume-4b358a76-5c35-4f15-9c8d-ad3c833debf7', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:27 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-dc618e01-2d85-4be2-ba5e-e9a8827b343c tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (284047ae-f3fb-4678-8a9d-9c3291875c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:27 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-dc618e01-2d85-4be2-ba5e-e9a8827b343c tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (284047ae-f3fb-4678-8a9d-9c3291875c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:27 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-dc618e01-2d85-4be2-ba5e-e9a8827b343c tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10fb73e6-3908-4375-af26-1e090cc715d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:27 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-dc618e01-2d85-4be2-ba5e-e9a8827b343c tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Volume 4b358a76-5c35-4f15-9c8d-ad3c833debf7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b358a76-5c35-4f15-9c8d-ad3c833debf7', 'volume_size': 1} Jul 30 17:10:27 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-dc618e01-2d85-4be2-ba5e-e9a8827b343c tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:28 devstack sudo[107749]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-78c3d302-55c3-4c0b-957e-46fa0ad311d4 tempest-CreateVolumesFromSnapshotTest-1648007070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d1d2cd2b-bc4e-4620-8e09-570c268e9240" returned: 0 in 0.477s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-78c3d302-55c3-4c0b-957e-46fa0ad311d4 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d1d2cd2b-bc4e-4620-8e09-570c268e9240,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d1d2cd2b-bc4e-4620-8e09-570c268e9240.4daaec3f-d8da-46cc-a15f-f8d434f3d0e4 1G {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:28 devstack sudo[107751]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-493f50ef-51ff-4ece-82f1-40c5d5817d7b tempest-VolumeImageDependencyTests-418620943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9603162-6489-4e7e-b109-aff864f9917c_3wtsdsohdevstack@QuobyteHD" returned: 1 in 0.436s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-493f50ef-51ff-4ece-82f1-40c5d5817d7b tempest-VolumeImageDependencyTests-418620943 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9603162-6489-4e7e-b109-aff864f9917c_3wtsdsohdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 17:10:28 devstack cinder-volume[88568]: DEBUG cinder.image.image_utils [None req-493f50ef-51ff-4ece-82f1-40c5d5817d7b tempest-VolumeImageDependencyTests-418620943 None] Temporary image c9603162-6489-4e7e-b109-aff864f9917c is fetched for user abe5db238ac84699874b624100c83244. {{(pid=88568) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 30 17:10:28 devstack sudo[107760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d1d2cd2b-bc4e-4620-8e09-570c268e9240,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d1d2cd2b-bc4e-4620-8e09-570c268e9240.4daaec3f-d8da-46cc-a15f-f8d434f3d0e4 1G Jul 30 17:10:28 devstack sudo[107760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:28 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9f10da4e-4411-4ff5-a7f5-6de4e935d05a tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (372fb673-f626-4ffa-a78c-f4d2649cdea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '98f74670-d5eb-4e3b-93fd-f27f66792f4e', 'volume_name': 'volume-98f74670-d5eb-4e3b-93fd-f27f66792f4e', 'volume_size': 1, 'image_id': '5743808e-c055-4ac6-8ff9-017d24ee38df', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5743808e-c055-4ac6-8ff9-017d24ee38df', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1efa6977721ea726abd0777db39741f3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '916d6533ed214008ac358384ae464381', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8712d742886b617bc402cf9638ba467fc2bd696fd984b2c2758a41bea86c94700158cf67e909ef298951364e6852dea6060f09d7f2cfd449ccd94d73024ead58', 'id': '5743808e-c055-4ac6-8ff9-017d24ee38df', 'created_at': datetime.datetime(2026, 7, 30, 15, 10, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 15, 10, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5743808e-c055-4ac6-8ff9-017d24ee38df/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:28 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9f10da4e-4411-4ff5-a7f5-6de4e935d05a tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1de84682-cffe-4dbf-9103-31656c0f3032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:28 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9f10da4e-4411-4ff5-a7f5-6de4e935d05a tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1de84682-cffe-4dbf-9103-31656c0f3032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:28 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9f10da4e-4411-4ff5-a7f5-6de4e935d05a tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (644fcfa2-822f-4cc6-96bf-deb6e1ddfa40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:28 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-9f10da4e-4411-4ff5-a7f5-6de4e935d05a tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] Volume 98f74670-d5eb-4e3b-93fd-f27f66792f4e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-98f74670-d5eb-4e3b-93fd-f27f66792f4e', 'volume_size': 1, 'image_id': '5743808e-c055-4ac6-8ff9-017d24ee38df', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5743808e-c055-4ac6-8ff9-017d24ee38df', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1efa6977721ea726abd0777db39741f3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '916d6533ed214008ac358384ae464381', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8712d742886b617bc402cf9638ba467fc2bd696fd984b2c2758a41bea86c94700158cf67e909ef298951364e6852dea6060f09d7f2cfd449ccd94d73024ead58', 'id': '5743808e-c055-4ac6-8ff9-017d24ee38df', 'created_at': datetime.datetime(2026, 7, 30, 15, 10, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 15, 10, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5743808e-c055-4ac6-8ff9-017d24ee38df/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 30 17:10:28 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f10da4e-4411-4ff5-a7f5-6de4e935d05a tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] Trying to clone 98f74670-d5eb-4e3b-93fd-f27f66792f4e from image 5743808e-c055-4ac6-8ff9-017d24ee38df at location (None, [{'url': 'file:///opt/stack/data/glance/images/5743808e-c055-4ac6-8ff9-017d24ee38df', 'metadata': {}}]). {{(pid=88568) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 30 17:10:28 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[582a8bc0-6935-433e-a2a3-9a93e436fedd]: (4, 'raw') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:10:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-493f50ef-51ff-4ece-82f1-40c5d5817d7b tempest-VolumeImageDependencyTests-418620943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c9603162-6489-4e7e-b109-aff864f9917c_3wtsdsohdevstack@QuobyteHD {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:28 devstack cinder-volume[88568]: DEBUG cinder.image.image_utils [None req-9f10da4e-4411-4ff5-a7f5-6de4e935d05a tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5743808e-c055-4ac6-8ff9-017d24ee38df_u23eagmidevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88568) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 30 17:10:28 devstack cinder-volume[88568]: INFO cinder.image.image_utils [None req-9f10da4e-4411-4ff5-a7f5-6de4e935d05a tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] Image download 0.00 MB at 0.00 MB/s Jul 30 17:10:28 devstack sudo[107762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c9603162-6489-4e7e-b109-aff864f9917c_3wtsdsohdevstack@QuobyteHD Jul 30 17:10:28 devstack sudo[107762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:28 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3dbef4-56ec-436d-8cd9-a94a103d0b5c]: (4, 'raw') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:10:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9f10da4e-4411-4ff5-a7f5-6de4e935d05a tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5743808e-c055-4ac6-8ff9-017d24ee38df_u23eagmidevstack@QuobyteHD {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:28 devstack sudo[107766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5743808e-c055-4ac6-8ff9-017d24ee38df_u23eagmidevstack@QuobyteHD Jul 30 17:10:28 devstack sudo[107766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:28 devstack sudo[107760]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-78c3d302-55c3-4c0b-957e-46fa0ad311d4 tempest-CreateVolumesFromSnapshotTest-1648007070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d1d2cd2b-bc4e-4620-8e09-570c268e9240,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d1d2cd2b-bc4e-4620-8e09-570c268e9240.4daaec3f-d8da-46cc-a15f-f8d434f3d0e4 1G" returned: 0 in 0.493s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-78c3d302-55c3-4c0b-957e-46fa0ad311d4 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1d2cd2b-bc4e-4620-8e09-570c268e9240 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d1d2cd2b-bc4e-4620-8e09-570c268e9240.4daaec3f-d8da-46cc-a15f-f8d434f3d0e4 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:28 devstack sudo[107762]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-493f50ef-51ff-4ece-82f1-40c5d5817d7b tempest-VolumeImageDependencyTests-418620943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c9603162-6489-4e7e-b109-aff864f9917c_3wtsdsohdevstack@QuobyteHD" returned: 0 in 0.377s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-493f50ef-51ff-4ece-82f1-40c5d5817d7b tempest-VolumeImageDependencyTests-418620943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9603162-6489-4e7e-b109-aff864f9917c_3wtsdsohdevstack@QuobyteHD {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:28 devstack sudo[107772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1d2cd2b-bc4e-4620-8e09-570c268e9240 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d1d2cd2b-bc4e-4620-8e09-570c268e9240.4daaec3f-d8da-46cc-a15f-f8d434f3d0e4 Jul 30 17:10:28 devstack sudo[107772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:28 devstack sudo[107766]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:28 devstack sudo[107773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9603162-6489-4e7e-b109-aff864f9917c_3wtsdsohdevstack@QuobyteHD Jul 30 17:10:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9f10da4e-4411-4ff5-a7f5-6de4e935d05a tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5743808e-c055-4ac6-8ff9-017d24ee38df_u23eagmidevstack@QuobyteHD" returned: 0 in 0.361s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:28 devstack sudo[107773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9f10da4e-4411-4ff5-a7f5-6de4e935d05a tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5743808e-c055-4ac6-8ff9-017d24ee38df_u23eagmidevstack@QuobyteHD {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:28 devstack sudo[107778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5743808e-c055-4ac6-8ff9-017d24ee38df_u23eagmidevstack@QuobyteHD Jul 30 17:10:28 devstack sudo[107778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:28 devstack sudo[107772]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-78c3d302-55c3-4c0b-957e-46fa0ad311d4 tempest-CreateVolumesFromSnapshotTest-1648007070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1d2cd2b-bc4e-4620-8e09-570c268e9240 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d1d2cd2b-bc4e-4620-8e09-570c268e9240.4daaec3f-d8da-46cc-a15f-f8d434f3d0e4" returned: 0 in 0.305s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:28 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-78c3d302-55c3-4c0b-957e-46fa0ad311d4 tempest-CreateVolumesFromSnapshotTest-1648007070 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d1d2cd2b-bc4e-4620-8e09-570c268e9240.4daaec3f-d8da-46cc-a15f-f8d434f3d0e4 is being set with open permissions: ugo+rw Jul 30 17:10:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-78c3d302-55c3-4c0b-957e-46fa0ad311d4 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d1d2cd2b-bc4e-4620-8e09-570c268e9240.4daaec3f-d8da-46cc-a15f-f8d434f3d0e4 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:28 devstack sudo[107783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d1d2cd2b-bc4e-4620-8e09-570c268e9240.4daaec3f-d8da-46cc-a15f-f8d434f3d0e4 Jul 30 17:10:28 devstack sudo[107783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:28 devstack sudo[107773]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-493f50ef-51ff-4ece-82f1-40c5d5817d7b tempest-VolumeImageDependencyTests-418620943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9603162-6489-4e7e-b109-aff864f9917c_3wtsdsohdevstack@QuobyteHD" returned: 1 in 0.353s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-493f50ef-51ff-4ece-82f1-40c5d5817d7b tempest-VolumeImageDependencyTests-418620943 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9603162-6489-4e7e-b109-aff864f9917c_3wtsdsohdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 17:10:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-493f50ef-51ff-4ece-82f1-40c5d5817d7b tempest-VolumeImageDependencyTests-418620943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:28 devstack sudo[107778]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9f10da4e-4411-4ff5-a7f5-6de4e935d05a tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5743808e-c055-4ac6-8ff9-017d24ee38df_u23eagmidevstack@QuobyteHD" returned: 1 in 0.338s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9f10da4e-4411-4ff5-a7f5-6de4e935d05a tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5743808e-c055-4ac6-8ff9-017d24ee38df_u23eagmidevstack@QuobyteHD' failed. Not Retrying. {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 17:10:28 devstack cinder-volume[88568]: DEBUG cinder.image.image_utils [None req-9f10da4e-4411-4ff5-a7f5-6de4e935d05a tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] Temporary image 5743808e-c055-4ac6-8ff9-017d24ee38df is fetched for user f0e50b4878574e5ba94f504c0720c0ab. {{(pid=88568) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 30 17:10:29 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5650b90-a0ec-4de8-a0e5-056a0a8e3968]: (4, 'raw') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:10:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9f10da4e-4411-4ff5-a7f5-6de4e935d05a tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5743808e-c055-4ac6-8ff9-017d24ee38df_u23eagmidevstack@QuobyteHD {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:29 devstack sudo[107783]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-78c3d302-55c3-4c0b-957e-46fa0ad311d4 tempest-CreateVolumesFromSnapshotTest-1648007070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d1d2cd2b-bc4e-4620-8e09-570c268e9240.4daaec3f-d8da-46cc-a15f-f8d434f3d0e4" returned: 0 in 0.270s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-78c3d302-55c3-4c0b-957e-46fa0ad311d4 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d1d2cd2b-bc4e-4620-8e09-570c268e9240.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:29 devstack sudo[107793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d1d2cd2b-bc4e-4620-8e09-570c268e9240.info Jul 30 17:10:29 devstack sudo[107793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:29 devstack sudo[107792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5743808e-c055-4ac6-8ff9-017d24ee38df_u23eagmidevstack@QuobyteHD Jul 30 17:10:29 devstack sudo[107792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:29 devstack sudo[107793]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-78c3d302-55c3-4c0b-957e-46fa0ad311d4 tempest-CreateVolumesFromSnapshotTest-1648007070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d1d2cd2b-bc4e-4620-8e09-570c268e9240.info" returned: 0 in 0.255s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:29 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-78c3d302-55c3-4c0b-957e-46fa0ad311d4 tempest-CreateVolumesFromSnapshotTest-1648007070 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d1d2cd2b-bc4e-4620-8e09-570c268e9240.info is being set with open permissions: ugo+rw Jul 30 17:10:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-78c3d302-55c3-4c0b-957e-46fa0ad311d4 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d1d2cd2b-bc4e-4620-8e09-570c268e9240.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:29 devstack sudo[107799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d1d2cd2b-bc4e-4620-8e09-570c268e9240.info Jul 30 17:10:29 devstack sudo[107792]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:29 devstack sudo[107799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9f10da4e-4411-4ff5-a7f5-6de4e935d05a tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5743808e-c055-4ac6-8ff9-017d24ee38df_u23eagmidevstack@QuobyteHD" returned: 0 in 0.344s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9f10da4e-4411-4ff5-a7f5-6de4e935d05a tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5743808e-c055-4ac6-8ff9-017d24ee38df_u23eagmidevstack@QuobyteHD {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:29 devstack sudo[107801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5743808e-c055-4ac6-8ff9-017d24ee38df_u23eagmidevstack@QuobyteHD Jul 30 17:10:29 devstack sudo[107801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:29 devstack sudo[107799]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-78c3d302-55c3-4c0b-957e-46fa0ad311d4 tempest-CreateVolumesFromSnapshotTest-1648007070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d1d2cd2b-bc4e-4620-8e09-570c268e9240.info" returned: 0 in 0.264s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-78c3d302-55c3-4c0b-957e-46fa0ad311d4 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.290s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-9f5efd4b-720a-4764-a5ca-031b7e452bff tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.171s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:29 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-9f5efd4b-720a-4764-a5ca-031b7e452bff tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:10:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1451864037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fb044fc-95ac-4d85-924d-6152b0d88de4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='966adfc9a22049f1941971b527ef521c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:10:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:10:26Z,use_quota=True,user_id='0af5567b32ab4efaa072c0bc24984cc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:10:29 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-9f5efd4b-720a-4764-a5ca-031b7e452bff tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Creating volume 2fb044fc-95ac-4d85-924d-6152b0d88de4 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:10:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-9f5efd4b-720a-4764-a5ca-031b7e452bff tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-9f5efd4b-720a-4764-a5ca-031b7e452bff tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:29 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-9f5efd4b-720a-4764-a5ca-031b7e452bff tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:10:29 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-9f5efd4b-720a-4764-a5ca-031b7e452bff tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:10:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-9f5efd4b-720a-4764-a5ca-031b7e452bff tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:29 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-9f5efd4b-720a-4764-a5ca-031b7e452bff tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:10:29 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-9f5efd4b-720a-4764-a5ca-031b7e452bff tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:10:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9f5efd4b-720a-4764-a5ca-031b7e452bff tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2fb044fc-95ac-4d85-924d-6152b0d88de4 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:29 devstack sudo[107804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2fb044fc-95ac-4d85-924d-6152b0d88de4 1073741824 Jul 30 17:10:29 devstack sudo[107804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:29 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-78c3d302-55c3-4c0b-957e-46fa0ad311d4 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Create snapshot completed successfully Jul 30 17:10:29 devstack sudo[107801]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9f10da4e-4411-4ff5-a7f5-6de4e935d05a tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5743808e-c055-4ac6-8ff9-017d24ee38df_u23eagmidevstack@QuobyteHD" returned: 1 in 0.349s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9f10da4e-4411-4ff5-a7f5-6de4e935d05a tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5743808e-c055-4ac6-8ff9-017d24ee38df_u23eagmidevstack@QuobyteHD' failed. Not Retrying. {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 17:10:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-9f10da4e-4411-4ff5-a7f5-6de4e935d05a tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:30 devstack sudo[107804]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:30 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9f5efd4b-720a-4764-a5ca-031b7e452bff tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2fb044fc-95ac-4d85-924d-6152b0d88de4 1073741824" returned: 0 in 0.424s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:30 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9f5efd4b-720a-4764-a5ca-031b7e452bff tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2fb044fc-95ac-4d85-924d-6152b0d88de4 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:30 devstack sudo[107813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2fb044fc-95ac-4d85-924d-6152b0d88de4 Jul 30 17:10:30 devstack sudo[107813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:30 devstack sudo[107813]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:30 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9f5efd4b-720a-4764-a5ca-031b7e452bff tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2fb044fc-95ac-4d85-924d-6152b0d88de4" returned: 0 in 0.261s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:30 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-9f5efd4b-720a-4764-a5ca-031b7e452bff tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:10:30 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-9f5efd4b-720a-4764-a5ca-031b7e452bff tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:30 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-daa15a97-cd32-43a7-a7a6-5b4dc775546a tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.647s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:30 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-daa15a97-cd32-43a7-a7a6-5b4dc775546a tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:10:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1922275487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6f84c02-20a0-4364-8589-c232dfd34474,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='966adfc9a22049f1941971b527ef521c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:10:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:10:27Z,use_quota=True,user_id='0af5567b32ab4efaa072c0bc24984cc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:10:30 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-daa15a97-cd32-43a7-a7a6-5b4dc775546a tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Creating volume e6f84c02-20a0-4364-8589-c232dfd34474 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:10:30 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-daa15a97-cd32-43a7-a7a6-5b4dc775546a tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:30 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-daa15a97-cd32-43a7-a7a6-5b4dc775546a tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:30 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-daa15a97-cd32-43a7-a7a6-5b4dc775546a tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:10:30 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-daa15a97-cd32-43a7-a7a6-5b4dc775546a tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:10:30 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-daa15a97-cd32-43a7-a7a6-5b4dc775546a tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:30 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-daa15a97-cd32-43a7-a7a6-5b4dc775546a tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:10:30 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-daa15a97-cd32-43a7-a7a6-5b4dc775546a tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:10:30 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-daa15a97-cd32-43a7-a7a6-5b4dc775546a tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e6f84c02-20a0-4364-8589-c232dfd34474 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:30 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9f5efd4b-720a-4764-a5ca-031b7e452bff tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24374640-db40-4b3d-8924-c5dd65b89bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fb044fc-95ac-4d85-924d-6152b0d88de4', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:30 devstack sudo[107816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e6f84c02-20a0-4364-8589-c232dfd34474 1073741824 Jul 30 17:10:30 devstack sudo[107816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:30 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9f5efd4b-720a-4764-a5ca-031b7e452bff tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dbb334e-1be3-42ae-81d7-9e5a662b66b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:30 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-9f5efd4b-720a-4764-a5ca-031b7e452bff tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Volume volume-2fb044fc-95ac-4d85-924d-6152b0d88de4 (2fb044fc-95ac-4d85-924d-6152b0d88de4): created successfully Jul 30 17:10:30 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9f5efd4b-720a-4764-a5ca-031b7e452bff tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dbb334e-1be3-42ae-81d7-9e5a662b66b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:30 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9f5efd4b-720a-4764-a5ca-031b7e452bff tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Flow 'volume_create_manager' (27101d4b-812a-488b-b951-821abfb57f30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:10:30 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-9f5efd4b-720a-4764-a5ca-031b7e452bff tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Created volume successfully. Jul 30 17:10:30 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7c583d2-f3f6-4311-9925-e37a402776a8 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:10:30 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-c7c583d2-f3f6-4311-9925-e37a402776a8 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Flow 'volume_create_manager' (5285ce72-cde9-4f03-bb36-aeee53e570ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:10:30 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-c7c583d2-f3f6-4311-9925-e37a402776a8 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (766d9768-7233-4ffd-acfe-bfab5264119d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:30 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-c7c583d2-f3f6-4311-9925-e37a402776a8 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (766d9768-7233-4ffd-acfe-bfab5264119d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:10:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-628755276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eff3563b-0160-40d2-81d4-2afdd76f93b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a1bfeeec4e441d0b285d4af6adeba66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:10:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:10:31Z,use_quota=True,user_id='42456a79f14e4e68b2d93c2b982eff90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:30 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-c7c583d2-f3f6-4311-9925-e37a402776a8 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4465b7f8-4935-4629-9e64-e464aefd2041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:30 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-c7c583d2-f3f6-4311-9925-e37a402776a8 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4465b7f8-4935-4629-9e64-e464aefd2041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:30 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-c7c583d2-f3f6-4311-9925-e37a402776a8 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4226508-6d40-4d62-b555-de5077d05677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:30 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-c7c583d2-f3f6-4311-9925-e37a402776a8 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4226508-6d40-4d62-b555-de5077d05677) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eff3563b-0160-40d2-81d4-2afdd76f93b2', 'volume_name': 'volume-eff3563b-0160-40d2-81d4-2afdd76f93b2', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:30 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-c7c583d2-f3f6-4311-9925-e37a402776a8 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (269ccad4-2c4a-49fe-8cb0-29f0a923d71c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:30 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-c7c583d2-f3f6-4311-9925-e37a402776a8 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (269ccad4-2c4a-49fe-8cb0-29f0a923d71c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:30 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-c7c583d2-f3f6-4311-9925-e37a402776a8 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (905b4668-3a7c-40cc-bd2b-caaf5d2e9e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:30 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-c7c583d2-f3f6-4311-9925-e37a402776a8 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Volume eff3563b-0160-40d2-81d4-2afdd76f93b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eff3563b-0160-40d2-81d4-2afdd76f93b2', 'volume_size': 1} Jul 30 17:10:30 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-c7c583d2-f3f6-4311-9925-e37a402776a8 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:30 devstack sudo[107816]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:30 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-daa15a97-cd32-43a7-a7a6-5b4dc775546a tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e6f84c02-20a0-4364-8589-c232dfd34474 1073741824" returned: 0 in 0.529s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:30 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-daa15a97-cd32-43a7-a7a6-5b4dc775546a tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e6f84c02-20a0-4364-8589-c232dfd34474 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:31 devstack sudo[107822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e6f84c02-20a0-4364-8589-c232dfd34474 Jul 30 17:10:31 devstack sudo[107822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:31 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-9478ae61-d0ff-40c0-a231-3788973d8571 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:10:31 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9478ae61-d0ff-40c0-a231-3788973d8571 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Flow 'volume_create_manager' (9a3390b8-e30d-4372-b58b-2e7deeac23a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:10:31 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9478ae61-d0ff-40c0-a231-3788973d8571 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ff1dc39-ba74-4f7e-952c-ad526ab15ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:31 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9478ae61-d0ff-40c0-a231-3788973d8571 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ff1dc39-ba74-4f7e-952c-ad526ab15ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:10:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-210221428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb66a854-0389-4789-823f-3350614a6726,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a1bfeeec4e441d0b285d4af6adeba66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:10:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:10:31Z,use_quota=True,user_id='42456a79f14e4e68b2d93c2b982eff90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:31 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9478ae61-d0ff-40c0-a231-3788973d8571 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2042898c-e448-4843-848f-7eec30b3538c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:31 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9478ae61-d0ff-40c0-a231-3788973d8571 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2042898c-e448-4843-848f-7eec30b3538c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:31 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9478ae61-d0ff-40c0-a231-3788973d8571 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11f75d21-32cf-4371-9aee-1ca9fb925151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:31 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9478ae61-d0ff-40c0-a231-3788973d8571 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11f75d21-32cf-4371-9aee-1ca9fb925151) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb66a854-0389-4789-823f-3350614a6726', 'volume_name': 'volume-bb66a854-0389-4789-823f-3350614a6726', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:31 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9478ae61-d0ff-40c0-a231-3788973d8571 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e23aa098-fcf7-4178-a3e4-0c5407e04c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:31 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9478ae61-d0ff-40c0-a231-3788973d8571 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e23aa098-fcf7-4178-a3e4-0c5407e04c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:31 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9478ae61-d0ff-40c0-a231-3788973d8571 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ac55464-cc18-467d-82a4-8cb83d86d456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:31 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-9478ae61-d0ff-40c0-a231-3788973d8571 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Volume bb66a854-0389-4789-823f-3350614a6726: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb66a854-0389-4789-823f-3350614a6726', 'volume_size': 1} Jul 30 17:10:31 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-9478ae61-d0ff-40c0-a231-3788973d8571 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:31 devstack sudo[107822]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:31 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-daa15a97-cd32-43a7-a7a6-5b4dc775546a tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e6f84c02-20a0-4364-8589-c232dfd34474" returned: 0 in 0.282s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:31 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-daa15a97-cd32-43a7-a7a6-5b4dc775546a tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:10:31 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-daa15a97-cd32-43a7-a7a6-5b4dc775546a tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:31 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-13b78012-f341-44fd-b621-5318665582a3 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.605s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:31 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-13b78012-f341-44fd-b621-5318665582a3 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:10:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1673045784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c081c145-134f-4809-bc3c-a43d20ccc436,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='966adfc9a22049f1941971b527ef521c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:10:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:10:27Z,use_quota=True,user_id='0af5567b32ab4efaa072c0bc24984cc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:10:31 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-13b78012-f341-44fd-b621-5318665582a3 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Creating volume c081c145-134f-4809-bc3c-a43d20ccc436 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:10:31 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-13b78012-f341-44fd-b621-5318665582a3 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:31 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-13b78012-f341-44fd-b621-5318665582a3 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:31 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-13b78012-f341-44fd-b621-5318665582a3 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:10:31 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-13b78012-f341-44fd-b621-5318665582a3 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:10:31 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-13b78012-f341-44fd-b621-5318665582a3 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:31 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-13b78012-f341-44fd-b621-5318665582a3 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:10:31 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-13b78012-f341-44fd-b621-5318665582a3 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:10:31 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-13b78012-f341-44fd-b621-5318665582a3 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c081c145-134f-4809-bc3c-a43d20ccc436 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:31 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-daa15a97-cd32-43a7-a7a6-5b4dc775546a tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac9811b8-855b-4339-bb0d-0cf8347f8ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6f84c02-20a0-4364-8589-c232dfd34474', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:31 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-daa15a97-cd32-43a7-a7a6-5b4dc775546a tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eac28cb7-751a-4e55-8f30-77ae8736801e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:31 devstack sudo[107825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c081c145-134f-4809-bc3c-a43d20ccc436 1073741824 Jul 30 17:10:31 devstack sudo[107825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:31 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-daa15a97-cd32-43a7-a7a6-5b4dc775546a tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Volume volume-e6f84c02-20a0-4364-8589-c232dfd34474 (e6f84c02-20a0-4364-8589-c232dfd34474): created successfully Jul 30 17:10:31 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-daa15a97-cd32-43a7-a7a6-5b4dc775546a tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eac28cb7-751a-4e55-8f30-77ae8736801e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:31 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-daa15a97-cd32-43a7-a7a6-5b4dc775546a tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Flow 'volume_create_manager' (29d94d75-a2e2-48ec-b2ed-be29b36a6861) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:10:31 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-daa15a97-cd32-43a7-a7a6-5b4dc775546a tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Created volume successfully. Jul 30 17:10:31 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-803ebf34-e210-41a8-baa1-cdbd7799611a tempest-CreateVolumesFromSnapshotTest-1648007070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:10:31 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-803ebf34-e210-41a8-baa1-cdbd7799611a tempest-CreateVolumesFromSnapshotTest-1648007070 None] Flow 'volume_create_manager' (20de75c0-bc7d-429a-b4c0-96cd0f2b9266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:10:31 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-803ebf34-e210-41a8-baa1-cdbd7799611a tempest-CreateVolumesFromSnapshotTest-1648007070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d282b7a7-275e-4ffe-8b3b-a41a70e76546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:31 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-803ebf34-e210-41a8-baa1-cdbd7799611a tempest-CreateVolumesFromSnapshotTest-1648007070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d282b7a7-275e-4ffe-8b3b-a41a70e76546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:10:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-454856300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54136732-049a-449c-baba-81d5c8de3240,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a1bfeeec4e441d0b285d4af6adeba66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:10:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:10:31Z,use_quota=True,user_id='42456a79f14e4e68b2d93c2b982eff90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:31 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-803ebf34-e210-41a8-baa1-cdbd7799611a tempest-CreateVolumesFromSnapshotTest-1648007070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c937e107-ad24-4d3f-b11a-26e41c6e2b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:31 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-803ebf34-e210-41a8-baa1-cdbd7799611a tempest-CreateVolumesFromSnapshotTest-1648007070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c937e107-ad24-4d3f-b11a-26e41c6e2b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:31 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-803ebf34-e210-41a8-baa1-cdbd7799611a tempest-CreateVolumesFromSnapshotTest-1648007070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39d52ff5-1a22-4454-ac49-3686d1868af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:31 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-803ebf34-e210-41a8-baa1-cdbd7799611a tempest-CreateVolumesFromSnapshotTest-1648007070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39d52ff5-1a22-4454-ac49-3686d1868af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54136732-049a-449c-baba-81d5c8de3240', 'volume_name': 'volume-54136732-049a-449c-baba-81d5c8de3240', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:31 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-803ebf34-e210-41a8-baa1-cdbd7799611a tempest-CreateVolumesFromSnapshotTest-1648007070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a31c6d6-f37c-44f4-b741-9c25be5fbfb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:31 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-803ebf34-e210-41a8-baa1-cdbd7799611a tempest-CreateVolumesFromSnapshotTest-1648007070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a31c6d6-f37c-44f4-b741-9c25be5fbfb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:31 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-803ebf34-e210-41a8-baa1-cdbd7799611a tempest-CreateVolumesFromSnapshotTest-1648007070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1ac90b4-b07e-4a1c-a31b-5ba2036f17d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:31 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-803ebf34-e210-41a8-baa1-cdbd7799611a tempest-CreateVolumesFromSnapshotTest-1648007070 None] Volume 54136732-049a-449c-baba-81d5c8de3240: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54136732-049a-449c-baba-81d5c8de3240', 'volume_size': 1} Jul 30 17:10:31 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-803ebf34-e210-41a8-baa1-cdbd7799611a tempest-CreateVolumesFromSnapshotTest-1648007070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:31 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-23f5d583-b6e0-45a6-a422-b665e5e9397d tempest-CreateVolumesFromSnapshotTest-1648007070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:10:31 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-23f5d583-b6e0-45a6-a422-b665e5e9397d tempest-CreateVolumesFromSnapshotTest-1648007070 None] Flow 'volume_create_manager' (f1b46a86-602e-4c80-bc20-45ea6f7c9a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:10:31 devstack sudo[107825]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:31 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-23f5d583-b6e0-45a6-a422-b665e5e9397d tempest-CreateVolumesFromSnapshotTest-1648007070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c36713a-73b6-4162-8ca3-7e72465fb0fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:31 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-13b78012-f341-44fd-b621-5318665582a3 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c081c145-134f-4809-bc3c-a43d20ccc436 1073741824" returned: 0 in 0.548s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:31 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-23f5d583-b6e0-45a6-a422-b665e5e9397d tempest-CreateVolumesFromSnapshotTest-1648007070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c36713a-73b6-4162-8ca3-7e72465fb0fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:10:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-825988464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c833f06-8e80-41bb-b4fd-a85f517c5c9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a1bfeeec4e441d0b285d4af6adeba66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:10:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:10:32Z,use_quota=True,user_id='42456a79f14e4e68b2d93c2b982eff90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:31 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-23f5d583-b6e0-45a6-a422-b665e5e9397d tempest-CreateVolumesFromSnapshotTest-1648007070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (695dbd6e-5448-42de-874b-4c6004e08755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:31 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-23f5d583-b6e0-45a6-a422-b665e5e9397d tempest-CreateVolumesFromSnapshotTest-1648007070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (695dbd6e-5448-42de-874b-4c6004e08755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:31 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-23f5d583-b6e0-45a6-a422-b665e5e9397d tempest-CreateVolumesFromSnapshotTest-1648007070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7b8221b-11ec-494c-b6a6-098026b32056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:31 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-23f5d583-b6e0-45a6-a422-b665e5e9397d tempest-CreateVolumesFromSnapshotTest-1648007070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7b8221b-11ec-494c-b6a6-098026b32056) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c833f06-8e80-41bb-b4fd-a85f517c5c9a', 'volume_name': 'volume-9c833f06-8e80-41bb-b4fd-a85f517c5c9a', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:31 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-23f5d583-b6e0-45a6-a422-b665e5e9397d tempest-CreateVolumesFromSnapshotTest-1648007070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5ea7fb4-68f9-48ae-88ca-e06e15669e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:31 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-23f5d583-b6e0-45a6-a422-b665e5e9397d tempest-CreateVolumesFromSnapshotTest-1648007070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5ea7fb4-68f9-48ae-88ca-e06e15669e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:31 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-23f5d583-b6e0-45a6-a422-b665e5e9397d tempest-CreateVolumesFromSnapshotTest-1648007070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8e1fb15-8ceb-4b96-8fb1-6f0545937215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:31 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-23f5d583-b6e0-45a6-a422-b665e5e9397d tempest-CreateVolumesFromSnapshotTest-1648007070 None] Volume 9c833f06-8e80-41bb-b4fd-a85f517c5c9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c833f06-8e80-41bb-b4fd-a85f517c5c9a', 'volume_size': 1} Jul 30 17:10:31 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-23f5d583-b6e0-45a6-a422-b665e5e9397d tempest-CreateVolumesFromSnapshotTest-1648007070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:31 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-13b78012-f341-44fd-b621-5318665582a3 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c081c145-134f-4809-bc3c-a43d20ccc436 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:31 devstack sudo[107831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c081c145-134f-4809-bc3c-a43d20ccc436 Jul 30 17:10:31 devstack sudo[107831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:32 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a6f6749-fbd7-499d-bf44-008897ad2f8d tempest-CreateVolumesFromSnapshotTest-1648007070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:10:32 devstack sudo[107831]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:32 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7a6f6749-fbd7-499d-bf44-008897ad2f8d tempest-CreateVolumesFromSnapshotTest-1648007070 None] Flow 'volume_create_manager' (af392cc0-f1f1-4b2b-bda8-71231ce5342c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:10:32 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7a6f6749-fbd7-499d-bf44-008897ad2f8d tempest-CreateVolumesFromSnapshotTest-1648007070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de6af4f7-8492-4e61-af0a-927b2755ee68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:32 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-13b78012-f341-44fd-b621-5318665582a3 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c081c145-134f-4809-bc3c-a43d20ccc436" returned: 0 in 0.333s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:32 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-13b78012-f341-44fd-b621-5318665582a3 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:10:32 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-13b78012-f341-44fd-b621-5318665582a3 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:32 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-dc618e01-2d85-4be2-ba5e-e9a8827b343c tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.418s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:32 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-dc618e01-2d85-4be2-ba5e-e9a8827b343c tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:10:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-202779798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b358a76-5c35-4f15-9c8d-ad3c833debf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='966adfc9a22049f1941971b527ef521c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:10:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:10:28Z,use_quota=True,user_id='0af5567b32ab4efaa072c0bc24984cc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:10:32 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-dc618e01-2d85-4be2-ba5e-e9a8827b343c tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Creating volume 4b358a76-5c35-4f15-9c8d-ad3c833debf7 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:10:32 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-dc618e01-2d85-4be2-ba5e-e9a8827b343c tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:32 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-dc618e01-2d85-4be2-ba5e-e9a8827b343c tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:32 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-dc618e01-2d85-4be2-ba5e-e9a8827b343c tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:10:32 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-dc618e01-2d85-4be2-ba5e-e9a8827b343c tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:10:32 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-dc618e01-2d85-4be2-ba5e-e9a8827b343c tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:32 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-dc618e01-2d85-4be2-ba5e-e9a8827b343c tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:10:32 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-dc618e01-2d85-4be2-ba5e-e9a8827b343c tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:10:32 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-dc618e01-2d85-4be2-ba5e-e9a8827b343c tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4b358a76-5c35-4f15-9c8d-ad3c833debf7 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:32 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7a6f6749-fbd7-499d-bf44-008897ad2f8d tempest-CreateVolumesFromSnapshotTest-1648007070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de6af4f7-8492-4e61-af0a-927b2755ee68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:10:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1912456163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9ac7485-159b-4c52-8b79-ef8aef31ded6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a1bfeeec4e441d0b285d4af6adeba66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:10:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:10:32Z,use_quota=True,user_id='42456a79f14e4e68b2d93c2b982eff90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:32 devstack sudo[107834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4b358a76-5c35-4f15-9c8d-ad3c833debf7 1073741824 Jul 30 17:10:32 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7a6f6749-fbd7-499d-bf44-008897ad2f8d tempest-CreateVolumesFromSnapshotTest-1648007070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23a2d25a-5275-474f-bc9e-59eb4d9a16f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:32 devstack sudo[107834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:32 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7a6f6749-fbd7-499d-bf44-008897ad2f8d tempest-CreateVolumesFromSnapshotTest-1648007070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23a2d25a-5275-474f-bc9e-59eb4d9a16f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:32 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7a6f6749-fbd7-499d-bf44-008897ad2f8d tempest-CreateVolumesFromSnapshotTest-1648007070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41508d67-0153-4ac0-ba19-4852820c1252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:32 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7a6f6749-fbd7-499d-bf44-008897ad2f8d tempest-CreateVolumesFromSnapshotTest-1648007070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41508d67-0153-4ac0-ba19-4852820c1252) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9ac7485-159b-4c52-8b79-ef8aef31ded6', 'volume_name': 'volume-e9ac7485-159b-4c52-8b79-ef8aef31ded6', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:32 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7a6f6749-fbd7-499d-bf44-008897ad2f8d tempest-CreateVolumesFromSnapshotTest-1648007070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2960a3b7-ffb2-498d-93e9-12ef409bb534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:32 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7a6f6749-fbd7-499d-bf44-008897ad2f8d tempest-CreateVolumesFromSnapshotTest-1648007070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2960a3b7-ffb2-498d-93e9-12ef409bb534) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:32 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7a6f6749-fbd7-499d-bf44-008897ad2f8d tempest-CreateVolumesFromSnapshotTest-1648007070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (242289f0-3250-4c2a-94bb-3668ef080367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:32 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-7a6f6749-fbd7-499d-bf44-008897ad2f8d tempest-CreateVolumesFromSnapshotTest-1648007070 None] Volume e9ac7485-159b-4c52-8b79-ef8aef31ded6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9ac7485-159b-4c52-8b79-ef8aef31ded6', 'volume_size': 1} Jul 30 17:10:32 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-7a6f6749-fbd7-499d-bf44-008897ad2f8d tempest-CreateVolumesFromSnapshotTest-1648007070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:32 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-13b78012-f341-44fd-b621-5318665582a3 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cd8b5c8-ddc5-4671-b8e3-562c64f4fd89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c081c145-134f-4809-bc3c-a43d20ccc436', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:32 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-13b78012-f341-44fd-b621-5318665582a3 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3ba5bc6-357c-4471-bd99-b8c3fba1519b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:32 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-13b78012-f341-44fd-b621-5318665582a3 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Volume volume-c081c145-134f-4809-bc3c-a43d20ccc436 (c081c145-134f-4809-bc3c-a43d20ccc436): created successfully Jul 30 17:10:32 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-13b78012-f341-44fd-b621-5318665582a3 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3ba5bc6-357c-4471-bd99-b8c3fba1519b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:32 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-13b78012-f341-44fd-b621-5318665582a3 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Flow 'volume_create_manager' (8ed768b4-8e43-45f1-a573-a55f0eaf9e4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:10:32 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-13b78012-f341-44fd-b621-5318665582a3 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Created volume successfully. Jul 30 17:10:32 devstack sudo[107834]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:32 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-dc618e01-2d85-4be2-ba5e-e9a8827b343c tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4b358a76-5c35-4f15-9c8d-ad3c833debf7 1073741824" returned: 0 in 0.414s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:32 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-dc618e01-2d85-4be2-ba5e-e9a8827b343c tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4b358a76-5c35-4f15-9c8d-ad3c833debf7 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:32 devstack sudo[107840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4b358a76-5c35-4f15-9c8d-ad3c833debf7 Jul 30 17:10:32 devstack sudo[107840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:32 devstack sudo[107840]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:32 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-dc618e01-2d85-4be2-ba5e-e9a8827b343c tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4b358a76-5c35-4f15-9c8d-ad3c833debf7" returned: 0 in 0.251s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:32 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-dc618e01-2d85-4be2-ba5e-e9a8827b343c tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:10:32 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-dc618e01-2d85-4be2-ba5e-e9a8827b343c tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:32 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-493f50ef-51ff-4ece-82f1-40c5d5817d7b tempest-VolumeImageDependencyTests-418620943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.088s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:32 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-493f50ef-51ff-4ece-82f1-40c5d5817d7b tempest-VolumeImageDependencyTests-418620943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:10:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01919c96-7ba3-4802-b03f-00413ce0183d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea282265e169485f8f81c8ad42213435',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:10:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:10:26Z,use_quota=True,user_id='abe5db238ac84699874b624100c83244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:10:32 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-493f50ef-51ff-4ece-82f1-40c5d5817d7b tempest-VolumeImageDependencyTests-418620943 None] Creating volume 01919c96-7ba3-4802-b03f-00413ce0183d {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:10:32 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-493f50ef-51ff-4ece-82f1-40c5d5817d7b tempest-VolumeImageDependencyTests-418620943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:32 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-493f50ef-51ff-4ece-82f1-40c5d5817d7b tempest-VolumeImageDependencyTests-418620943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:32 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-493f50ef-51ff-4ece-82f1-40c5d5817d7b tempest-VolumeImageDependencyTests-418620943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:10:32 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-493f50ef-51ff-4ece-82f1-40c5d5817d7b tempest-VolumeImageDependencyTests-418620943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:10:32 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-493f50ef-51ff-4ece-82f1-40c5d5817d7b tempest-VolumeImageDependencyTests-418620943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:32 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-493f50ef-51ff-4ece-82f1-40c5d5817d7b tempest-VolumeImageDependencyTests-418620943 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:10:32 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-493f50ef-51ff-4ece-82f1-40c5d5817d7b tempest-VolumeImageDependencyTests-418620943 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:10:32 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-493f50ef-51ff-4ece-82f1-40c5d5817d7b tempest-VolumeImageDependencyTests-418620943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-01919c96-7ba3-4802-b03f-00413ce0183d 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:33 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-dc618e01-2d85-4be2-ba5e-e9a8827b343c tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10fb73e6-3908-4375-af26-1e090cc715d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b358a76-5c35-4f15-9c8d-ad3c833debf7', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:33 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-dc618e01-2d85-4be2-ba5e-e9a8827b343c tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19a0bdf0-4a56-4a9c-a297-afe2fad14879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:33 devstack sudo[107843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-01919c96-7ba3-4802-b03f-00413ce0183d 1073741824 Jul 30 17:10:33 devstack sudo[107843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:33 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-dc618e01-2d85-4be2-ba5e-e9a8827b343c tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Volume volume-4b358a76-5c35-4f15-9c8d-ad3c833debf7 (4b358a76-5c35-4f15-9c8d-ad3c833debf7): created successfully Jul 30 17:10:33 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-dc618e01-2d85-4be2-ba5e-e9a8827b343c tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19a0bdf0-4a56-4a9c-a297-afe2fad14879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:33 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-dc618e01-2d85-4be2-ba5e-e9a8827b343c tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Flow 'volume_create_manager' (536e7014-b15e-4e23-b576-2ba1d7962a46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:10:33 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-dc618e01-2d85-4be2-ba5e-e9a8827b343c tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Created volume successfully. Jul 30 17:10:33 devstack sudo[107843]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:33 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-493f50ef-51ff-4ece-82f1-40c5d5817d7b tempest-VolumeImageDependencyTests-418620943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-01919c96-7ba3-4802-b03f-00413ce0183d 1073741824" returned: 0 in 0.419s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:33 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-493f50ef-51ff-4ece-82f1-40c5d5817d7b tempest-VolumeImageDependencyTests-418620943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-01919c96-7ba3-4802-b03f-00413ce0183d {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:33 devstack sudo[107850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-01919c96-7ba3-4802-b03f-00413ce0183d Jul 30 17:10:33 devstack sudo[107850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:33 devstack sudo[107850]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:33 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-493f50ef-51ff-4ece-82f1-40c5d5817d7b tempest-VolumeImageDependencyTests-418620943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-01919c96-7ba3-4802-b03f-00413ce0183d" returned: 0 in 0.238s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:33 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-493f50ef-51ff-4ece-82f1-40c5d5817d7b tempest-VolumeImageDependencyTests-418620943 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:10:33 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-493f50ef-51ff-4ece-82f1-40c5d5817d7b tempest-VolumeImageDependencyTests-418620943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:33 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-9f10da4e-4411-4ff5-a7f5-6de4e935d05a tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.922s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:33 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-9f10da4e-4411-4ff5-a7f5-6de4e935d05a tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:10:27Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98f74670-d5eb-4e3b-93fd-f27f66792f4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='916d6533ed214008ac358384ae464381',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:10:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:10:27Z,use_quota=True,user_id='f0e50b4878574e5ba94f504c0720c0ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60fc5722-9a66-4e80-91c6-50bfc51b10e5),volume_type_id=60fc5722-9a66-4e80-91c6-50bfc51b10e5)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:10:33 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-9f10da4e-4411-4ff5-a7f5-6de4e935d05a tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] Creating volume 98f74670-d5eb-4e3b-93fd-f27f66792f4e {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:10:33 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-9f10da4e-4411-4ff5-a7f5-6de4e935d05a tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:33 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-9f10da4e-4411-4ff5-a7f5-6de4e935d05a tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:33 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-9f10da4e-4411-4ff5-a7f5-6de4e935d05a tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:10:33 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-9f10da4e-4411-4ff5-a7f5-6de4e935d05a tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:10:33 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-9f10da4e-4411-4ff5-a7f5-6de4e935d05a tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:33 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-9f10da4e-4411-4ff5-a7f5-6de4e935d05a tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:10:33 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-9f10da4e-4411-4ff5-a7f5-6de4e935d05a tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:10:33 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9f10da4e-4411-4ff5-a7f5-6de4e935d05a tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-98f74670-d5eb-4e3b-93fd-f27f66792f4e 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:33 devstack sudo[107853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-98f74670-d5eb-4e3b-93fd-f27f66792f4e 1073741824 Jul 30 17:10:33 devstack sudo[107853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:33 devstack cinder-volume[88568]: DEBUG cinder.volume.volume_utils [None req-493f50ef-51ff-4ece-82f1-40c5d5817d7b tempest-VolumeImageDependencyTests-418620943 None] Attempting download of c9603162-6489-4e7e-b109-aff864f9917c ((None, [{'url': 'file:///opt/stack/data/glance/images/c9603162-6489-4e7e-b109-aff864f9917c', 'metadata': {}}])) to volume 01919c96-7ba3-4802-b03f-00413ce0183d. {{(pid=88568) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 30 17:10:33 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[99439415-77cf-4f8f-883b-3168f7103547]: (4, 'raw') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:10:33 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-493f50ef-51ff-4ece-82f1-40c5d5817d7b tempest-VolumeImageDependencyTests-418620943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c9603162-6489-4e7e-b109-aff864f9917c_sgji_16t {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:33 devstack sudo[107855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c9603162-6489-4e7e-b109-aff864f9917c_sgji_16t Jul 30 17:10:33 devstack sudo[107855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:34 devstack sudo[107855]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:34 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-493f50ef-51ff-4ece-82f1-40c5d5817d7b tempest-VolumeImageDependencyTests-418620943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c9603162-6489-4e7e-b109-aff864f9917c_sgji_16t" returned: 0 in 0.372s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:34 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-493f50ef-51ff-4ece-82f1-40c5d5817d7b tempest-VolumeImageDependencyTests-418620943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c9603162-6489-4e7e-b109-aff864f9917c_sgji_16t {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:34 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-c6ede1d3-9797-4f95-9e47-e476066b1f0e tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Acquiring lock "cinder-4b358a76-5c35-4f15-9c8d-ad3c833debf7-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:34 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-c6ede1d3-9797-4f95-9e47-e476066b1f0e tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Lock "cinder-4b358a76-5c35-4f15-9c8d-ad3c833debf7-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:34 devstack sudo[107853]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:34 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9f10da4e-4411-4ff5-a7f5-6de4e935d05a tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-98f74670-d5eb-4e3b-93fd-f27f66792f4e 1073741824" returned: 0 in 0.516s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:34 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-c6ede1d3-9797-4f95-9e47-e476066b1f0e tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Acquiring lock "cinder-quobyte-4b358a76-5c35-4f15-9c8d-ad3c833debf7" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:34 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-c6ede1d3-9797-4f95-9e47-e476066b1f0e tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Lock "cinder-quobyte-4b358a76-5c35-4f15-9c8d-ad3c833debf7" acquired by "delete_volume" :: waited 0.021s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:34 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9f10da4e-4411-4ff5-a7f5-6de4e935d05a tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-98f74670-d5eb-4e3b-93fd-f27f66792f4e {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:34 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[78bf7c9d-5247-4dbd-8288-63ba48221d08]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:10:34 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-c6ede1d3-9797-4f95-9e47-e476066b1f0e tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4b358a76-5c35-4f15-9c8d-ad3c833debf7 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:34 devstack sudo[107863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c9603162-6489-4e7e-b109-aff864f9917c_sgji_16t Jul 30 17:10:34 devstack sudo[107863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:34 devstack sudo[107864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-98f74670-d5eb-4e3b-93fd-f27f66792f4e Jul 30 17:10:34 devstack sudo[107864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:34 devstack sudo[107865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4b358a76-5c35-4f15-9c8d-ad3c833debf7 Jul 30 17:10:34 devstack sudo[107865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:34 devstack sudo[107863]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:34 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-493f50ef-51ff-4ece-82f1-40c5d5817d7b tempest-VolumeImageDependencyTests-418620943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c9603162-6489-4e7e-b109-aff864f9917c_sgji_16t" returned: 1 in 0.385s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:34 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-493f50ef-51ff-4ece-82f1-40c5d5817d7b tempest-VolumeImageDependencyTests-418620943 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c9603162-6489-4e7e-b109-aff864f9917c_sgji_16t' failed. Not Retrying. {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 17:10:34 devstack sudo[107864]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:34 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[64db3079-bd78-4c73-bfe7-f5c0bbe489f4]: (4, 'raw') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:10:34 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-493f50ef-51ff-4ece-82f1-40c5d5817d7b tempest-VolumeImageDependencyTests-418620943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c9603162-6489-4e7e-b109-aff864f9917c_3wtsdsohdevstack@QuobyteHD {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:34 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9f10da4e-4411-4ff5-a7f5-6de4e935d05a tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-98f74670-d5eb-4e3b-93fd-f27f66792f4e" returned: 0 in 0.275s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:34 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-9f10da4e-4411-4ff5-a7f5-6de4e935d05a tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:10:34 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-9f10da4e-4411-4ff5-a7f5-6de4e935d05a tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:34 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-c7c583d2-f3f6-4311-9925-e37a402776a8 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.856s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:34 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-c7c583d2-f3f6-4311-9925-e37a402776a8 tempest-CreateVolumesFromSnapshotTest-1648007070 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:10:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-628755276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eff3563b-0160-40d2-81d4-2afdd76f93b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a1bfeeec4e441d0b285d4af6adeba66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:10:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:10:31Z,use_quota=True,user_id='42456a79f14e4e68b2d93c2b982eff90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:10:34 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-c7c583d2-f3f6-4311-9925-e37a402776a8 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Creating volume eff3563b-0160-40d2-81d4-2afdd76f93b2 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:10:34 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-c7c583d2-f3f6-4311-9925-e37a402776a8 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:34 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-c7c583d2-f3f6-4311-9925-e37a402776a8 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:34 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-c7c583d2-f3f6-4311-9925-e37a402776a8 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:10:34 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-c7c583d2-f3f6-4311-9925-e37a402776a8 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:10:34 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-c7c583d2-f3f6-4311-9925-e37a402776a8 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:34 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-c7c583d2-f3f6-4311-9925-e37a402776a8 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:10:34 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-c7c583d2-f3f6-4311-9925-e37a402776a8 tempest-CreateVolumesFromSnapshotTest-1648007070 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:10:34 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-c7c583d2-f3f6-4311-9925-e37a402776a8 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-eff3563b-0160-40d2-81d4-2afdd76f93b2 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:34 devstack sudo[107873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-eff3563b-0160-40d2-81d4-2afdd76f93b2 1073741824 Jul 30 17:10:34 devstack sudo[107873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:34 devstack cinder-volume[88568]: DEBUG cinder.volume.volume_utils [None req-9f10da4e-4411-4ff5-a7f5-6de4e935d05a tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] Attempting download of 5743808e-c055-4ac6-8ff9-017d24ee38df ((None, [{'url': 'file:///opt/stack/data/glance/images/5743808e-c055-4ac6-8ff9-017d24ee38df', 'metadata': {}}])) to volume 98f74670-d5eb-4e3b-93fd-f27f66792f4e. {{(pid=88568) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 30 17:10:34 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac36a90c-5297-4d75-a8d8-1106c322ca54]: (4, 'raw') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:10:34 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9f10da4e-4411-4ff5-a7f5-6de4e935d05a tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5743808e-c055-4ac6-8ff9-017d24ee38df_902c9zjk {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:34 devstack sudo[107872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c9603162-6489-4e7e-b109-aff864f9917c_3wtsdsohdevstack@QuobyteHD Jul 30 17:10:34 devstack sudo[107872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:34 devstack sudo[107865]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:34 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-c6ede1d3-9797-4f95-9e47-e476066b1f0e tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4b358a76-5c35-4f15-9c8d-ad3c833debf7" returned: 0 in 0.399s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:34 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-c6ede1d3-9797-4f95-9e47-e476066b1f0e tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4b358a76-5c35-4f15-9c8d-ad3c833debf7 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:34 devstack sudo[107881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4b358a76-5c35-4f15-9c8d-ad3c833debf7 Jul 30 17:10:34 devstack sudo[107881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:34 devstack sudo[107880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5743808e-c055-4ac6-8ff9-017d24ee38df_902c9zjk Jul 30 17:10:34 devstack sudo[107880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:34 devstack sudo[107872]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:34 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-493f50ef-51ff-4ece-82f1-40c5d5817d7b tempest-VolumeImageDependencyTests-418620943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c9603162-6489-4e7e-b109-aff864f9917c_3wtsdsohdevstack@QuobyteHD" returned: 0 in 0.359s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:34 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-493f50ef-51ff-4ece-82f1-40c5d5817d7b tempest-VolumeImageDependencyTests-418620943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9603162-6489-4e7e-b109-aff864f9917c_3wtsdsohdevstack@QuobyteHD {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:34 devstack sudo[107881]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:34 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-c6ede1d3-9797-4f95-9e47-e476066b1f0e tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4b358a76-5c35-4f15-9c8d-ad3c833debf7" returned: 0 in 0.293s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:35 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-c6ede1d3-9797-4f95-9e47-e476066b1f0e tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Lock "cinder-quobyte-4b358a76-5c35-4f15-9c8d-ad3c833debf7" released by "delete_volume" :: held 0.751s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:35 devstack sudo[107889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9603162-6489-4e7e-b109-aff864f9917c_3wtsdsohdevstack@QuobyteHD Jul 30 17:10:35 devstack sudo[107889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:35 devstack sudo[107880]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9f10da4e-4411-4ff5-a7f5-6de4e935d05a tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5743808e-c055-4ac6-8ff9-017d24ee38df_902c9zjk" returned: 0 in 0.384s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9f10da4e-4411-4ff5-a7f5-6de4e935d05a tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5743808e-c055-4ac6-8ff9-017d24ee38df_902c9zjk {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:35 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-c6ede1d3-9797-4f95-9e47-e476066b1f0e tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Created reservations ['f262662f-3725-4d6d-b364-f80f9e51dd2d', '1b2af7e4-1702-48a4-8a52-20d7f8c506bf', '53914bb5-c81d-462c-a305-99bd1abb3333', 'f2fcd8a9-391b-4c78-ae00-c4ca67e1e903'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:10:35 devstack sudo[107873]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-c7c583d2-f3f6-4311-9925-e37a402776a8 tempest-CreateVolumesFromSnapshotTest-1648007070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-eff3563b-0160-40d2-81d4-2afdd76f93b2 1073741824" returned: 0 in 0.547s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-c7c583d2-f3f6-4311-9925-e37a402776a8 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-eff3563b-0160-40d2-81d4-2afdd76f93b2 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-c6ede1d3-9797-4f95-9e47-e476066b1f0e tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-c6ede1d3-9797-4f95-9e47-e476066b1f0e tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:35 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-c6ede1d3-9797-4f95-9e47-e476066b1f0e tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:10:35 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-c6ede1d3-9797-4f95-9e47-e476066b1f0e tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:10:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-c6ede1d3-9797-4f95-9e47-e476066b1f0e tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-c6ede1d3-9797-4f95-9e47-e476066b1f0e tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:35 devstack sudo[107895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5743808e-c055-4ac6-8ff9-017d24ee38df_902c9zjk Jul 30 17:10:35 devstack sudo[107895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:35 devstack sudo[107897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-eff3563b-0160-40d2-81d4-2afdd76f93b2 Jul 30 17:10:35 devstack sudo[107897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:35 devstack sudo[107900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:10:35 devstack sudo[107900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:35 devstack sudo[107889]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-493f50ef-51ff-4ece-82f1-40c5d5817d7b tempest-VolumeImageDependencyTests-418620943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9603162-6489-4e7e-b109-aff864f9917c_3wtsdsohdevstack@QuobyteHD" returned: 1 in 0.425s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-493f50ef-51ff-4ece-82f1-40c5d5817d7b tempest-VolumeImageDependencyTests-418620943 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c9603162-6489-4e7e-b109-aff864f9917c_3wtsdsohdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 17:10:35 devstack cinder-volume[88568]: DEBUG cinder.image.image_utils [None req-493f50ef-51ff-4ece-82f1-40c5d5817d7b tempest-VolumeImageDependencyTests-418620943 None] c9603162-6489-4e7e-b109-aff864f9917c was raw, converting to qcow2 {{(pid=88568) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 30 17:10:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-493f50ef-51ff-4ece-82f1-40c5d5817d7b tempest-VolumeImageDependencyTests-418620943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c9603162-6489-4e7e-b109-aff864f9917c_3wtsdsohdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-01919c96-7ba3-4802-b03f-00413ce0183d {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:35 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-ca91b450-12c6-4815-bb68-7d1cb814c9aa tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Acquiring lock "cinder-c081c145-134f-4809-bc3c-a43d20ccc436-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:35 devstack sudo[107905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c9603162-6489-4e7e-b109-aff864f9917c_3wtsdsohdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-01919c96-7ba3-4802-b03f-00413ce0183d Jul 30 17:10:35 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-ca91b450-12c6-4815-bb68-7d1cb814c9aa tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Lock "cinder-c081c145-134f-4809-bc3c-a43d20ccc436-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:35 devstack sudo[107905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:35 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-ca91b450-12c6-4815-bb68-7d1cb814c9aa tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Acquiring lock "cinder-quobyte-c081c145-134f-4809-bc3c-a43d20ccc436" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:35 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-ca91b450-12c6-4815-bb68-7d1cb814c9aa tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Lock "cinder-quobyte-c081c145-134f-4809-bc3c-a43d20ccc436" acquired by "delete_volume" :: waited 0.039s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:35 devstack sudo[107895]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:35 devstack sudo[107900]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9f10da4e-4411-4ff5-a7f5-6de4e935d05a tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5743808e-c055-4ac6-8ff9-017d24ee38df_902c9zjk" returned: 1 in 0.507s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9f10da4e-4411-4ff5-a7f5-6de4e935d05a tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5743808e-c055-4ac6-8ff9-017d24ee38df_902c9zjk' failed. Not Retrying. {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 17:10:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-c6ede1d3-9797-4f95-9e47-e476066b1f0e tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.373s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:35 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-c6ede1d3-9797-4f95-9e47-e476066b1f0e tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:10:35 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[406bf105-52ce-41f9-aba5-101d0267cf7a]: (4, 'raw') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:10:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9f10da4e-4411-4ff5-a7f5-6de4e935d05a tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5743808e-c055-4ac6-8ff9-017d24ee38df_u23eagmidevstack@QuobyteHD {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:35 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[5462fc63-6a8e-4dcf-846e-9a0712f4e0dc]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:10:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-ca91b450-12c6-4815-bb68-7d1cb814c9aa tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c081c145-134f-4809-bc3c-a43d20ccc436 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:35 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-c6ede1d3-9797-4f95-9e47-e476066b1f0e tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Deleted volume successfully. Jul 30 17:10:35 devstack sudo[107897]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-c7c583d2-f3f6-4311-9925-e37a402776a8 tempest-CreateVolumesFromSnapshotTest-1648007070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-eff3563b-0160-40d2-81d4-2afdd76f93b2" returned: 0 in 0.476s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:35 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-c7c583d2-f3f6-4311-9925-e37a402776a8 tempest-CreateVolumesFromSnapshotTest-1648007070 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:10:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-c7c583d2-f3f6-4311-9925-e37a402776a8 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-9478ae61-d0ff-40c0-a231-3788973d8571 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.528s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:35 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-9478ae61-d0ff-40c0-a231-3788973d8571 tempest-CreateVolumesFromSnapshotTest-1648007070 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:10:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-210221428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb66a854-0389-4789-823f-3350614a6726,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a1bfeeec4e441d0b285d4af6adeba66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:10:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:10:31Z,use_quota=True,user_id='42456a79f14e4e68b2d93c2b982eff90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:10:35 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-9478ae61-d0ff-40c0-a231-3788973d8571 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Creating volume bb66a854-0389-4789-823f-3350614a6726 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:10:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-9478ae61-d0ff-40c0-a231-3788973d8571 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-9478ae61-d0ff-40c0-a231-3788973d8571 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:35 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-9478ae61-d0ff-40c0-a231-3788973d8571 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:10:35 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-9478ae61-d0ff-40c0-a231-3788973d8571 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:10:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-9478ae61-d0ff-40c0-a231-3788973d8571 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:35 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-9478ae61-d0ff-40c0-a231-3788973d8571 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:10:35 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-9478ae61-d0ff-40c0-a231-3788973d8571 tempest-CreateVolumesFromSnapshotTest-1648007070 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:10:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9478ae61-d0ff-40c0-a231-3788973d8571 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bb66a854-0389-4789-823f-3350614a6726 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:35 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-c7c583d2-f3f6-4311-9925-e37a402776a8 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (905b4668-3a7c-40cc-bd2b-caaf5d2e9e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eff3563b-0160-40d2-81d4-2afdd76f93b2', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:35 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-c7c583d2-f3f6-4311-9925-e37a402776a8 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50ebf92a-2c97-426b-9489-2161acfeccc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:35 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-c7c583d2-f3f6-4311-9925-e37a402776a8 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Volume volume-eff3563b-0160-40d2-81d4-2afdd76f93b2 (eff3563b-0160-40d2-81d4-2afdd76f93b2): created successfully Jul 30 17:10:35 devstack sudo[107914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bb66a854-0389-4789-823f-3350614a6726 1073741824 Jul 30 17:10:35 devstack sudo[107914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:35 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-c7c583d2-f3f6-4311-9925-e37a402776a8 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50ebf92a-2c97-426b-9489-2161acfeccc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:35 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-c7c583d2-f3f6-4311-9925-e37a402776a8 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Flow 'volume_create_manager' (5285ce72-cde9-4f03-bb36-aeee53e570ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:10:35 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-c6ede1d3-9797-4f95-9e47-e476066b1f0e tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Lock "cinder-4b358a76-5c35-4f15-9c8d-ad3c833debf7-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:35 devstack sudo[107912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5743808e-c055-4ac6-8ff9-017d24ee38df_u23eagmidevstack@QuobyteHD Jul 30 17:10:35 devstack sudo[107912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:35 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-c7c583d2-f3f6-4311-9925-e37a402776a8 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Created volume successfully. Jul 30 17:10:35 devstack sudo[107913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c081c145-134f-4809-bc3c-a43d20ccc436 Jul 30 17:10:35 devstack sudo[107913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:35 devstack sudo[107905]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-493f50ef-51ff-4ece-82f1-40c5d5817d7b tempest-VolumeImageDependencyTests-418620943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c9603162-6489-4e7e-b109-aff864f9917c_3wtsdsohdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-01919c96-7ba3-4802-b03f-00413ce0183d" returned: 0 in 0.638s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:35 devstack cinder-volume[88568]: DEBUG cinder.image.image_utils [None req-493f50ef-51ff-4ece-82f1-40c5d5817d7b tempest-VolumeImageDependencyTests-418620943 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c9603162-6489-4e7e-b109-aff864f9917c_3wtsdsohdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-01919c96-7ba3-4802-b03f-00413ce0183d {{(pid=88568) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 17:10:35 devstack cinder-volume[88568]: INFO cinder.image.image_utils [None req-493f50ef-51ff-4ece-82f1-40c5d5817d7b tempest-VolumeImageDependencyTests-418620943 None] Converted 0.00 MB image at 0.00 MB/s Jul 30 17:10:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-493f50ef-51ff-4ece-82f1-40c5d5817d7b tempest-VolumeImageDependencyTests-418620943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-01919c96-7ba3-4802-b03f-00413ce0183d 1G {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:35 devstack sudo[107912]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9f10da4e-4411-4ff5-a7f5-6de4e935d05a tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5743808e-c055-4ac6-8ff9-017d24ee38df_u23eagmidevstack@QuobyteHD" returned: 0 in 0.427s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9f10da4e-4411-4ff5-a7f5-6de4e935d05a tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5743808e-c055-4ac6-8ff9-017d24ee38df_u23eagmidevstack@QuobyteHD {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:36 devstack sudo[107929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-01919c96-7ba3-4802-b03f-00413ce0183d 1G Jul 30 17:10:36 devstack sudo[107929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:36 devstack sudo[107913]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-ca91b450-12c6-4815-bb68-7d1cb814c9aa tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c081c145-134f-4809-bc3c-a43d20ccc436" returned: 0 in 0.473s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-ca91b450-12c6-4815-bb68-7d1cb814c9aa tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c081c145-134f-4809-bc3c-a43d20ccc436 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:36 devstack sudo[107933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c081c145-134f-4809-bc3c-a43d20ccc436 Jul 30 17:10:36 devstack sudo[107933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:36 devstack sudo[107931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5743808e-c055-4ac6-8ff9-017d24ee38df_u23eagmidevstack@QuobyteHD Jul 30 17:10:36 devstack sudo[107931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:36 devstack sudo[107914]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9478ae61-d0ff-40c0-a231-3788973d8571 tempest-CreateVolumesFromSnapshotTest-1648007070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bb66a854-0389-4789-823f-3350614a6726 1073741824" returned: 0 in 0.527s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9478ae61-d0ff-40c0-a231-3788973d8571 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bb66a854-0389-4789-823f-3350614a6726 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:36 devstack sudo[107939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bb66a854-0389-4789-823f-3350614a6726 Jul 30 17:10:36 devstack sudo[107939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:36 devstack sudo[107931]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9f10da4e-4411-4ff5-a7f5-6de4e935d05a tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5743808e-c055-4ac6-8ff9-017d24ee38df_u23eagmidevstack@QuobyteHD" returned: 1 in 0.352s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9f10da4e-4411-4ff5-a7f5-6de4e935d05a tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5743808e-c055-4ac6-8ff9-017d24ee38df_u23eagmidevstack@QuobyteHD' failed. Not Retrying. {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 17:10:36 devstack cinder-volume[88568]: DEBUG cinder.image.image_utils [None req-9f10da4e-4411-4ff5-a7f5-6de4e935d05a tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] 5743808e-c055-4ac6-8ff9-017d24ee38df was raw, converting to qcow2 {{(pid=88568) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 30 17:10:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9f10da4e-4411-4ff5-a7f5-6de4e935d05a tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5743808e-c055-4ac6-8ff9-017d24ee38df_u23eagmidevstack@QuobyteHD /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-98f74670-d5eb-4e3b-93fd-f27f66792f4e {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:36 devstack sudo[107929]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:36 devstack sudo[107933]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-493f50ef-51ff-4ece-82f1-40c5d5817d7b tempest-VolumeImageDependencyTests-418620943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-01919c96-7ba3-4802-b03f-00413ce0183d 1G" returned: 0 in 0.407s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:36 devstack cinder-volume[88568]: DEBUG cinder.volume.volume_utils [None req-493f50ef-51ff-4ece-82f1-40c5d5817d7b tempest-VolumeImageDependencyTests-418620943 None] Downloaded image c9603162-6489-4e7e-b109-aff864f9917c ((None, [{'url': 'file:///opt/stack/data/glance/images/c9603162-6489-4e7e-b109-aff864f9917c', 'metadata': {}}])) to volume 01919c96-7ba3-4802-b03f-00413ce0183d successfully. {{(pid=88568) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 30 17:10:36 devstack cinder-volume[88568]: DEBUG cinder.image.image_utils [None req-493f50ef-51ff-4ece-82f1-40c5d5817d7b tempest-VolumeImageDependencyTests-418620943 None] Temporary image c9603162-6489-4e7e-b109-aff864f9917c for user abe5db238ac84699874b624100c83244 is deleted. {{(pid=88568) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 30 17:10:36 devstack cinder-volume[88568]: DEBUG cinder.volume.volume_utils [None req-493f50ef-51ff-4ece-82f1-40c5d5817d7b tempest-VolumeImageDependencyTests-418620943 None] Marking volume 01919c96-7ba3-4802-b03f-00413ce0183d as bootable. {{(pid=88568) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 30 17:10:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-ca91b450-12c6-4815-bb68-7d1cb814c9aa tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c081c145-134f-4809-bc3c-a43d20ccc436" returned: 0 in 0.325s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:36 devstack sudo[107946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5743808e-c055-4ac6-8ff9-017d24ee38df_u23eagmidevstack@QuobyteHD /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-98f74670-d5eb-4e3b-93fd-f27f66792f4e Jul 30 17:10:36 devstack sudo[107946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:36 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-493f50ef-51ff-4ece-82f1-40c5d5817d7b tempest-VolumeImageDependencyTests-418620943 None] Copying metadata from image c9603162-6489-4e7e-b109-aff864f9917c to 01919c96-7ba3-4802-b03f-00413ce0183d. {{(pid=88568) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 30 17:10:36 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-493f50ef-51ff-4ece-82f1-40c5d5817d7b tempest-VolumeImageDependencyTests-418620943 None] Creating volume glance metadata for volume 01919c96-7ba3-4802-b03f-00413ce0183d backed by image c9603162-6489-4e7e-b109-aff864f9917c with: {'image_id': 'c9603162-6489-4e7e-b109-aff864f9917c', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'd76cef1185cf06db33c6cde4bd83ba5d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88568) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 30 17:10:36 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-ca91b450-12c6-4815-bb68-7d1cb814c9aa tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Lock "cinder-quobyte-c081c145-134f-4809-bc3c-a43d20ccc436" released by "delete_volume" :: held 0.911s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:36 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-ca91b450-12c6-4815-bb68-7d1cb814c9aa tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Created reservations ['233e2798-d86a-49ed-bdcf-765ec2016af1', '43ff0374-eb4b-42f0-92ec-6859f94fd61d', '826946eb-ee69-4c02-bec7-4fa6eb78cb76', '1c93c22a-77fe-4cc3-99bb-a0926ccdd629'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:10:36 devstack sudo[107939]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9478ae61-d0ff-40c0-a231-3788973d8571 tempest-CreateVolumesFromSnapshotTest-1648007070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bb66a854-0389-4789-823f-3350614a6726" returned: 0 in 0.310s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:36 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-9478ae61-d0ff-40c0-a231-3788973d8571 tempest-CreateVolumesFromSnapshotTest-1648007070 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:10:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-9478ae61-d0ff-40c0-a231-3788973d8571 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-803ebf34-e210-41a8-baa1-cdbd7799611a tempest-CreateVolumesFromSnapshotTest-1648007070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.020s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:36 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-803ebf34-e210-41a8-baa1-cdbd7799611a tempest-CreateVolumesFromSnapshotTest-1648007070 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:10:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-454856300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54136732-049a-449c-baba-81d5c8de3240,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a1bfeeec4e441d0b285d4af6adeba66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:10:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:10:31Z,use_quota=True,user_id='42456a79f14e4e68b2d93c2b982eff90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:10:36 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-803ebf34-e210-41a8-baa1-cdbd7799611a tempest-CreateVolumesFromSnapshotTest-1648007070 None] Creating volume 54136732-049a-449c-baba-81d5c8de3240 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:10:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-803ebf34-e210-41a8-baa1-cdbd7799611a tempest-CreateVolumesFromSnapshotTest-1648007070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-803ebf34-e210-41a8-baa1-cdbd7799611a tempest-CreateVolumesFromSnapshotTest-1648007070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:36 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-803ebf34-e210-41a8-baa1-cdbd7799611a tempest-CreateVolumesFromSnapshotTest-1648007070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:10:36 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-803ebf34-e210-41a8-baa1-cdbd7799611a tempest-CreateVolumesFromSnapshotTest-1648007070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:10:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-803ebf34-e210-41a8-baa1-cdbd7799611a tempest-CreateVolumesFromSnapshotTest-1648007070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:36 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-803ebf34-e210-41a8-baa1-cdbd7799611a tempest-CreateVolumesFromSnapshotTest-1648007070 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:10:36 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-803ebf34-e210-41a8-baa1-cdbd7799611a tempest-CreateVolumesFromSnapshotTest-1648007070 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:10:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-803ebf34-e210-41a8-baa1-cdbd7799611a tempest-CreateVolumesFromSnapshotTest-1648007070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-54136732-049a-449c-baba-81d5c8de3240 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:36 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-493f50ef-51ff-4ece-82f1-40c5d5817d7b tempest-VolumeImageDependencyTests-418620943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f664b68-4f86-4651-9d63-07f55e397a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01919c96-7ba3-4802-b03f-00413ce0183d', 'volume_size': 1, 'image_id': 'c9603162-6489-4e7e-b109-aff864f9917c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c9603162-6489-4e7e-b109-aff864f9917c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd76cef1185cf06db33c6cde4bd83ba5d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ea282265e169485f8f81c8ad42213435', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '60f4fe4c8ccbfd6d027db038b5021f5dcc7095b432bbcacf5269b9447293b64ec3881117fb723c3accf1aa005d027e700c3c2b202a14a24b452b773a26b64e6d', 'id': 'c9603162-6489-4e7e-b109-aff864f9917c', 'created_at': datetime.datetime(2026, 7, 30, 15, 10, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 15, 10, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c9603162-6489-4e7e-b109-aff864f9917c/file', 'properties': {}}, 'image_service': }' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:36 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-493f50ef-51ff-4ece-82f1-40c5d5817d7b tempest-VolumeImageDependencyTests-418620943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d64a3271-6849-460c-b915-0ddc2d8fdf39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:36 devstack sudo[107949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-54136732-049a-449c-baba-81d5c8de3240 1073741824 Jul 30 17:10:36 devstack sudo[107949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:36 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9478ae61-d0ff-40c0-a231-3788973d8571 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ac55464-cc18-467d-82a4-8cb83d86d456) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb66a854-0389-4789-823f-3350614a6726', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:36 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9478ae61-d0ff-40c0-a231-3788973d8571 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f0018f3-0a32-4e3a-846d-0ca449e37b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:36 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-493f50ef-51ff-4ece-82f1-40c5d5817d7b tempest-VolumeImageDependencyTests-418620943 None] Volume volume-01919c96-7ba3-4802-b03f-00413ce0183d (01919c96-7ba3-4802-b03f-00413ce0183d): created successfully Jul 30 17:10:36 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-493f50ef-51ff-4ece-82f1-40c5d5817d7b tempest-VolumeImageDependencyTests-418620943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d64a3271-6849-460c-b915-0ddc2d8fdf39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:36 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-493f50ef-51ff-4ece-82f1-40c5d5817d7b tempest-VolumeImageDependencyTests-418620943 None] Flow 'volume_create_manager' (1bbf44a3-5d78-4643-8797-03f62c95a22d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:10:36 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-9478ae61-d0ff-40c0-a231-3788973d8571 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Volume volume-bb66a854-0389-4789-823f-3350614a6726 (bb66a854-0389-4789-823f-3350614a6726): created successfully Jul 30 17:10:36 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9478ae61-d0ff-40c0-a231-3788973d8571 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f0018f3-0a32-4e3a-846d-0ca449e37b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:36 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9478ae61-d0ff-40c0-a231-3788973d8571 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Flow 'volume_create_manager' (9a3390b8-e30d-4372-b58b-2e7deeac23a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:10:36 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-493f50ef-51ff-4ece-82f1-40c5d5817d7b tempest-VolumeImageDependencyTests-418620943 None] Created volume successfully. Jul 30 17:10:36 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-9478ae61-d0ff-40c0-a231-3788973d8571 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Created volume successfully. Jul 30 17:10:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-ca91b450-12c6-4815-bb68-7d1cb814c9aa tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-ca91b450-12c6-4815-bb68-7d1cb814c9aa tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:36 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-ca91b450-12c6-4815-bb68-7d1cb814c9aa tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:10:36 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-ca91b450-12c6-4815-bb68-7d1cb814c9aa tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:10:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-ca91b450-12c6-4815-bb68-7d1cb814c9aa tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-ca91b450-12c6-4815-bb68-7d1cb814c9aa tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:36 devstack sudo[107954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:10:36 devstack sudo[107954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:36 devstack sudo[107946]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9f10da4e-4411-4ff5-a7f5-6de4e935d05a tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5743808e-c055-4ac6-8ff9-017d24ee38df_u23eagmidevstack@QuobyteHD /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-98f74670-d5eb-4e3b-93fd-f27f66792f4e" returned: 0 in 0.548s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:36 devstack cinder-volume[88568]: DEBUG cinder.image.image_utils [None req-9f10da4e-4411-4ff5-a7f5-6de4e935d05a tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5743808e-c055-4ac6-8ff9-017d24ee38df_u23eagmidevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-98f74670-d5eb-4e3b-93fd-f27f66792f4e {{(pid=88568) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 17:10:36 devstack cinder-volume[88568]: INFO cinder.image.image_utils [None req-9f10da4e-4411-4ff5-a7f5-6de4e935d05a tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] Converted 0.00 MB image at 0.00 MB/s Jul 30 17:10:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9f10da4e-4411-4ff5-a7f5-6de4e935d05a tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-98f74670-d5eb-4e3b-93fd-f27f66792f4e 1G {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:36 devstack sudo[107959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-98f74670-d5eb-4e3b-93fd-f27f66792f4e 1G Jul 30 17:10:36 devstack sudo[107959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:36 devstack sudo[107954]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-ca91b450-12c6-4815-bb68-7d1cb814c9aa tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.267s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:36 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-ca91b450-12c6-4815-bb68-7d1cb814c9aa tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:10:36 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-ca91b450-12c6-4815-bb68-7d1cb814c9aa tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Deleted volume successfully. Jul 30 17:10:37 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-ca91b450-12c6-4815-bb68-7d1cb814c9aa tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Lock "cinder-c081c145-134f-4809-bc3c-a43d20ccc436-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:37 devstack sudo[107949]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:37 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-803ebf34-e210-41a8-baa1-cdbd7799611a tempest-CreateVolumesFromSnapshotTest-1648007070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-54136732-049a-449c-baba-81d5c8de3240 1073741824" returned: 0 in 0.511s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:37 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-803ebf34-e210-41a8-baa1-cdbd7799611a tempest-CreateVolumesFromSnapshotTest-1648007070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-54136732-049a-449c-baba-81d5c8de3240 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:37 devstack sudo[107963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-54136732-049a-449c-baba-81d5c8de3240 Jul 30 17:10:37 devstack sudo[107963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:37 devstack sudo[107959]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:37 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9f10da4e-4411-4ff5-a7f5-6de4e935d05a tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-98f74670-d5eb-4e3b-93fd-f27f66792f4e 1G" returned: 0 in 0.341s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:37 devstack cinder-volume[88568]: DEBUG cinder.volume.volume_utils [None req-9f10da4e-4411-4ff5-a7f5-6de4e935d05a tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] Downloaded image 5743808e-c055-4ac6-8ff9-017d24ee38df ((None, [{'url': 'file:///opt/stack/data/glance/images/5743808e-c055-4ac6-8ff9-017d24ee38df', 'metadata': {}}])) to volume 98f74670-d5eb-4e3b-93fd-f27f66792f4e successfully. {{(pid=88568) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 30 17:10:37 devstack cinder-volume[88568]: DEBUG cinder.image.image_utils [None req-9f10da4e-4411-4ff5-a7f5-6de4e935d05a tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] Temporary image 5743808e-c055-4ac6-8ff9-017d24ee38df for user f0e50b4878574e5ba94f504c0720c0ab is deleted. {{(pid=88568) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 30 17:10:37 devstack cinder-volume[88568]: DEBUG cinder.volume.volume_utils [None req-9f10da4e-4411-4ff5-a7f5-6de4e935d05a tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] Marking volume 98f74670-d5eb-4e3b-93fd-f27f66792f4e as bootable. {{(pid=88568) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 30 17:10:37 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f10da4e-4411-4ff5-a7f5-6de4e935d05a tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] Copying metadata from image 5743808e-c055-4ac6-8ff9-017d24ee38df to 98f74670-d5eb-4e3b-93fd-f27f66792f4e. {{(pid=88568) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 30 17:10:37 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f10da4e-4411-4ff5-a7f5-6de4e935d05a tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] Creating volume glance metadata for volume 98f74670-d5eb-4e3b-93fd-f27f66792f4e backed by image 5743808e-c055-4ac6-8ff9-017d24ee38df with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '5743808e-c055-4ac6-8ff9-017d24ee38df', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '1efa6977721ea726abd0777db39741f3', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88568) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 30 17:10:37 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9f10da4e-4411-4ff5-a7f5-6de4e935d05a tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (644fcfa2-822f-4cc6-96bf-deb6e1ddfa40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98f74670-d5eb-4e3b-93fd-f27f66792f4e', 'volume_size': 1, 'image_id': '5743808e-c055-4ac6-8ff9-017d24ee38df', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5743808e-c055-4ac6-8ff9-017d24ee38df', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1efa6977721ea726abd0777db39741f3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '916d6533ed214008ac358384ae464381', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8712d742886b617bc402cf9638ba467fc2bd696fd984b2c2758a41bea86c94700158cf67e909ef298951364e6852dea6060f09d7f2cfd449ccd94d73024ead58', 'id': '5743808e-c055-4ac6-8ff9-017d24ee38df', 'created_at': datetime.datetime(2026, 7, 30, 15, 10, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 15, 10, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5743808e-c055-4ac6-8ff9-017d24ee38df/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:37 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9f10da4e-4411-4ff5-a7f5-6de4e935d05a tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d4fa8b9-630b-4283-8248-54df8bb97a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:37 devstack sudo[107963]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:37 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-9f10da4e-4411-4ff5-a7f5-6de4e935d05a tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] Volume volume-98f74670-d5eb-4e3b-93fd-f27f66792f4e (98f74670-d5eb-4e3b-93fd-f27f66792f4e): created successfully Jul 30 17:10:37 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9f10da4e-4411-4ff5-a7f5-6de4e935d05a tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d4fa8b9-630b-4283-8248-54df8bb97a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:37 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9f10da4e-4411-4ff5-a7f5-6de4e935d05a tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] Flow 'volume_create_manager' (e89627a0-3718-4e92-ae8f-ae45c95b4d80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:10:37 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-803ebf34-e210-41a8-baa1-cdbd7799611a tempest-CreateVolumesFromSnapshotTest-1648007070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-54136732-049a-449c-baba-81d5c8de3240" returned: 0 in 0.275s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:37 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-803ebf34-e210-41a8-baa1-cdbd7799611a tempest-CreateVolumesFromSnapshotTest-1648007070 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:10:37 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-803ebf34-e210-41a8-baa1-cdbd7799611a tempest-CreateVolumesFromSnapshotTest-1648007070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:37 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-23f5d583-b6e0-45a6-a422-b665e5e9397d tempest-CreateVolumesFromSnapshotTest-1648007070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.469s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:37 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-23f5d583-b6e0-45a6-a422-b665e5e9397d tempest-CreateVolumesFromSnapshotTest-1648007070 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:10:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-825988464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c833f06-8e80-41bb-b4fd-a85f517c5c9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a1bfeeec4e441d0b285d4af6adeba66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:10:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:10:32Z,use_quota=True,user_id='42456a79f14e4e68b2d93c2b982eff90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:10:37 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-23f5d583-b6e0-45a6-a422-b665e5e9397d tempest-CreateVolumesFromSnapshotTest-1648007070 None] Creating volume 9c833f06-8e80-41bb-b4fd-a85f517c5c9a {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:10:37 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-23f5d583-b6e0-45a6-a422-b665e5e9397d tempest-CreateVolumesFromSnapshotTest-1648007070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:37 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-23f5d583-b6e0-45a6-a422-b665e5e9397d tempest-CreateVolumesFromSnapshotTest-1648007070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:37 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-23f5d583-b6e0-45a6-a422-b665e5e9397d tempest-CreateVolumesFromSnapshotTest-1648007070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:10:37 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-23f5d583-b6e0-45a6-a422-b665e5e9397d tempest-CreateVolumesFromSnapshotTest-1648007070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:10:37 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-23f5d583-b6e0-45a6-a422-b665e5e9397d tempest-CreateVolumesFromSnapshotTest-1648007070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:37 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-23f5d583-b6e0-45a6-a422-b665e5e9397d tempest-CreateVolumesFromSnapshotTest-1648007070 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:10:37 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-23f5d583-b6e0-45a6-a422-b665e5e9397d tempest-CreateVolumesFromSnapshotTest-1648007070 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:10:37 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-23f5d583-b6e0-45a6-a422-b665e5e9397d tempest-CreateVolumesFromSnapshotTest-1648007070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9c833f06-8e80-41bb-b4fd-a85f517c5c9a 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:37 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-9f10da4e-4411-4ff5-a7f5-6de4e935d05a tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] Created volume successfully. Jul 30 17:10:37 devstack sudo[107969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9c833f06-8e80-41bb-b4fd-a85f517c5c9a 1073741824 Jul 30 17:10:37 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-803ebf34-e210-41a8-baa1-cdbd7799611a tempest-CreateVolumesFromSnapshotTest-1648007070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1ac90b4-b07e-4a1c-a31b-5ba2036f17d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54136732-049a-449c-baba-81d5c8de3240', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:37 devstack sudo[107969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:37 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-803ebf34-e210-41a8-baa1-cdbd7799611a tempest-CreateVolumesFromSnapshotTest-1648007070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d746b925-85ea-494b-84a3-c69de97427a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:37 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-803ebf34-e210-41a8-baa1-cdbd7799611a tempest-CreateVolumesFromSnapshotTest-1648007070 None] Volume volume-54136732-049a-449c-baba-81d5c8de3240 (54136732-049a-449c-baba-81d5c8de3240): created successfully Jul 30 17:10:37 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-803ebf34-e210-41a8-baa1-cdbd7799611a tempest-CreateVolumesFromSnapshotTest-1648007070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d746b925-85ea-494b-84a3-c69de97427a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:37 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-803ebf34-e210-41a8-baa1-cdbd7799611a tempest-CreateVolumesFromSnapshotTest-1648007070 None] Flow 'volume_create_manager' (20de75c0-bc7d-429a-b4c0-96cd0f2b9266) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:10:37 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-803ebf34-e210-41a8-baa1-cdbd7799611a tempest-CreateVolumesFromSnapshotTest-1648007070 None] Created volume successfully. Jul 30 17:10:37 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-9e7b92c7-2151-4a57-8e46-c2234e3e4c53 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Acquiring lock "cinder-e6f84c02-20a0-4364-8589-c232dfd34474-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:37 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-9e7b92c7-2151-4a57-8e46-c2234e3e4c53 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Lock "cinder-e6f84c02-20a0-4364-8589-c232dfd34474-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:37 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-9e7b92c7-2151-4a57-8e46-c2234e3e4c53 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Acquiring lock "cinder-quobyte-e6f84c02-20a0-4364-8589-c232dfd34474" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:37 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-9e7b92c7-2151-4a57-8e46-c2234e3e4c53 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Lock "cinder-quobyte-e6f84c02-20a0-4364-8589-c232dfd34474" acquired by "delete_volume" :: waited 0.018s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:37 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fdad2ff-02f3-4b2d-8f11-ccf08c9dd064]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:10:37 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9e7b92c7-2151-4a57-8e46-c2234e3e4c53 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e6f84c02-20a0-4364-8589-c232dfd34474 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:37 devstack sudo[107974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e6f84c02-20a0-4364-8589-c232dfd34474 Jul 30 17:10:37 devstack sudo[107974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:37 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-aaad4dd1-7541-424a-a0b4-f6f4f6bd4cf6 tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] Acquiring lock "cinder-98f74670-d5eb-4e3b-93fd-f27f66792f4e-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:37 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-338fe864-d706-4801-af31-89b1e92b9334 tempest-VolumeImageDependencyTests-418620943 None] Acquiring lock "cinder-01919c96-7ba3-4802-b03f-00413ce0183d-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:37 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-aaad4dd1-7541-424a-a0b4-f6f4f6bd4cf6 tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] Lock "cinder-98f74670-d5eb-4e3b-93fd-f27f66792f4e-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:37 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-338fe864-d706-4801-af31-89b1e92b9334 tempest-VolumeImageDependencyTests-418620943 None] Lock "cinder-01919c96-7ba3-4802-b03f-00413ce0183d-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:37 devstack sudo[107969]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:38 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-23f5d583-b6e0-45a6-a422-b665e5e9397d tempest-CreateVolumesFromSnapshotTest-1648007070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9c833f06-8e80-41bb-b4fd-a85f517c5c9a 1073741824" returned: 0 in 0.614s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:38 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-338fe864-d706-4801-af31-89b1e92b9334 tempest-VolumeImageDependencyTests-418620943 None] Acquiring lock "cinder-quobyte-01919c96-7ba3-4802-b03f-00413ce0183d" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:38 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-aaad4dd1-7541-424a-a0b4-f6f4f6bd4cf6 tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] Acquiring lock "cinder-quobyte-98f74670-d5eb-4e3b-93fd-f27f66792f4e" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:38 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-23f5d583-b6e0-45a6-a422-b665e5e9397d tempest-CreateVolumesFromSnapshotTest-1648007070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9c833f06-8e80-41bb-b4fd-a85f517c5c9a {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:38 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-338fe864-d706-4801-af31-89b1e92b9334 tempest-VolumeImageDependencyTests-418620943 None] Lock "cinder-quobyte-01919c96-7ba3-4802-b03f-00413ce0183d" acquired by "delete_volume" :: waited 0.042s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:38 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-aaad4dd1-7541-424a-a0b4-f6f4f6bd4cf6 tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] Lock "cinder-quobyte-98f74670-d5eb-4e3b-93fd-f27f66792f4e" acquired by "delete_volume" :: waited 0.057s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:38 devstack sudo[107976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9c833f06-8e80-41bb-b4fd-a85f517c5c9a Jul 30 17:10:38 devstack sudo[107976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:38 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[56fd989a-5f9e-465f-90b5-633c71041d13]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:10:38 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-338fe864-d706-4801-af31-89b1e92b9334 tempest-VolumeImageDependencyTests-418620943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-01919c96-7ba3-4802-b03f-00413ce0183d {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:38 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[87867c34-43f8-42ee-a7df-8ba8543ba98d]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:10:38 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-aaad4dd1-7541-424a-a0b4-f6f4f6bd4cf6 tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-98f74670-d5eb-4e3b-93fd-f27f66792f4e {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:38 devstack sudo[107974]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:38 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9e7b92c7-2151-4a57-8e46-c2234e3e4c53 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e6f84c02-20a0-4364-8589-c232dfd34474" returned: 0 in 0.465s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:38 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9e7b92c7-2151-4a57-8e46-c2234e3e4c53 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e6f84c02-20a0-4364-8589-c232dfd34474 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:38 devstack sudo[107978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-01919c96-7ba3-4802-b03f-00413ce0183d Jul 30 17:10:38 devstack sudo[107978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:38 devstack sudo[107983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e6f84c02-20a0-4364-8589-c232dfd34474 Jul 30 17:10:38 devstack sudo[107983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:38 devstack sudo[107981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-98f74670-d5eb-4e3b-93fd-f27f66792f4e Jul 30 17:10:38 devstack sudo[107981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:38 devstack sudo[107976]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:38 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-23f5d583-b6e0-45a6-a422-b665e5e9397d tempest-CreateVolumesFromSnapshotTest-1648007070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9c833f06-8e80-41bb-b4fd-a85f517c5c9a" returned: 0 in 0.294s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:38 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-23f5d583-b6e0-45a6-a422-b665e5e9397d tempest-CreateVolumesFromSnapshotTest-1648007070 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:10:38 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-23f5d583-b6e0-45a6-a422-b665e5e9397d tempest-CreateVolumesFromSnapshotTest-1648007070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:38 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-7a6f6749-fbd7-499d-bf44-008897ad2f8d tempest-CreateVolumesFromSnapshotTest-1648007070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.017s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:38 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-7a6f6749-fbd7-499d-bf44-008897ad2f8d tempest-CreateVolumesFromSnapshotTest-1648007070 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:10:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1912456163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9ac7485-159b-4c52-8b79-ef8aef31ded6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a1bfeeec4e441d0b285d4af6adeba66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:10:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:10:32Z,use_quota=True,user_id='42456a79f14e4e68b2d93c2b982eff90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:10:38 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-7a6f6749-fbd7-499d-bf44-008897ad2f8d tempest-CreateVolumesFromSnapshotTest-1648007070 None] Creating volume e9ac7485-159b-4c52-8b79-ef8aef31ded6 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:10:38 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-7a6f6749-fbd7-499d-bf44-008897ad2f8d tempest-CreateVolumesFromSnapshotTest-1648007070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:38 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-7a6f6749-fbd7-499d-bf44-008897ad2f8d tempest-CreateVolumesFromSnapshotTest-1648007070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:38 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-7a6f6749-fbd7-499d-bf44-008897ad2f8d tempest-CreateVolumesFromSnapshotTest-1648007070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:10:38 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-7a6f6749-fbd7-499d-bf44-008897ad2f8d tempest-CreateVolumesFromSnapshotTest-1648007070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:10:38 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-7a6f6749-fbd7-499d-bf44-008897ad2f8d tempest-CreateVolumesFromSnapshotTest-1648007070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:38 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-7a6f6749-fbd7-499d-bf44-008897ad2f8d tempest-CreateVolumesFromSnapshotTest-1648007070 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:10:38 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-7a6f6749-fbd7-499d-bf44-008897ad2f8d tempest-CreateVolumesFromSnapshotTest-1648007070 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:10:38 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7a6f6749-fbd7-499d-bf44-008897ad2f8d tempest-CreateVolumesFromSnapshotTest-1648007070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e9ac7485-159b-4c52-8b79-ef8aef31ded6 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:38 devstack sudo[107988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e9ac7485-159b-4c52-8b79-ef8aef31ded6 1073741824 Jul 30 17:10:38 devstack sudo[107988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:38 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-23f5d583-b6e0-45a6-a422-b665e5e9397d tempest-CreateVolumesFromSnapshotTest-1648007070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8e1fb15-8ceb-4b96-8fb1-6f0545937215) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c833f06-8e80-41bb-b4fd-a85f517c5c9a', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:38 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-23f5d583-b6e0-45a6-a422-b665e5e9397d tempest-CreateVolumesFromSnapshotTest-1648007070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36260f3d-183f-4e57-96b3-9a320eca405c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:38 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-23f5d583-b6e0-45a6-a422-b665e5e9397d tempest-CreateVolumesFromSnapshotTest-1648007070 None] Volume volume-9c833f06-8e80-41bb-b4fd-a85f517c5c9a (9c833f06-8e80-41bb-b4fd-a85f517c5c9a): created successfully Jul 30 17:10:38 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-23f5d583-b6e0-45a6-a422-b665e5e9397d tempest-CreateVolumesFromSnapshotTest-1648007070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36260f3d-183f-4e57-96b3-9a320eca405c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:38 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-23f5d583-b6e0-45a6-a422-b665e5e9397d tempest-CreateVolumesFromSnapshotTest-1648007070 None] Flow 'volume_create_manager' (f1b46a86-602e-4c80-bc20-45ea6f7c9a2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:10:38 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-23f5d583-b6e0-45a6-a422-b665e5e9397d tempest-CreateVolumesFromSnapshotTest-1648007070 None] Created volume successfully. Jul 30 17:10:38 devstack sudo[107983]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:38 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9e7b92c7-2151-4a57-8e46-c2234e3e4c53 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e6f84c02-20a0-4364-8589-c232dfd34474" returned: 0 in 0.302s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:38 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-9e7b92c7-2151-4a57-8e46-c2234e3e4c53 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Lock "cinder-quobyte-e6f84c02-20a0-4364-8589-c232dfd34474" released by "delete_volume" :: held 0.830s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:38 devstack sudo[107978]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:38 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-338fe864-d706-4801-af31-89b1e92b9334 tempest-VolumeImageDependencyTests-418620943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-01919c96-7ba3-4802-b03f-00413ce0183d" returned: 0 in 0.438s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:38 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-338fe864-d706-4801-af31-89b1e92b9334 tempest-VolumeImageDependencyTests-418620943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-01919c96-7ba3-4802-b03f-00413ce0183d {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:38 devstack sudo[107981]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:38 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-aaad4dd1-7541-424a-a0b4-f6f4f6bd4cf6 tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-98f74670-d5eb-4e3b-93fd-f27f66792f4e" returned: 0 in 0.440s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:38 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-aaad4dd1-7541-424a-a0b4-f6f4f6bd4cf6 tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-98f74670-d5eb-4e3b-93fd-f27f66792f4e {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:38 devstack sudo[107998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-01919c96-7ba3-4802-b03f-00413ce0183d Jul 30 17:10:38 devstack sudo[107998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:38 devstack sudo[107999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-98f74670-d5eb-4e3b-93fd-f27f66792f4e Jul 30 17:10:38 devstack sudo[107999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:38 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-9e7b92c7-2151-4a57-8e46-c2234e3e4c53 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Created reservations ['fb1352cf-5e29-4866-a56a-f848a4b99bd6', 'bfe8868c-d2ab-4f8b-bcc0-b3846b246abb', 'b7d5471d-39ea-4090-a85a-229a22411613', '90fa8692-312e-43ae-bf4b-d4de9309d53e'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:10:38 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-9e7b92c7-2151-4a57-8e46-c2234e3e4c53 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:38 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-9e7b92c7-2151-4a57-8e46-c2234e3e4c53 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:38 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-9e7b92c7-2151-4a57-8e46-c2234e3e4c53 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:10:38 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-9e7b92c7-2151-4a57-8e46-c2234e3e4c53 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:10:38 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-9e7b92c7-2151-4a57-8e46-c2234e3e4c53 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:38 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9e7b92c7-2151-4a57-8e46-c2234e3e4c53 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:38 devstack sudo[108005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:10:38 devstack sudo[108005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:38 devstack sudo[107998]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:38 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-338fe864-d706-4801-af31-89b1e92b9334 tempest-VolumeImageDependencyTests-418620943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-01919c96-7ba3-4802-b03f-00413ce0183d" returned: 0 in 0.320s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:38 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-338fe864-d706-4801-af31-89b1e92b9334 tempest-VolumeImageDependencyTests-418620943 None] Lock "cinder-quobyte-01919c96-7ba3-4802-b03f-00413ce0183d" released by "delete_volume" :: held 0.814s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:38 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-c3c1bc5a-38c3-4ee7-98aa-76bb1fa60480 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Acquiring lock "cinder-2fb044fc-95ac-4d85-924d-6152b0d88de4-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:38 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-c3c1bc5a-38c3-4ee7-98aa-76bb1fa60480 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Lock "cinder-2fb044fc-95ac-4d85-924d-6152b0d88de4-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:38 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-c3c1bc5a-38c3-4ee7-98aa-76bb1fa60480 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Acquiring lock "cinder-quobyte-2fb044fc-95ac-4d85-924d-6152b0d88de4" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:39 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-c3c1bc5a-38c3-4ee7-98aa-76bb1fa60480 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Lock "cinder-quobyte-2fb044fc-95ac-4d85-924d-6152b0d88de4" acquired by "delete_volume" :: waited 0.026s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:39 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-338fe864-d706-4801-af31-89b1e92b9334 tempest-VolumeImageDependencyTests-418620943 None] Created reservations ['23d4a54d-b1a1-4492-a62b-58de0b703ab3', 'a0bbbf7b-4f99-458e-8a72-80cf5d4141c0', '7ca662f6-8f43-486e-8144-f7bceb1f8d60', 'd14c9fc0-9828-4a69-86a8-e60ad128ce73'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:10:39 devstack sudo[107999]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:39 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[3efa6cfb-1b06-45bb-ac10-12b4c402c032]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:10:39 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-c3c1bc5a-38c3-4ee7-98aa-76bb1fa60480 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2fb044fc-95ac-4d85-924d-6152b0d88de4 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:39 devstack sudo[108005]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:39 devstack sudo[107988]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:39 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-aaad4dd1-7541-424a-a0b4-f6f4f6bd4cf6 tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-98f74670-d5eb-4e3b-93fd-f27f66792f4e" returned: 0 in 0.521s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:39 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9e7b92c7-2151-4a57-8e46-c2234e3e4c53 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.410s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:39 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7a6f6749-fbd7-499d-bf44-008897ad2f8d tempest-CreateVolumesFromSnapshotTest-1648007070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e9ac7485-159b-4c52-8b79-ef8aef31ded6 1073741824" returned: 0 in 0.735s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:39 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-9e7b92c7-2151-4a57-8e46-c2234e3e4c53 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:10:39 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-9e7b92c7-2151-4a57-8e46-c2234e3e4c53 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Deleted volume successfully. Jul 30 17:10:39 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-aaad4dd1-7541-424a-a0b4-f6f4f6bd4cf6 tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] Lock "cinder-quobyte-98f74670-d5eb-4e3b-93fd-f27f66792f4e" released by "delete_volume" :: held 1.043s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:39 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-9e7b92c7-2151-4a57-8e46-c2234e3e4c53 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Lock "cinder-e6f84c02-20a0-4364-8589-c232dfd34474-delete_volume" released by "delete_volume" :: held 1.518s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:39 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7a6f6749-fbd7-499d-bf44-008897ad2f8d tempest-CreateVolumesFromSnapshotTest-1648007070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e9ac7485-159b-4c52-8b79-ef8aef31ded6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:39 devstack sudo[108010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2fb044fc-95ac-4d85-924d-6152b0d88de4 Jul 30 17:10:39 devstack sudo[108010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:39 devstack sudo[108011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e9ac7485-159b-4c52-8b79-ef8aef31ded6 Jul 30 17:10:39 devstack sudo[108011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:39 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-338fe864-d706-4801-af31-89b1e92b9334 tempest-VolumeImageDependencyTests-418620943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:39 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-338fe864-d706-4801-af31-89b1e92b9334 tempest-VolumeImageDependencyTests-418620943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:39 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-338fe864-d706-4801-af31-89b1e92b9334 tempest-VolumeImageDependencyTests-418620943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:10:39 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-338fe864-d706-4801-af31-89b1e92b9334 tempest-VolumeImageDependencyTests-418620943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:10:39 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-338fe864-d706-4801-af31-89b1e92b9334 tempest-VolumeImageDependencyTests-418620943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:39 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-338fe864-d706-4801-af31-89b1e92b9334 tempest-VolumeImageDependencyTests-418620943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:39 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-aaad4dd1-7541-424a-a0b4-f6f4f6bd4cf6 tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] Created reservations ['3a55e778-63d6-474d-901d-19dc36dc23b4', '628c0375-3dc1-4759-91ea-20909d277fca', '5175177e-3866-48c6-b718-4148ca99380f', 'e829eb1c-d813-4e66-b88e-4b79732cce4f'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:10:39 devstack sudo[108014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:10:39 devstack sudo[108014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:39 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-aaad4dd1-7541-424a-a0b4-f6f4f6bd4cf6 tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:39 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-aaad4dd1-7541-424a-a0b4-f6f4f6bd4cf6 tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:39 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-aaad4dd1-7541-424a-a0b4-f6f4f6bd4cf6 tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:10:39 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-aaad4dd1-7541-424a-a0b4-f6f4f6bd4cf6 tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:10:39 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-aaad4dd1-7541-424a-a0b4-f6f4f6bd4cf6 tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:39 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-aaad4dd1-7541-424a-a0b4-f6f4f6bd4cf6 tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:39 devstack sudo[108016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:10:39 devstack sudo[108016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:39 devstack sudo[108011]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:39 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7a6f6749-fbd7-499d-bf44-008897ad2f8d tempest-CreateVolumesFromSnapshotTest-1648007070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e9ac7485-159b-4c52-8b79-ef8aef31ded6" returned: 0 in 0.270s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:39 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-7a6f6749-fbd7-499d-bf44-008897ad2f8d tempest-CreateVolumesFromSnapshotTest-1648007070 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:10:39 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-7a6f6749-fbd7-499d-bf44-008897ad2f8d tempest-CreateVolumesFromSnapshotTest-1648007070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:39 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7a6f6749-fbd7-499d-bf44-008897ad2f8d tempest-CreateVolumesFromSnapshotTest-1648007070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (242289f0-3250-4c2a-94bb-3668ef080367) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9ac7485-159b-4c52-8b79-ef8aef31ded6', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:39 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7a6f6749-fbd7-499d-bf44-008897ad2f8d tempest-CreateVolumesFromSnapshotTest-1648007070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bf4770e-6dce-4fac-92b9-cc2a525d2553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:39 devstack sudo[108010]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:39 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-c3c1bc5a-38c3-4ee7-98aa-76bb1fa60480 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2fb044fc-95ac-4d85-924d-6152b0d88de4" returned: 0 in 0.408s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:39 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-c3c1bc5a-38c3-4ee7-98aa-76bb1fa60480 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2fb044fc-95ac-4d85-924d-6152b0d88de4 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:39 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-7a6f6749-fbd7-499d-bf44-008897ad2f8d tempest-CreateVolumesFromSnapshotTest-1648007070 None] Volume volume-e9ac7485-159b-4c52-8b79-ef8aef31ded6 (e9ac7485-159b-4c52-8b79-ef8aef31ded6): created successfully Jul 30 17:10:39 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7a6f6749-fbd7-499d-bf44-008897ad2f8d tempest-CreateVolumesFromSnapshotTest-1648007070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bf4770e-6dce-4fac-92b9-cc2a525d2553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:39 devstack sudo[108022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2fb044fc-95ac-4d85-924d-6152b0d88de4 Jul 30 17:10:39 devstack sudo[108022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:39 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7a6f6749-fbd7-499d-bf44-008897ad2f8d tempest-CreateVolumesFromSnapshotTest-1648007070 None] Flow 'volume_create_manager' (af392cc0-f1f1-4b2b-bda8-71231ce5342c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:10:39 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-7a6f6749-fbd7-499d-bf44-008897ad2f8d tempest-CreateVolumesFromSnapshotTest-1648007070 None] Created volume successfully. Jul 30 17:10:39 devstack sudo[108014]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:39 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-338fe864-d706-4801-af31-89b1e92b9334 tempest-VolumeImageDependencyTests-418620943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.325s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:39 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-338fe864-d706-4801-af31-89b1e92b9334 tempest-VolumeImageDependencyTests-418620943 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:10:39 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-338fe864-d706-4801-af31-89b1e92b9334 tempest-VolumeImageDependencyTests-418620943 None] Deleted volume successfully. Jul 30 17:10:39 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-338fe864-d706-4801-af31-89b1e92b9334 tempest-VolumeImageDependencyTests-418620943 None] Lock "cinder-01919c96-7ba3-4802-b03f-00413ce0183d-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:39 devstack sudo[108016]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:39 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-aaad4dd1-7541-424a-a0b4-f6f4f6bd4cf6 tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.286s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:39 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-aaad4dd1-7541-424a-a0b4-f6f4f6bd4cf6 tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:10:39 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-aaad4dd1-7541-424a-a0b4-f6f4f6bd4cf6 tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] Deleted volume successfully. Jul 30 17:10:39 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-aaad4dd1-7541-424a-a0b4-f6f4f6bd4cf6 tempest-VolumeAndVolumeTypeFromImageTest-2144835737 None] Lock "cinder-98f74670-d5eb-4e3b-93fd-f27f66792f4e-delete_volume" released by "delete_volume" :: held 1.727s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:39 devstack sudo[108022]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:39 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-c3c1bc5a-38c3-4ee7-98aa-76bb1fa60480 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2fb044fc-95ac-4d85-924d-6152b0d88de4" returned: 0 in 0.263s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:39 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-c3c1bc5a-38c3-4ee7-98aa-76bb1fa60480 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Lock "cinder-quobyte-2fb044fc-95ac-4d85-924d-6152b0d88de4" released by "delete_volume" :: held 0.739s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:39 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-c3c1bc5a-38c3-4ee7-98aa-76bb1fa60480 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Created reservations ['f551297a-29c6-46f3-8a80-cfc9515af710', '8cca97b8-15a2-477e-a26b-1518b61e740a', 'a92a3861-56cb-422c-ab85-2e9833334fe1', 'a2156672-9fd2-4ca5-b95f-3ce016a63d3e'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:10:39 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-c3c1bc5a-38c3-4ee7-98aa-76bb1fa60480 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:39 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-c3c1bc5a-38c3-4ee7-98aa-76bb1fa60480 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:39 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-c3c1bc5a-38c3-4ee7-98aa-76bb1fa60480 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:10:39 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-c3c1bc5a-38c3-4ee7-98aa-76bb1fa60480 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:10:39 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-c3c1bc5a-38c3-4ee7-98aa-76bb1fa60480 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:39 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-c3c1bc5a-38c3-4ee7-98aa-76bb1fa60480 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:39 devstack sudo[108061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:10:39 devstack sudo[108061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:40 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-3fec4743-9a13-456c-a16e-3b3d7366d078 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Acquiring lock "cinder-e9ac7485-159b-4c52-8b79-ef8aef31ded6-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:40 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-3fec4743-9a13-456c-a16e-3b3d7366d078 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Lock "cinder-e9ac7485-159b-4c52-8b79-ef8aef31ded6-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:40 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-76fac060-551f-4128-9c01-60f2e45e2d18 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Acquiring lock "cinder-4398da83-d143-4062-bbba-12e2e73596b3-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:40 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-76fac060-551f-4128-9c01-60f2e45e2d18 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Lock "cinder-4398da83-d143-4062-bbba-12e2e73596b3-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:40 devstack sudo[108061]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:40 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-3fec4743-9a13-456c-a16e-3b3d7366d078 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Acquiring lock "cinder-quobyte-e9ac7485-159b-4c52-8b79-ef8aef31ded6" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:40 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-c3c1bc5a-38c3-4ee7-98aa-76bb1fa60480 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.380s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:40 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-c3c1bc5a-38c3-4ee7-98aa-76bb1fa60480 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:10:40 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-c3c1bc5a-38c3-4ee7-98aa-76bb1fa60480 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Deleted volume successfully. Jul 30 17:10:40 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-76fac060-551f-4128-9c01-60f2e45e2d18 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Acquiring lock "cinder-quobyte-4398da83-d143-4062-bbba-12e2e73596b3" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:40 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-3fec4743-9a13-456c-a16e-3b3d7366d078 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Lock "cinder-quobyte-e9ac7485-159b-4c52-8b79-ef8aef31ded6" acquired by "delete_volume" :: waited 0.048s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:40 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-c3c1bc5a-38c3-4ee7-98aa-76bb1fa60480 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Lock "cinder-2fb044fc-95ac-4d85-924d-6152b0d88de4-delete_volume" released by "delete_volume" :: held 1.400s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:40 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-76fac060-551f-4128-9c01-60f2e45e2d18 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Lock "cinder-quobyte-4398da83-d143-4062-bbba-12e2e73596b3" acquired by "delete_volume" :: waited 0.043s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:40 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[167f8d97-33f6-4cf7-87c7-0a2a969bafa7]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:10:40 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-3fec4743-9a13-456c-a16e-3b3d7366d078 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e9ac7485-159b-4c52-8b79-ef8aef31ded6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:40 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb0a8f98-9bd3-4bcf-8afb-0c37c177fced]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:10:40 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-76fac060-551f-4128-9c01-60f2e45e2d18 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4398da83-d143-4062-bbba-12e2e73596b3 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:40 devstack sudo[108066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e9ac7485-159b-4c52-8b79-ef8aef31ded6 Jul 30 17:10:40 devstack sudo[108066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:40 devstack sudo[108067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4398da83-d143-4062-bbba-12e2e73596b3 Jul 30 17:10:40 devstack sudo[108067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:40 devstack sudo[108066]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:40 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-3fec4743-9a13-456c-a16e-3b3d7366d078 tempest-CreateVolumesFromSnapshotTest-1648007070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e9ac7485-159b-4c52-8b79-ef8aef31ded6" returned: 0 in 0.448s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:40 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-3fec4743-9a13-456c-a16e-3b3d7366d078 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e9ac7485-159b-4c52-8b79-ef8aef31ded6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:40 devstack sudo[108074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e9ac7485-159b-4c52-8b79-ef8aef31ded6 Jul 30 17:10:40 devstack sudo[108074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:40 devstack sudo[108067]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:40 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-76fac060-551f-4128-9c01-60f2e45e2d18 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4398da83-d143-4062-bbba-12e2e73596b3" returned: 0 in 0.550s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:40 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-76fac060-551f-4128-9c01-60f2e45e2d18 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4398da83-d143-4062-bbba-12e2e73596b3 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:40 devstack sudo[108078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4398da83-d143-4062-bbba-12e2e73596b3 Jul 30 17:10:40 devstack sudo[108078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:41 devstack sudo[108074]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:41 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-3fec4743-9a13-456c-a16e-3b3d7366d078 tempest-CreateVolumesFromSnapshotTest-1648007070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e9ac7485-159b-4c52-8b79-ef8aef31ded6" returned: 0 in 0.312s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:41 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-3fec4743-9a13-456c-a16e-3b3d7366d078 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Lock "cinder-quobyte-e9ac7485-159b-4c52-8b79-ef8aef31ded6" released by "delete_volume" :: held 0.852s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:41 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-3fec4743-9a13-456c-a16e-3b3d7366d078 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Created reservations ['3904499f-d3cf-46df-a7d4-f651c6cd4802', '20f424ae-97d8-42b6-bf06-c7014124317a', '53233252-3009-45a5-9adc-f901e8a67d89', '2228f297-057e-41c8-907d-a1cb99d00c36'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:10:41 devstack sudo[108078]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:41 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-76fac060-551f-4128-9c01-60f2e45e2d18 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4398da83-d143-4062-bbba-12e2e73596b3" returned: 0 in 0.315s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:41 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-76fac060-551f-4128-9c01-60f2e45e2d18 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Lock "cinder-quobyte-4398da83-d143-4062-bbba-12e2e73596b3" released by "delete_volume" :: held 0.931s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:41 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-3fec4743-9a13-456c-a16e-3b3d7366d078 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:41 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-3fec4743-9a13-456c-a16e-3b3d7366d078 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:41 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-3fec4743-9a13-456c-a16e-3b3d7366d078 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:10:41 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-3fec4743-9a13-456c-a16e-3b3d7366d078 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:10:41 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-3fec4743-9a13-456c-a16e-3b3d7366d078 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:41 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-3fec4743-9a13-456c-a16e-3b3d7366d078 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:41 devstack sudo[108082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:10:41 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-76fac060-551f-4128-9c01-60f2e45e2d18 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Created reservations ['d0792091-548f-46e4-b5fc-3ff69e25e182', '03252d22-c7bb-484a-a578-e171e1e6f85a', '15c3e933-f90d-4030-aee5-cf232b5ec20b', '8610b971-399b-49c8-aa26-b966cca2c8e8'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:10:41 devstack sudo[108082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:41 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-76fac060-551f-4128-9c01-60f2e45e2d18 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:41 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-76fac060-551f-4128-9c01-60f2e45e2d18 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:41 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-76fac060-551f-4128-9c01-60f2e45e2d18 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:10:41 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-76fac060-551f-4128-9c01-60f2e45e2d18 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:10:41 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-76fac060-551f-4128-9c01-60f2e45e2d18 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:41 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-76fac060-551f-4128-9c01-60f2e45e2d18 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:41 devstack sudo[108084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:10:41 devstack sudo[108084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:41 devstack sudo[108082]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:41 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-3fec4743-9a13-456c-a16e-3b3d7366d078 tempest-CreateVolumesFromSnapshotTest-1648007070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.311s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:41 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-3fec4743-9a13-456c-a16e-3b3d7366d078 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:10:41 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-3fec4743-9a13-456c-a16e-3b3d7366d078 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Deleted volume successfully. Jul 30 17:10:41 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-3fec4743-9a13-456c-a16e-3b3d7366d078 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Lock "cinder-e9ac7485-159b-4c52-8b79-ef8aef31ded6-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:41 devstack sudo[108084]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:41 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-76fac060-551f-4128-9c01-60f2e45e2d18 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.309s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:41 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-76fac060-551f-4128-9c01-60f2e45e2d18 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:10:41 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-76fac060-551f-4128-9c01-60f2e45e2d18 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Deleted volume successfully. Jul 30 17:10:41 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-76fac060-551f-4128-9c01-60f2e45e2d18 tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Lock "cinder-4398da83-d143-4062-bbba-12e2e73596b3-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:42 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-21308d58-65ec-4004-a820-172c141a1d98 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Acquiring lock "cinder-9c833f06-8e80-41bb-b4fd-a85f517c5c9a-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:42 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-21308d58-65ec-4004-a820-172c141a1d98 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Lock "cinder-9c833f06-8e80-41bb-b4fd-a85f517c5c9a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:42 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-21308d58-65ec-4004-a820-172c141a1d98 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Acquiring lock "cinder-quobyte-9c833f06-8e80-41bb-b4fd-a85f517c5c9a" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:42 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-21308d58-65ec-4004-a820-172c141a1d98 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Lock "cinder-quobyte-9c833f06-8e80-41bb-b4fd-a85f517c5c9a" acquired by "delete_volume" :: waited 0.018s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:42 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-d69d8d41-c711-401e-a710-e38c642faa4f tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Acquiring lock "cinder-c6f5647c-201c-4e7f-9044-c4cce0fb1ead-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:42 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a0d28e-de16-41fd-9f81-4e23fe57263b]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:10:42 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-21308d58-65ec-4004-a820-172c141a1d98 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9c833f06-8e80-41bb-b4fd-a85f517c5c9a {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:42 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-d69d8d41-c711-401e-a710-e38c642faa4f tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Lock "cinder-c6f5647c-201c-4e7f-9044-c4cce0fb1ead-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:42 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-d69d8d41-c711-401e-a710-e38c642faa4f tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Acquiring lock "cinder-quobyte-c6f5647c-201c-4e7f-9044-c4cce0fb1ead" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:42 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-d69d8d41-c711-401e-a710-e38c642faa4f tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Lock "cinder-quobyte-c6f5647c-201c-4e7f-9044-c4cce0fb1ead" acquired by "delete_volume" :: waited 0.018s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:42 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f242df-c24d-4a38-add8-48343e12aff9]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:10:42 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d69d8d41-c711-401e-a710-e38c642faa4f tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c6f5647c-201c-4e7f-9044-c4cce0fb1ead {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:42 devstack sudo[108089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9c833f06-8e80-41bb-b4fd-a85f517c5c9a Jul 30 17:10:42 devstack sudo[108089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:42 devstack sudo[108090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c6f5647c-201c-4e7f-9044-c4cce0fb1ead Jul 30 17:10:42 devstack sudo[108090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:43 devstack sudo[108089]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:43 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-21308d58-65ec-4004-a820-172c141a1d98 tempest-CreateVolumesFromSnapshotTest-1648007070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9c833f06-8e80-41bb-b4fd-a85f517c5c9a" returned: 0 in 0.465s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:43 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-21308d58-65ec-4004-a820-172c141a1d98 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9c833f06-8e80-41bb-b4fd-a85f517c5c9a {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:43 devstack sudo[108096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9c833f06-8e80-41bb-b4fd-a85f517c5c9a Jul 30 17:10:43 devstack sudo[108096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:43 devstack sudo[108090]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:43 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d69d8d41-c711-401e-a710-e38c642faa4f tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c6f5647c-201c-4e7f-9044-c4cce0fb1ead" returned: 0 in 0.512s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:43 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d69d8d41-c711-401e-a710-e38c642faa4f tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c6f5647c-201c-4e7f-9044-c4cce0fb1ead {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:43 devstack sudo[108101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c6f5647c-201c-4e7f-9044-c4cce0fb1ead Jul 30 17:10:43 devstack sudo[108101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:43 devstack sudo[108096]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:43 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-21308d58-65ec-4004-a820-172c141a1d98 tempest-CreateVolumesFromSnapshotTest-1648007070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9c833f06-8e80-41bb-b4fd-a85f517c5c9a" returned: 0 in 0.362s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:43 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-21308d58-65ec-4004-a820-172c141a1d98 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Lock "cinder-quobyte-9c833f06-8e80-41bb-b4fd-a85f517c5c9a" released by "delete_volume" :: held 0.893s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:43 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-21308d58-65ec-4004-a820-172c141a1d98 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Created reservations ['e8470abf-3c80-4a6f-b422-5b5fe45e6e62', '84413fd0-816e-4c9e-bd0c-c08d6f3f2054', 'f98b1ffc-41b9-4621-8ed1-728b0857eb37', '73785f84-5fc3-4738-983b-229ddd260af5'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:10:43 devstack sudo[108101]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:43 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d69d8d41-c711-401e-a710-e38c642faa4f tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c6f5647c-201c-4e7f-9044-c4cce0fb1ead" returned: 0 in 0.328s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:43 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-d69d8d41-c711-401e-a710-e38c642faa4f tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Lock "cinder-quobyte-c6f5647c-201c-4e7f-9044-c4cce0fb1ead" released by "delete_volume" :: held 0.897s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:43 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-21308d58-65ec-4004-a820-172c141a1d98 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:43 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-21308d58-65ec-4004-a820-172c141a1d98 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:43 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-21308d58-65ec-4004-a820-172c141a1d98 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:10:43 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-21308d58-65ec-4004-a820-172c141a1d98 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:10:43 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-21308d58-65ec-4004-a820-172c141a1d98 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:43 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-21308d58-65ec-4004-a820-172c141a1d98 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:43 devstack sudo[108105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:10:43 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-d69d8d41-c711-401e-a710-e38c642faa4f tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Created reservations ['0bf21210-4583-43dd-ac27-f84753a39ef6', 'cc22e4e8-c28a-4d3a-96cd-814c063ab3ed', '80af404c-f4fb-4103-b143-ee5e2adde49a', '3dc376be-9df2-4206-98f9-1565d7733d27'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:10:43 devstack sudo[108105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:43 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-d69d8d41-c711-401e-a710-e38c642faa4f tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:43 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-d69d8d41-c711-401e-a710-e38c642faa4f tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:43 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-d69d8d41-c711-401e-a710-e38c642faa4f tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:10:43 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-d69d8d41-c711-401e-a710-e38c642faa4f tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:10:43 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-d69d8d41-c711-401e-a710-e38c642faa4f tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:43 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d69d8d41-c711-401e-a710-e38c642faa4f tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:43 devstack sudo[108107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:10:43 devstack sudo[108107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:43 devstack sudo[108105]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:43 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-21308d58-65ec-4004-a820-172c141a1d98 tempest-CreateVolumesFromSnapshotTest-1648007070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.346s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:43 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-21308d58-65ec-4004-a820-172c141a1d98 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:10:43 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-21308d58-65ec-4004-a820-172c141a1d98 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Deleted volume successfully. Jul 30 17:10:44 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-21308d58-65ec-4004-a820-172c141a1d98 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Lock "cinder-9c833f06-8e80-41bb-b4fd-a85f517c5c9a-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:44 devstack sudo[108107]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:44 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d69d8d41-c711-401e-a710-e38c642faa4f tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.366s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:44 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-d69d8d41-c711-401e-a710-e38c642faa4f tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:10:44 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-d69d8d41-c711-401e-a710-e38c642faa4f tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Deleted volume successfully. Jul 30 17:10:44 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-d69d8d41-c711-401e-a710-e38c642faa4f tempest-CreateVolumesFromSourceVolumeTest-1149256984 None] Lock "cinder-c6f5647c-201c-4e7f-9044-c4cce0fb1ead-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:44 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-f011c2d0-b844-4f41-992d-2a5d1a29efb7 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Acquiring lock "cinder-54136732-049a-449c-baba-81d5c8de3240-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:44 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-f011c2d0-b844-4f41-992d-2a5d1a29efb7 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Lock "cinder-54136732-049a-449c-baba-81d5c8de3240-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:44 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-f011c2d0-b844-4f41-992d-2a5d1a29efb7 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Acquiring lock "cinder-quobyte-54136732-049a-449c-baba-81d5c8de3240" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:44 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-f011c2d0-b844-4f41-992d-2a5d1a29efb7 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Lock "cinder-quobyte-54136732-049a-449c-baba-81d5c8de3240" acquired by "delete_volume" :: waited 0.021s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:44 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d5e3ec-d3c7-468d-85b7-4a8e6460c0b5]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:10:44 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f011c2d0-b844-4f41-992d-2a5d1a29efb7 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-54136732-049a-449c-baba-81d5c8de3240 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:45 devstack sudo[108111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-54136732-049a-449c-baba-81d5c8de3240 Jul 30 17:10:45 devstack sudo[108111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:45 devstack sudo[108111]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:45 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f011c2d0-b844-4f41-992d-2a5d1a29efb7 tempest-CreateVolumesFromSnapshotTest-1648007070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-54136732-049a-449c-baba-81d5c8de3240" returned: 0 in 0.425s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:45 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f011c2d0-b844-4f41-992d-2a5d1a29efb7 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-54136732-049a-449c-baba-81d5c8de3240 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:45 devstack sudo[108117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-54136732-049a-449c-baba-81d5c8de3240 Jul 30 17:10:45 devstack sudo[108117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:45 devstack sudo[108117]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:45 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f011c2d0-b844-4f41-992d-2a5d1a29efb7 tempest-CreateVolumesFromSnapshotTest-1648007070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-54136732-049a-449c-baba-81d5c8de3240" returned: 0 in 0.293s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:45 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-f011c2d0-b844-4f41-992d-2a5d1a29efb7 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Lock "cinder-quobyte-54136732-049a-449c-baba-81d5c8de3240" released by "delete_volume" :: held 0.775s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:45 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-f011c2d0-b844-4f41-992d-2a5d1a29efb7 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Created reservations ['6263b312-2c24-4d85-a84f-f60d86bb94de', 'ab04b251-cc3e-4e9b-8cae-f7315f9b092a', 'ca8cb90a-a4bd-42e0-8737-aeebb6aa7271', '6a8c7584-596a-4ee1-a968-582fce2045a1'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:10:45 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-f011c2d0-b844-4f41-992d-2a5d1a29efb7 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:45 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-f011c2d0-b844-4f41-992d-2a5d1a29efb7 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:45 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-f011c2d0-b844-4f41-992d-2a5d1a29efb7 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:10:45 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-f011c2d0-b844-4f41-992d-2a5d1a29efb7 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:10:45 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-f011c2d0-b844-4f41-992d-2a5d1a29efb7 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:45 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f011c2d0-b844-4f41-992d-2a5d1a29efb7 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:45 devstack sudo[108120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:10:45 devstack sudo[108120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:45 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-9d05923f-a871-4c1c-b915-adce70bf4e09 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Acquiring lock "cinder-bb66a854-0389-4789-823f-3350614a6726-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:45 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-9d05923f-a871-4c1c-b915-adce70bf4e09 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Lock "cinder-bb66a854-0389-4789-823f-3350614a6726-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:46 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-9d05923f-a871-4c1c-b915-adce70bf4e09 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Acquiring lock "cinder-quobyte-bb66a854-0389-4789-823f-3350614a6726" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:46 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-9d05923f-a871-4c1c-b915-adce70bf4e09 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Lock "cinder-quobyte-bb66a854-0389-4789-823f-3350614a6726" acquired by "delete_volume" :: waited 0.027s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:46 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef05b045-b74f-4e17-8efd-19097a29d09b]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:10:46 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9d05923f-a871-4c1c-b915-adce70bf4e09 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bb66a854-0389-4789-823f-3350614a6726 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:46 devstack sudo[108120]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:46 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f011c2d0-b844-4f41-992d-2a5d1a29efb7 tempest-CreateVolumesFromSnapshotTest-1648007070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.366s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:46 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-f011c2d0-b844-4f41-992d-2a5d1a29efb7 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:10:46 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-f011c2d0-b844-4f41-992d-2a5d1a29efb7 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Deleted volume successfully. Jul 30 17:10:46 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-f011c2d0-b844-4f41-992d-2a5d1a29efb7 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Lock "cinder-54136732-049a-449c-baba-81d5c8de3240-delete_volume" released by "delete_volume" :: held 1.496s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:46 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-fddd01eb-2d04-4602-8f22-953d34d55e4f tempest-CreateVolumesFromImageTest-661222144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:10:46 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fddd01eb-2d04-4602-8f22-953d34d55e4f tempest-CreateVolumesFromImageTest-661222144 None] Flow 'volume_create_manager' (4b367208-1df9-42e3-ae3a-66582ee2817c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:10:46 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fddd01eb-2d04-4602-8f22-953d34d55e4f tempest-CreateVolumesFromImageTest-661222144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70861bfd-58bc-4d52-8098-d80cdea48542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:46 devstack sudo[108123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bb66a854-0389-4789-823f-3350614a6726 Jul 30 17:10:46 devstack sudo[108123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:46 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fddd01eb-2d04-4602-8f22-953d34d55e4f tempest-CreateVolumesFromImageTest-661222144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70861bfd-58bc-4d52-8098-d80cdea48542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:10:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1175898021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=042b7cdc-d0d5-49cc-8042-dd03d28d31cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5bc3a9c71174afba6b4e4a85722b815',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:10:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:10:46Z,use_quota=True,user_id='733c1c51f3dc4d0ea885e1cc38c1eb11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:46 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fddd01eb-2d04-4602-8f22-953d34d55e4f tempest-CreateVolumesFromImageTest-661222144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df839411-819f-441f-b7a1-b4df0be82e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:46 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fddd01eb-2d04-4602-8f22-953d34d55e4f tempest-CreateVolumesFromImageTest-661222144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df839411-819f-441f-b7a1-b4df0be82e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:46 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fddd01eb-2d04-4602-8f22-953d34d55e4f tempest-CreateVolumesFromImageTest-661222144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c4e2f22-19c0-4842-b653-97a75c0ad254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:46 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fddd01eb-2d04-4602-8f22-953d34d55e4f tempest-CreateVolumesFromImageTest-661222144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c4e2f22-19c0-4842-b653-97a75c0ad254) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '042b7cdc-d0d5-49cc-8042-dd03d28d31cb', 'volume_name': 'volume-042b7cdc-d0d5-49cc-8042-dd03d28d31cb', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:46 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fddd01eb-2d04-4602-8f22-953d34d55e4f tempest-CreateVolumesFromImageTest-661222144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cefe0c2-104b-453c-8277-4ad11166bc0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:46 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fddd01eb-2d04-4602-8f22-953d34d55e4f tempest-CreateVolumesFromImageTest-661222144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cefe0c2-104b-453c-8277-4ad11166bc0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:46 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fddd01eb-2d04-4602-8f22-953d34d55e4f tempest-CreateVolumesFromImageTest-661222144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94ce89a5-fb99-42fa-bf0c-2dd7595798f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:46 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-fddd01eb-2d04-4602-8f22-953d34d55e4f tempest-CreateVolumesFromImageTest-661222144 None] Volume 042b7cdc-d0d5-49cc-8042-dd03d28d31cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-042b7cdc-d0d5-49cc-8042-dd03d28d31cb', 'volume_size': 1} Jul 30 17:10:46 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-fddd01eb-2d04-4602-8f22-953d34d55e4f tempest-CreateVolumesFromImageTest-661222144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:46 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-fddd01eb-2d04-4602-8f22-953d34d55e4f tempest-CreateVolumesFromImageTest-661222144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:46 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-fddd01eb-2d04-4602-8f22-953d34d55e4f tempest-CreateVolumesFromImageTest-661222144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:10:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1175898021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=042b7cdc-d0d5-49cc-8042-dd03d28d31cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5bc3a9c71174afba6b4e4a85722b815',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:10:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:10:46Z,use_quota=True,user_id='733c1c51f3dc4d0ea885e1cc38c1eb11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:10:46 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-fddd01eb-2d04-4602-8f22-953d34d55e4f tempest-CreateVolumesFromImageTest-661222144 None] Creating volume 042b7cdc-d0d5-49cc-8042-dd03d28d31cb {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:10:46 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-fddd01eb-2d04-4602-8f22-953d34d55e4f tempest-CreateVolumesFromImageTest-661222144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:46 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-fddd01eb-2d04-4602-8f22-953d34d55e4f tempest-CreateVolumesFromImageTest-661222144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:46 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-fddd01eb-2d04-4602-8f22-953d34d55e4f tempest-CreateVolumesFromImageTest-661222144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:10:46 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-fddd01eb-2d04-4602-8f22-953d34d55e4f tempest-CreateVolumesFromImageTest-661222144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:10:46 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-fddd01eb-2d04-4602-8f22-953d34d55e4f tempest-CreateVolumesFromImageTest-661222144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:46 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-fddd01eb-2d04-4602-8f22-953d34d55e4f tempest-CreateVolumesFromImageTest-661222144 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:10:46 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-fddd01eb-2d04-4602-8f22-953d34d55e4f tempest-CreateVolumesFromImageTest-661222144 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:10:46 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fddd01eb-2d04-4602-8f22-953d34d55e4f tempest-CreateVolumesFromImageTest-661222144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-042b7cdc-d0d5-49cc-8042-dd03d28d31cb 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:46 devstack sudo[108125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-042b7cdc-d0d5-49cc-8042-dd03d28d31cb 1073741824 Jul 30 17:10:46 devstack sudo[108125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:46 devstack sudo[108123]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:46 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9d05923f-a871-4c1c-b915-adce70bf4e09 tempest-CreateVolumesFromSnapshotTest-1648007070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bb66a854-0389-4789-823f-3350614a6726" returned: 0 in 0.640s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:46 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9d05923f-a871-4c1c-b915-adce70bf4e09 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bb66a854-0389-4789-823f-3350614a6726 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:46 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-999ddb18-4d7c-4aa7-8f7a-faa8b1e50ab4 tempest-CreateVolumesFromImageTest-661222144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:10:46 devstack sudo[108130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bb66a854-0389-4789-823f-3350614a6726 Jul 30 17:10:46 devstack sudo[108130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:46 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-999ddb18-4d7c-4aa7-8f7a-faa8b1e50ab4 tempest-CreateVolumesFromImageTest-661222144 None] Flow 'volume_create_manager' (3bfcedd3-8354-4609-8897-3f8817bf53aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:10:46 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-999ddb18-4d7c-4aa7-8f7a-faa8b1e50ab4 tempest-CreateVolumesFromImageTest-661222144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3cebd2e-7e48-490b-bab3-95d08c5428fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:46 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-999ddb18-4d7c-4aa7-8f7a-faa8b1e50ab4 tempest-CreateVolumesFromImageTest-661222144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3cebd2e-7e48-490b-bab3-95d08c5428fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:10:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1991916306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f346bfc4-3baa-4e08-b83f-8ac445af2d84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5bc3a9c71174afba6b4e4a85722b815',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:10:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:10:47Z,use_quota=True,user_id='733c1c51f3dc4d0ea885e1cc38c1eb11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:46 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-999ddb18-4d7c-4aa7-8f7a-faa8b1e50ab4 tempest-CreateVolumesFromImageTest-661222144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d91156db-d632-49aa-9041-3e9f99bfd608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:46 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-999ddb18-4d7c-4aa7-8f7a-faa8b1e50ab4 tempest-CreateVolumesFromImageTest-661222144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d91156db-d632-49aa-9041-3e9f99bfd608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:46 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-999ddb18-4d7c-4aa7-8f7a-faa8b1e50ab4 tempest-CreateVolumesFromImageTest-661222144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (504ff4a0-d330-4ad0-85fd-67c676181c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:46 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-999ddb18-4d7c-4aa7-8f7a-faa8b1e50ab4 tempest-CreateVolumesFromImageTest-661222144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (504ff4a0-d330-4ad0-85fd-67c676181c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f346bfc4-3baa-4e08-b83f-8ac445af2d84', 'volume_name': 'volume-f346bfc4-3baa-4e08-b83f-8ac445af2d84', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:46 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-999ddb18-4d7c-4aa7-8f7a-faa8b1e50ab4 tempest-CreateVolumesFromImageTest-661222144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e468564e-f878-49eb-8630-ca4eb777d381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:46 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-999ddb18-4d7c-4aa7-8f7a-faa8b1e50ab4 tempest-CreateVolumesFromImageTest-661222144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e468564e-f878-49eb-8630-ca4eb777d381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:46 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-999ddb18-4d7c-4aa7-8f7a-faa8b1e50ab4 tempest-CreateVolumesFromImageTest-661222144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3ce962c-78e4-4c99-a6b8-b8db70506133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:46 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-999ddb18-4d7c-4aa7-8f7a-faa8b1e50ab4 tempest-CreateVolumesFromImageTest-661222144 None] Volume f346bfc4-3baa-4e08-b83f-8ac445af2d84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f346bfc4-3baa-4e08-b83f-8ac445af2d84', 'volume_size': 1} Jul 30 17:10:46 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-999ddb18-4d7c-4aa7-8f7a-faa8b1e50ab4 tempest-CreateVolumesFromImageTest-661222144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:47 devstack sudo[108125]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fddd01eb-2d04-4602-8f22-953d34d55e4f tempest-CreateVolumesFromImageTest-661222144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-042b7cdc-d0d5-49cc-8042-dd03d28d31cb 1073741824" returned: 0 in 0.856s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:47 devstack sudo[108130]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:47 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-1aa4d753-746e-4335-8a8e-e02d594b9418 tempest-CreateVolumesFromImageTest-661222144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:10:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1aa4d753-746e-4335-8a8e-e02d594b9418 tempest-CreateVolumesFromImageTest-661222144 None] Flow 'volume_create_manager' (ab91dd2e-ef5d-47c7-a5dd-17e50ad9f795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:10:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1aa4d753-746e-4335-8a8e-e02d594b9418 tempest-CreateVolumesFromImageTest-661222144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7db8c578-038b-48e2-864c-22fbffa76b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9d05923f-a871-4c1c-b915-adce70bf4e09 tempest-CreateVolumesFromSnapshotTest-1648007070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-bb66a854-0389-4789-823f-3350614a6726" returned: 0 in 0.568s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1aa4d753-746e-4335-8a8e-e02d594b9418 tempest-CreateVolumesFromImageTest-661222144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7db8c578-038b-48e2-864c-22fbffa76b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:10:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-784730190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e51486e9-5713-45da-81d0-fd4adc681793,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5bc3a9c71174afba6b4e4a85722b815',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:10:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:10:47Z,use_quota=True,user_id='733c1c51f3dc4d0ea885e1cc38c1eb11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1aa4d753-746e-4335-8a8e-e02d594b9418 tempest-CreateVolumesFromImageTest-661222144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0514e99-9fed-4ef0-a170-33c6b7fa92d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1aa4d753-746e-4335-8a8e-e02d594b9418 tempest-CreateVolumesFromImageTest-661222144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0514e99-9fed-4ef0-a170-33c6b7fa92d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1aa4d753-746e-4335-8a8e-e02d594b9418 tempest-CreateVolumesFromImageTest-661222144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e968f5a8-3895-45c5-800e-b4381da9b00f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1aa4d753-746e-4335-8a8e-e02d594b9418 tempest-CreateVolumesFromImageTest-661222144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e968f5a8-3895-45c5-800e-b4381da9b00f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e51486e9-5713-45da-81d0-fd4adc681793', 'volume_name': 'volume-e51486e9-5713-45da-81d0-fd4adc681793', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1aa4d753-746e-4335-8a8e-e02d594b9418 tempest-CreateVolumesFromImageTest-661222144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f93fa16-25b1-4611-b553-36416406388d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1aa4d753-746e-4335-8a8e-e02d594b9418 tempest-CreateVolumesFromImageTest-661222144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f93fa16-25b1-4611-b553-36416406388d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1aa4d753-746e-4335-8a8e-e02d594b9418 tempest-CreateVolumesFromImageTest-661222144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecc16496-8881-4ea4-a64f-6c4a6ffab98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:47 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-1aa4d753-746e-4335-8a8e-e02d594b9418 tempest-CreateVolumesFromImageTest-661222144 None] Volume e51486e9-5713-45da-81d0-fd4adc681793: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e51486e9-5713-45da-81d0-fd4adc681793', 'volume_size': 1} Jul 30 17:10:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-1aa4d753-746e-4335-8a8e-e02d594b9418 tempest-CreateVolumesFromImageTest-661222144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:47 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-9d05923f-a871-4c1c-b915-adce70bf4e09 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Lock "cinder-quobyte-bb66a854-0389-4789-823f-3350614a6726" released by "delete_volume" :: held 1.342s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fddd01eb-2d04-4602-8f22-953d34d55e4f tempest-CreateVolumesFromImageTest-661222144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-042b7cdc-d0d5-49cc-8042-dd03d28d31cb {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:47 devstack sudo[108137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-042b7cdc-d0d5-49cc-8042-dd03d28d31cb Jul 30 17:10:47 devstack sudo[108137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:47 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-9d05923f-a871-4c1c-b915-adce70bf4e09 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Created reservations ['2aba4122-d52f-492e-944d-7fe6cd56f7e8', 'f84e0953-593e-4228-a37f-64797a1be513', '3ce3b765-d99b-4401-86c6-f886895926a7', '963e49d7-db88-4680-86d8-bf605bd8c0a1'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:10:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-9d05923f-a871-4c1c-b915-adce70bf4e09 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-9d05923f-a871-4c1c-b915-adce70bf4e09 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:47 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-9d05923f-a871-4c1c-b915-adce70bf4e09 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:10:47 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-9d05923f-a871-4c1c-b915-adce70bf4e09 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:10:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-9d05923f-a871-4c1c-b915-adce70bf4e09 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9d05923f-a871-4c1c-b915-adce70bf4e09 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:47 devstack sudo[108139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:10:47 devstack sudo[108139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:47 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-03ce2a3d-d884-442c-a609-efc6fa43d980 tempest-CreateVolumesFromImageTest-661222144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:10:47 devstack sudo[108137]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-03ce2a3d-d884-442c-a609-efc6fa43d980 tempest-CreateVolumesFromImageTest-661222144 None] Flow 'volume_create_manager' (f8651897-d0bb-4024-9bf6-0d569888af65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:10:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-03ce2a3d-d884-442c-a609-efc6fa43d980 tempest-CreateVolumesFromImageTest-661222144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54802858-91b4-4479-84a2-472299c4eeb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fddd01eb-2d04-4602-8f22-953d34d55e4f tempest-CreateVolumesFromImageTest-661222144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-042b7cdc-d0d5-49cc-8042-dd03d28d31cb" returned: 0 in 0.439s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:47 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-fddd01eb-2d04-4602-8f22-953d34d55e4f tempest-CreateVolumesFromImageTest-661222144 None] <== create_volume: return (1491ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:10:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-fddd01eb-2d04-4602-8f22-953d34d55e4f tempest-CreateVolumesFromImageTest-661222144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.496s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-999ddb18-4d7c-4aa7-8f7a-faa8b1e50ab4 tempest-CreateVolumesFromImageTest-661222144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.928s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:47 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-999ddb18-4d7c-4aa7-8f7a-faa8b1e50ab4 tempest-CreateVolumesFromImageTest-661222144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:10:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1991916306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f346bfc4-3baa-4e08-b83f-8ac445af2d84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5bc3a9c71174afba6b4e4a85722b815',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:10:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:10:47Z,use_quota=True,user_id='733c1c51f3dc4d0ea885e1cc38c1eb11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:10:47 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-999ddb18-4d7c-4aa7-8f7a-faa8b1e50ab4 tempest-CreateVolumesFromImageTest-661222144 None] Creating volume f346bfc4-3baa-4e08-b83f-8ac445af2d84 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:10:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-999ddb18-4d7c-4aa7-8f7a-faa8b1e50ab4 tempest-CreateVolumesFromImageTest-661222144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-999ddb18-4d7c-4aa7-8f7a-faa8b1e50ab4 tempest-CreateVolumesFromImageTest-661222144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:47 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-999ddb18-4d7c-4aa7-8f7a-faa8b1e50ab4 tempest-CreateVolumesFromImageTest-661222144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:10:47 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-999ddb18-4d7c-4aa7-8f7a-faa8b1e50ab4 tempest-CreateVolumesFromImageTest-661222144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:10:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-999ddb18-4d7c-4aa7-8f7a-faa8b1e50ab4 tempest-CreateVolumesFromImageTest-661222144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:47 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-999ddb18-4d7c-4aa7-8f7a-faa8b1e50ab4 tempest-CreateVolumesFromImageTest-661222144 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:10:47 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-999ddb18-4d7c-4aa7-8f7a-faa8b1e50ab4 tempest-CreateVolumesFromImageTest-661222144 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:10:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-999ddb18-4d7c-4aa7-8f7a-faa8b1e50ab4 tempest-CreateVolumesFromImageTest-661222144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f346bfc4-3baa-4e08-b83f-8ac445af2d84 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-03ce2a3d-d884-442c-a609-efc6fa43d980 tempest-CreateVolumesFromImageTest-661222144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54802858-91b4-4479-84a2-472299c4eeb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:10:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1607218137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c6a7417-58d8-45e9-9608-08c5da9c0297,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5bc3a9c71174afba6b4e4a85722b815',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:10:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:10:48Z,use_quota=True,user_id='733c1c51f3dc4d0ea885e1cc38c1eb11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-03ce2a3d-d884-442c-a609-efc6fa43d980 tempest-CreateVolumesFromImageTest-661222144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5967694-e967-4cbb-bfc6-a4e1dd5575e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-03ce2a3d-d884-442c-a609-efc6fa43d980 tempest-CreateVolumesFromImageTest-661222144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5967694-e967-4cbb-bfc6-a4e1dd5575e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-03ce2a3d-d884-442c-a609-efc6fa43d980 tempest-CreateVolumesFromImageTest-661222144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e9ba82c-c0fa-4f54-8e50-46bce86009b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-03ce2a3d-d884-442c-a609-efc6fa43d980 tempest-CreateVolumesFromImageTest-661222144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e9ba82c-c0fa-4f54-8e50-46bce86009b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c6a7417-58d8-45e9-9608-08c5da9c0297', 'volume_name': 'volume-8c6a7417-58d8-45e9-9608-08c5da9c0297', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-03ce2a3d-d884-442c-a609-efc6fa43d980 tempest-CreateVolumesFromImageTest-661222144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7de2e402-efcb-43cd-b9e1-14f53bb02429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:47 devstack sudo[108142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f346bfc4-3baa-4e08-b83f-8ac445af2d84 1073741824 Jul 30 17:10:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-03ce2a3d-d884-442c-a609-efc6fa43d980 tempest-CreateVolumesFromImageTest-661222144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7de2e402-efcb-43cd-b9e1-14f53bb02429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:47 devstack sudo[108142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-03ce2a3d-d884-442c-a609-efc6fa43d980 tempest-CreateVolumesFromImageTest-661222144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f6007a0-18cc-4f00-9385-15705e1c81ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:47 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-03ce2a3d-d884-442c-a609-efc6fa43d980 tempest-CreateVolumesFromImageTest-661222144 None] Volume 8c6a7417-58d8-45e9-9608-08c5da9c0297: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c6a7417-58d8-45e9-9608-08c5da9c0297', 'volume_size': 1} Jul 30 17:10:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-03ce2a3d-d884-442c-a609-efc6fa43d980 tempest-CreateVolumesFromImageTest-661222144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:48 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fddd01eb-2d04-4602-8f22-953d34d55e4f tempest-CreateVolumesFromImageTest-661222144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94ce89a5-fb99-42fa-bf0c-2dd7595798f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-042b7cdc-d0d5-49cc-8042-dd03d28d31cb', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:48 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fddd01eb-2d04-4602-8f22-953d34d55e4f tempest-CreateVolumesFromImageTest-661222144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afd00a06-afc7-4f91-80cb-e9d1bfc8a265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:48 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-fddd01eb-2d04-4602-8f22-953d34d55e4f tempest-CreateVolumesFromImageTest-661222144 None] Volume volume-042b7cdc-d0d5-49cc-8042-dd03d28d31cb (042b7cdc-d0d5-49cc-8042-dd03d28d31cb): created successfully Jul 30 17:10:48 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fddd01eb-2d04-4602-8f22-953d34d55e4f tempest-CreateVolumesFromImageTest-661222144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afd00a06-afc7-4f91-80cb-e9d1bfc8a265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:48 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fddd01eb-2d04-4602-8f22-953d34d55e4f tempest-CreateVolumesFromImageTest-661222144 None] Flow 'volume_create_manager' (4b367208-1df9-42e3-ae3a-66582ee2817c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:10:48 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-fddd01eb-2d04-4602-8f22-953d34d55e4f tempest-CreateVolumesFromImageTest-661222144 None] Created volume successfully. Jul 30 17:10:48 devstack sudo[108139]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:48 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9d05923f-a871-4c1c-b915-adce70bf4e09 tempest-CreateVolumesFromSnapshotTest-1648007070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.547s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:48 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-9d05923f-a871-4c1c-b915-adce70bf4e09 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:10:48 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-9d05923f-a871-4c1c-b915-adce70bf4e09 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Deleted volume successfully. Jul 30 17:10:48 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-9d05923f-a871-4c1c-b915-adce70bf4e09 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Lock "cinder-bb66a854-0389-4789-823f-3350614a6726-delete_volume" released by "delete_volume" :: held 2.340s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:48 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-506b8e2f-e534-4924-9826-0caead1fc2ff tempest-CreateVolumesFromImageTest-661222144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:10:48 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-506b8e2f-e534-4924-9826-0caead1fc2ff tempest-CreateVolumesFromImageTest-661222144 None] Flow 'volume_create_manager' (3e5bf806-57d5-4e26-9cb8-a4d6e7c366b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:10:48 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-506b8e2f-e534-4924-9826-0caead1fc2ff tempest-CreateVolumesFromImageTest-661222144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd4a0be5-cdf1-4869-8f0c-ff0d527c4a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:48 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-506b8e2f-e534-4924-9826-0caead1fc2ff tempest-CreateVolumesFromImageTest-661222144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd4a0be5-cdf1-4869-8f0c-ff0d527c4a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:10:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1122883322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94eea110-4dcd-4346-aed2-84180f622ca4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5bc3a9c71174afba6b4e4a85722b815',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:10:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:10:48Z,use_quota=True,user_id='733c1c51f3dc4d0ea885e1cc38c1eb11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:48 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-506b8e2f-e534-4924-9826-0caead1fc2ff tempest-CreateVolumesFromImageTest-661222144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c48d823d-8f5d-4580-802a-759e554954e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:48 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-506b8e2f-e534-4924-9826-0caead1fc2ff tempest-CreateVolumesFromImageTest-661222144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c48d823d-8f5d-4580-802a-759e554954e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:48 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-506b8e2f-e534-4924-9826-0caead1fc2ff tempest-CreateVolumesFromImageTest-661222144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02066e24-51f2-4e85-aab6-bf3a0690b0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:48 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-506b8e2f-e534-4924-9826-0caead1fc2ff tempest-CreateVolumesFromImageTest-661222144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02066e24-51f2-4e85-aab6-bf3a0690b0ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94eea110-4dcd-4346-aed2-84180f622ca4', 'volume_name': 'volume-94eea110-4dcd-4346-aed2-84180f622ca4', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:48 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-506b8e2f-e534-4924-9826-0caead1fc2ff tempest-CreateVolumesFromImageTest-661222144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ad36ab8-8848-453b-9834-b09590ea435f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:48 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-506b8e2f-e534-4924-9826-0caead1fc2ff tempest-CreateVolumesFromImageTest-661222144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ad36ab8-8848-453b-9834-b09590ea435f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:48 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-506b8e2f-e534-4924-9826-0caead1fc2ff tempest-CreateVolumesFromImageTest-661222144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d782b0f9-fb0f-4bc7-bf04-11fd75280cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:48 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-506b8e2f-e534-4924-9826-0caead1fc2ff tempest-CreateVolumesFromImageTest-661222144 None] Volume 94eea110-4dcd-4346-aed2-84180f622ca4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94eea110-4dcd-4346-aed2-84180f622ca4', 'volume_size': 1} Jul 30 17:10:48 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-506b8e2f-e534-4924-9826-0caead1fc2ff tempest-CreateVolumesFromImageTest-661222144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:48 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-fe8f4728-b686-4190-b4f0-2c0b07413e27 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Acquiring lock "cinder-eff3563b-0160-40d2-81d4-2afdd76f93b2-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:48 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-fe8f4728-b686-4190-b4f0-2c0b07413e27 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Lock "cinder-eff3563b-0160-40d2-81d4-2afdd76f93b2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:48 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-fe8f4728-b686-4190-b4f0-2c0b07413e27 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Acquiring lock "cinder-quobyte-eff3563b-0160-40d2-81d4-2afdd76f93b2" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:48 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-fe8f4728-b686-4190-b4f0-2c0b07413e27 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Lock "cinder-quobyte-eff3563b-0160-40d2-81d4-2afdd76f93b2" acquired by "delete_volume" :: waited 0.019s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:48 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[f583a63e-76da-4a5c-856e-7e102f6d400f]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:10:48 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fe8f4728-b686-4190-b4f0-2c0b07413e27 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-eff3563b-0160-40d2-81d4-2afdd76f93b2 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:48 devstack sudo[108142]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:48 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-999ddb18-4d7c-4aa7-8f7a-faa8b1e50ab4 tempest-CreateVolumesFromImageTest-661222144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f346bfc4-3baa-4e08-b83f-8ac445af2d84 1073741824" returned: 0 in 0.803s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:48 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-999ddb18-4d7c-4aa7-8f7a-faa8b1e50ab4 tempest-CreateVolumesFromImageTest-661222144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f346bfc4-3baa-4e08-b83f-8ac445af2d84 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:48 devstack sudo[108155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-eff3563b-0160-40d2-81d4-2afdd76f93b2 Jul 30 17:10:48 devstack sudo[108155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:48 devstack sudo[108156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f346bfc4-3baa-4e08-b83f-8ac445af2d84 Jul 30 17:10:48 devstack sudo[108156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:49 devstack sudo[108156]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:49 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-999ddb18-4d7c-4aa7-8f7a-faa8b1e50ab4 tempest-CreateVolumesFromImageTest-661222144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f346bfc4-3baa-4e08-b83f-8ac445af2d84" returned: 0 in 0.290s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:49 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-999ddb18-4d7c-4aa7-8f7a-faa8b1e50ab4 tempest-CreateVolumesFromImageTest-661222144 None] <== create_volume: return (1143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:10:49 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-999ddb18-4d7c-4aa7-8f7a-faa8b1e50ab4 tempest-CreateVolumesFromImageTest-661222144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.147s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:49 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-1aa4d753-746e-4335-8a8e-e02d594b9418 tempest-CreateVolumesFromImageTest-661222144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.629s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:49 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-1aa4d753-746e-4335-8a8e-e02d594b9418 tempest-CreateVolumesFromImageTest-661222144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:10:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-784730190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e51486e9-5713-45da-81d0-fd4adc681793,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5bc3a9c71174afba6b4e4a85722b815',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:10:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:10:47Z,use_quota=True,user_id='733c1c51f3dc4d0ea885e1cc38c1eb11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:10:49 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-1aa4d753-746e-4335-8a8e-e02d594b9418 tempest-CreateVolumesFromImageTest-661222144 None] Creating volume e51486e9-5713-45da-81d0-fd4adc681793 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:10:49 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-1aa4d753-746e-4335-8a8e-e02d594b9418 tempest-CreateVolumesFromImageTest-661222144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:49 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-1aa4d753-746e-4335-8a8e-e02d594b9418 tempest-CreateVolumesFromImageTest-661222144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:49 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-1aa4d753-746e-4335-8a8e-e02d594b9418 tempest-CreateVolumesFromImageTest-661222144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:10:49 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-1aa4d753-746e-4335-8a8e-e02d594b9418 tempest-CreateVolumesFromImageTest-661222144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:10:49 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-1aa4d753-746e-4335-8a8e-e02d594b9418 tempest-CreateVolumesFromImageTest-661222144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:49 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-1aa4d753-746e-4335-8a8e-e02d594b9418 tempest-CreateVolumesFromImageTest-661222144 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:10:49 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-1aa4d753-746e-4335-8a8e-e02d594b9418 tempest-CreateVolumesFromImageTest-661222144 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:10:49 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-1aa4d753-746e-4335-8a8e-e02d594b9418 tempest-CreateVolumesFromImageTest-661222144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e51486e9-5713-45da-81d0-fd4adc681793 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:49 devstack sudo[108155]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:49 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fe8f4728-b686-4190-b4f0-2c0b07413e27 tempest-CreateVolumesFromSnapshotTest-1648007070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-eff3563b-0160-40d2-81d4-2afdd76f93b2" returned: 0 in 0.435s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:49 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fe8f4728-b686-4190-b4f0-2c0b07413e27 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-eff3563b-0160-40d2-81d4-2afdd76f93b2 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:49 devstack sudo[108163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e51486e9-5713-45da-81d0-fd4adc681793 1073741824 Jul 30 17:10:49 devstack sudo[108163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:49 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-999ddb18-4d7c-4aa7-8f7a-faa8b1e50ab4 tempest-CreateVolumesFromImageTest-661222144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3ce962c-78e4-4c99-a6b8-b8db70506133) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f346bfc4-3baa-4e08-b83f-8ac445af2d84', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:49 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-999ddb18-4d7c-4aa7-8f7a-faa8b1e50ab4 tempest-CreateVolumesFromImageTest-661222144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60f1969d-3457-4606-aa68-9631a3889b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:49 devstack sudo[108164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-eff3563b-0160-40d2-81d4-2afdd76f93b2 Jul 30 17:10:49 devstack sudo[108164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:49 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-999ddb18-4d7c-4aa7-8f7a-faa8b1e50ab4 tempest-CreateVolumesFromImageTest-661222144 None] Volume volume-f346bfc4-3baa-4e08-b83f-8ac445af2d84 (f346bfc4-3baa-4e08-b83f-8ac445af2d84): created successfully Jul 30 17:10:49 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-999ddb18-4d7c-4aa7-8f7a-faa8b1e50ab4 tempest-CreateVolumesFromImageTest-661222144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60f1969d-3457-4606-aa68-9631a3889b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:49 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-999ddb18-4d7c-4aa7-8f7a-faa8b1e50ab4 tempest-CreateVolumesFromImageTest-661222144 None] Flow 'volume_create_manager' (3bfcedd3-8354-4609-8897-3f8817bf53aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:10:49 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-999ddb18-4d7c-4aa7-8f7a-faa8b1e50ab4 tempest-CreateVolumesFromImageTest-661222144 None] Created volume successfully. Jul 30 17:10:49 devstack sudo[108164]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:49 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fe8f4728-b686-4190-b4f0-2c0b07413e27 tempest-CreateVolumesFromSnapshotTest-1648007070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-eff3563b-0160-40d2-81d4-2afdd76f93b2" returned: 0 in 0.290s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:49 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-fe8f4728-b686-4190-b4f0-2c0b07413e27 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Lock "cinder-quobyte-eff3563b-0160-40d2-81d4-2afdd76f93b2" released by "delete_volume" :: held 0.777s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:49 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-fe8f4728-b686-4190-b4f0-2c0b07413e27 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Created reservations ['0d6f4bb3-9307-4b98-aadc-ee0c19046ada', 'b27bb1ce-32ab-4549-a51c-5072252b6062', '48169e9b-a643-4d89-ab65-59e9f82e097c', '3dca648b-dfe6-48e3-b8f1-ed52865d8e4f'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:10:49 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-42a7da2b-c594-4cc9-baa4-33aa5080d57c tempest-VolumeDependencyTests-33890977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:10:49 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-42a7da2b-c594-4cc9-baa4-33aa5080d57c tempest-VolumeDependencyTests-33890977 None] Flow 'volume_create_manager' (e2d0c634-4e35-49de-b72d-edb5863df2a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:10:49 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-42a7da2b-c594-4cc9-baa4-33aa5080d57c tempest-VolumeDependencyTests-33890977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bd6a296-f9de-4095-881e-7fe72b5bcb5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:49 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-fe8f4728-b686-4190-b4f0-2c0b07413e27 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:49 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-fe8f4728-b686-4190-b4f0-2c0b07413e27 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:49 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-fe8f4728-b686-4190-b4f0-2c0b07413e27 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:10:49 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-fe8f4728-b686-4190-b4f0-2c0b07413e27 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:10:49 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-fe8f4728-b686-4190-b4f0-2c0b07413e27 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:49 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fe8f4728-b686-4190-b4f0-2c0b07413e27 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:49 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-42a7da2b-c594-4cc9-baa4-33aa5080d57c tempest-VolumeDependencyTests-33890977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bd6a296-f9de-4095-881e-7fe72b5bcb5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:10:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1222253912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d08a8f36-1b3e-424a-a39d-24894a89403e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12e0e28ab7d7453ea9d75301f1aa2c90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:10:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:10:49Z,use_quota=True,user_id='edc86705b5bd4a2791ee0338325cbc64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:49 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-42a7da2b-c594-4cc9-baa4-33aa5080d57c tempest-VolumeDependencyTests-33890977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad61af6f-3b0e-4783-8340-a5cd7cdf2be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:49 devstack sudo[108172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:10:49 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-42a7da2b-c594-4cc9-baa4-33aa5080d57c tempest-VolumeDependencyTests-33890977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad61af6f-3b0e-4783-8340-a5cd7cdf2be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:49 devstack sudo[108172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:49 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-42a7da2b-c594-4cc9-baa4-33aa5080d57c tempest-VolumeDependencyTests-33890977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeca6e36-ff66-4969-b9f4-93d55059eb18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:49 devstack sudo[108163]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:49 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-42a7da2b-c594-4cc9-baa4-33aa5080d57c tempest-VolumeDependencyTests-33890977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeca6e36-ff66-4969-b9f4-93d55059eb18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd08a8f36-1b3e-424a-a39d-24894a89403e', 'volume_name': 'volume-d08a8f36-1b3e-424a-a39d-24894a89403e', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:49 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-42a7da2b-c594-4cc9-baa4-33aa5080d57c tempest-VolumeDependencyTests-33890977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4f05595-c094-428a-afdc-f69b434781c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:49 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-42a7da2b-c594-4cc9-baa4-33aa5080d57c tempest-VolumeDependencyTests-33890977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4f05595-c094-428a-afdc-f69b434781c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:49 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-42a7da2b-c594-4cc9-baa4-33aa5080d57c tempest-VolumeDependencyTests-33890977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (949d2f40-a5fb-4413-b934-b120f683982d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:49 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-42a7da2b-c594-4cc9-baa4-33aa5080d57c tempest-VolumeDependencyTests-33890977 None] Volume d08a8f36-1b3e-424a-a39d-24894a89403e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d08a8f36-1b3e-424a-a39d-24894a89403e', 'volume_size': 1} Jul 30 17:10:49 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-42a7da2b-c594-4cc9-baa4-33aa5080d57c tempest-VolumeDependencyTests-33890977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:49 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-2a0b448e-5c3d-42c0-9cc5-44d7605936df tempest-CreateVolumesFromSnapshotTest-1648007070 None] Acquiring lock "cinder-4daaec3f-d8da-46cc-a15f-f8d434f3d0e4-delete_snapshot" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:49 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-1aa4d753-746e-4335-8a8e-e02d594b9418 tempest-CreateVolumesFromImageTest-661222144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e51486e9-5713-45da-81d0-fd4adc681793 1073741824" returned: 0 in 0.657s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:49 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-2a0b448e-5c3d-42c0-9cc5-44d7605936df tempest-CreateVolumesFromSnapshotTest-1648007070 None] Lock "cinder-4daaec3f-d8da-46cc-a15f-f8d434f3d0e4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:49 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-2a0b448e-5c3d-42c0-9cc5-44d7605936df tempest-CreateVolumesFromSnapshotTest-1648007070 None] Acquiring lock "cinder-quobyte-d1d2cd2b-bc4e-4620-8e09-570c268e9240" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:49 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-2a0b448e-5c3d-42c0-9cc5-44d7605936df tempest-CreateVolumesFromSnapshotTest-1648007070 None] Lock "cinder-quobyte-d1d2cd2b-bc4e-4620-8e09-570c268e9240" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:49 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-2a0b448e-5c3d-42c0-9cc5-44d7605936df tempest-CreateVolumesFromSnapshotTest-1648007070 None] Acquiring lock "cinder-quobyte-4daaec3f-d8da-46cc-a15f-f8d434f3d0e4" by "_delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:49 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-1aa4d753-746e-4335-8a8e-e02d594b9418 tempest-CreateVolumesFromImageTest-661222144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e51486e9-5713-45da-81d0-fd4adc681793 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:49 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-2a0b448e-5c3d-42c0-9cc5-44d7605936df tempest-CreateVolumesFromSnapshotTest-1648007070 None] Lock "cinder-quobyte-4daaec3f-d8da-46cc-a15f-f8d434f3d0e4" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:49 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-2a0b448e-5c3d-42c0-9cc5-44d7605936df tempest-CreateVolumesFromSnapshotTest-1648007070 None] Deleting offline snapshot 4daaec3f-d8da-46cc-a15f-f8d434f3d0e4 of volume d1d2cd2b-bc4e-4620-8e09-570c268e9240 {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:10:49 devstack sudo[108174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e51486e9-5713-45da-81d0-fd4adc681793 Jul 30 17:10:49 devstack sudo[108174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:49 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-2a0b448e-5c3d-42c0-9cc5-44d7605936df tempest-CreateVolumesFromSnapshotTest-1648007070 None] snapshot_file for this snap is: volume-d1d2cd2b-bc4e-4620-8e09-570c268e9240.4daaec3f-d8da-46cc-a15f-f8d434f3d0e4 {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:10:49 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[5725c4bd-26f3-4439-935f-97d0dc436ab8]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:10:49 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2a0b448e-5c3d-42c0-9cc5-44d7605936df tempest-CreateVolumesFromSnapshotTest-1648007070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d1d2cd2b-bc4e-4620-8e09-570c268e9240.4daaec3f-d8da-46cc-a15f-f8d434f3d0e4 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:49 devstack sudo[108172]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:49 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fe8f4728-b686-4190-b4f0-2c0b07413e27 tempest-CreateVolumesFromSnapshotTest-1648007070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.363s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:49 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-fe8f4728-b686-4190-b4f0-2c0b07413e27 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:10:49 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-fe8f4728-b686-4190-b4f0-2c0b07413e27 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Deleted volume successfully. Jul 30 17:10:50 devstack sudo[108176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d1d2cd2b-bc4e-4620-8e09-570c268e9240.4daaec3f-d8da-46cc-a15f-f8d434f3d0e4 Jul 30 17:10:50 devstack sudo[108176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:50 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-fe8f4728-b686-4190-b4f0-2c0b07413e27 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Lock "cinder-eff3563b-0160-40d2-81d4-2afdd76f93b2-delete_volume" released by "delete_volume" :: held 1.485s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:50 devstack sudo[108174]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-1aa4d753-746e-4335-8a8e-e02d594b9418 tempest-CreateVolumesFromImageTest-661222144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e51486e9-5713-45da-81d0-fd4adc681793" returned: 0 in 0.310s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:50 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-1aa4d753-746e-4335-8a8e-e02d594b9418 tempest-CreateVolumesFromImageTest-661222144 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:10:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-1aa4d753-746e-4335-8a8e-e02d594b9418 tempest-CreateVolumesFromImageTest-661222144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-03ce2a3d-d884-442c-a609-efc6fa43d980 tempest-CreateVolumesFromImageTest-661222144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.105s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:50 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-03ce2a3d-d884-442c-a609-efc6fa43d980 tempest-CreateVolumesFromImageTest-661222144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:10:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1607218137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c6a7417-58d8-45e9-9608-08c5da9c0297,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5bc3a9c71174afba6b4e4a85722b815',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:10:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:10:48Z,use_quota=True,user_id='733c1c51f3dc4d0ea885e1cc38c1eb11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:10:50 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-03ce2a3d-d884-442c-a609-efc6fa43d980 tempest-CreateVolumesFromImageTest-661222144 None] Creating volume 8c6a7417-58d8-45e9-9608-08c5da9c0297 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:10:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-03ce2a3d-d884-442c-a609-efc6fa43d980 tempest-CreateVolumesFromImageTest-661222144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-03ce2a3d-d884-442c-a609-efc6fa43d980 tempest-CreateVolumesFromImageTest-661222144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:50 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-03ce2a3d-d884-442c-a609-efc6fa43d980 tempest-CreateVolumesFromImageTest-661222144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:10:50 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-03ce2a3d-d884-442c-a609-efc6fa43d980 tempest-CreateVolumesFromImageTest-661222144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:10:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-03ce2a3d-d884-442c-a609-efc6fa43d980 tempest-CreateVolumesFromImageTest-661222144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:50 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-03ce2a3d-d884-442c-a609-efc6fa43d980 tempest-CreateVolumesFromImageTest-661222144 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:10:50 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-03ce2a3d-d884-442c-a609-efc6fa43d980 tempest-CreateVolumesFromImageTest-661222144 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:10:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-03ce2a3d-d884-442c-a609-efc6fa43d980 tempest-CreateVolumesFromImageTest-661222144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8c6a7417-58d8-45e9-9608-08c5da9c0297 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:50 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1aa4d753-746e-4335-8a8e-e02d594b9418 tempest-CreateVolumesFromImageTest-661222144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecc16496-8881-4ea4-a64f-6c4a6ffab98b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e51486e9-5713-45da-81d0-fd4adc681793', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:50 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1aa4d753-746e-4335-8a8e-e02d594b9418 tempest-CreateVolumesFromImageTest-661222144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3ff93f5-902a-4442-800a-bcc01440dd05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:50 devstack sudo[108180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8c6a7417-58d8-45e9-9608-08c5da9c0297 1073741824 Jul 30 17:10:50 devstack sudo[108180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:50 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-1aa4d753-746e-4335-8a8e-e02d594b9418 tempest-CreateVolumesFromImageTest-661222144 None] Volume volume-e51486e9-5713-45da-81d0-fd4adc681793 (e51486e9-5713-45da-81d0-fd4adc681793): created successfully Jul 30 17:10:50 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1aa4d753-746e-4335-8a8e-e02d594b9418 tempest-CreateVolumesFromImageTest-661222144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3ff93f5-902a-4442-800a-bcc01440dd05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:50 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1aa4d753-746e-4335-8a8e-e02d594b9418 tempest-CreateVolumesFromImageTest-661222144 None] Flow 'volume_create_manager' (ab91dd2e-ef5d-47c7-a5dd-17e50ad9f795) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:10:50 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-1aa4d753-746e-4335-8a8e-e02d594b9418 tempest-CreateVolumesFromImageTest-661222144 None] Created volume successfully. Jul 30 17:10:50 devstack sudo[108176]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2a0b448e-5c3d-42c0-9cc5-44d7605936df tempest-CreateVolumesFromSnapshotTest-1648007070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d1d2cd2b-bc4e-4620-8e09-570c268e9240.4daaec3f-d8da-46cc-a15f-f8d434f3d0e4" returned: 0 in 0.464s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:50 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-2a0b448e-5c3d-42c0-9cc5-44d7605936df tempest-CreateVolumesFromSnapshotTest-1648007070 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1d2cd2b-bc4e-4620-8e09-570c268e9240(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:10:50 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1e78bc-7367-4464-bc76-16db551b03c7]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:10:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2a0b448e-5c3d-42c0-9cc5-44d7605936df tempest-CreateVolumesFromSnapshotTest-1648007070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d1d2cd2b-bc4e-4620-8e09-570c268e9240 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:50 devstack sudo[108188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d1d2cd2b-bc4e-4620-8e09-570c268e9240 Jul 30 17:10:50 devstack sudo[108188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:50 devstack sudo[108180]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-03ce2a3d-d884-442c-a609-efc6fa43d980 tempest-CreateVolumesFromImageTest-661222144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8c6a7417-58d8-45e9-9608-08c5da9c0297 1073741824" returned: 0 in 0.589s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-03ce2a3d-d884-442c-a609-efc6fa43d980 tempest-CreateVolumesFromImageTest-661222144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8c6a7417-58d8-45e9-9608-08c5da9c0297 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:50 devstack sudo[108190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8c6a7417-58d8-45e9-9608-08c5da9c0297 Jul 30 17:10:50 devstack sudo[108190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:50 devstack sudo[108188]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2a0b448e-5c3d-42c0-9cc5-44d7605936df tempest-CreateVolumesFromSnapshotTest-1648007070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d1d2cd2b-bc4e-4620-8e09-570c268e9240" returned: 0 in 0.515s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2a0b448e-5c3d-42c0-9cc5-44d7605936df tempest-CreateVolumesFromSnapshotTest-1648007070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d1d2cd2b-bc4e-4620-8e09-570c268e9240.4daaec3f-d8da-46cc-a15f-f8d434f3d0e4 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:50 devstack sudo[108195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d1d2cd2b-bc4e-4620-8e09-570c268e9240.4daaec3f-d8da-46cc-a15f-f8d434f3d0e4 Jul 30 17:10:50 devstack sudo[108195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:50 devstack sudo[108190]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-03ce2a3d-d884-442c-a609-efc6fa43d980 tempest-CreateVolumesFromImageTest-661222144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8c6a7417-58d8-45e9-9608-08c5da9c0297" returned: 0 in 0.257s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:50 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-03ce2a3d-d884-442c-a609-efc6fa43d980 tempest-CreateVolumesFromImageTest-661222144 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:10:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-03ce2a3d-d884-442c-a609-efc6fa43d980 tempest-CreateVolumesFromImageTest-661222144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-506b8e2f-e534-4924-9826-0caead1fc2ff tempest-CreateVolumesFromImageTest-661222144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.481s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:50 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-506b8e2f-e534-4924-9826-0caead1fc2ff tempest-CreateVolumesFromImageTest-661222144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:10:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1122883322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94eea110-4dcd-4346-aed2-84180f622ca4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5bc3a9c71174afba6b4e4a85722b815',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:10:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:10:48Z,use_quota=True,user_id='733c1c51f3dc4d0ea885e1cc38c1eb11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:10:50 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-506b8e2f-e534-4924-9826-0caead1fc2ff tempest-CreateVolumesFromImageTest-661222144 None] Creating volume 94eea110-4dcd-4346-aed2-84180f622ca4 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:10:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-506b8e2f-e534-4924-9826-0caead1fc2ff tempest-CreateVolumesFromImageTest-661222144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-506b8e2f-e534-4924-9826-0caead1fc2ff tempest-CreateVolumesFromImageTest-661222144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:50 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-506b8e2f-e534-4924-9826-0caead1fc2ff tempest-CreateVolumesFromImageTest-661222144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:10:51 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-506b8e2f-e534-4924-9826-0caead1fc2ff tempest-CreateVolumesFromImageTest-661222144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:10:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-506b8e2f-e534-4924-9826-0caead1fc2ff tempest-CreateVolumesFromImageTest-661222144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:51 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-506b8e2f-e534-4924-9826-0caead1fc2ff tempest-CreateVolumesFromImageTest-661222144 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:10:51 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-506b8e2f-e534-4924-9826-0caead1fc2ff tempest-CreateVolumesFromImageTest-661222144 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:10:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-506b8e2f-e534-4924-9826-0caead1fc2ff tempest-CreateVolumesFromImageTest-661222144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-94eea110-4dcd-4346-aed2-84180f622ca4 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:51 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-03ce2a3d-d884-442c-a609-efc6fa43d980 tempest-CreateVolumesFromImageTest-661222144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f6007a0-18cc-4f00-9385-15705e1c81ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c6a7417-58d8-45e9-9608-08c5da9c0297', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:51 devstack sudo[108198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-94eea110-4dcd-4346-aed2-84180f622ca4 1073741824 Jul 30 17:10:51 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-03ce2a3d-d884-442c-a609-efc6fa43d980 tempest-CreateVolumesFromImageTest-661222144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91a6debe-fe25-4404-a8ad-86ddfc2c0550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:51 devstack sudo[108198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:51 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-03ce2a3d-d884-442c-a609-efc6fa43d980 tempest-CreateVolumesFromImageTest-661222144 None] Volume volume-8c6a7417-58d8-45e9-9608-08c5da9c0297 (8c6a7417-58d8-45e9-9608-08c5da9c0297): created successfully Jul 30 17:10:51 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-03ce2a3d-d884-442c-a609-efc6fa43d980 tempest-CreateVolumesFromImageTest-661222144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91a6debe-fe25-4404-a8ad-86ddfc2c0550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:51 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-03ce2a3d-d884-442c-a609-efc6fa43d980 tempest-CreateVolumesFromImageTest-661222144 None] Flow 'volume_create_manager' (f8651897-d0bb-4024-9bf6-0d569888af65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:10:51 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-03ce2a3d-d884-442c-a609-efc6fa43d980 tempest-CreateVolumesFromImageTest-661222144 None] Created volume successfully. Jul 30 17:10:51 devstack sudo[108195]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2a0b448e-5c3d-42c0-9cc5-44d7605936df tempest-CreateVolumesFromSnapshotTest-1648007070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d1d2cd2b-bc4e-4620-8e09-570c268e9240.4daaec3f-d8da-46cc-a15f-f8d434f3d0e4" returned: 0 in 0.338s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2a0b448e-5c3d-42c0-9cc5-44d7605936df tempest-CreateVolumesFromSnapshotTest-1648007070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d1d2cd2b-bc4e-4620-8e09-570c268e9240.4daaec3f-d8da-46cc-a15f-f8d434f3d0e4 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:51 devstack sudo[108205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d1d2cd2b-bc4e-4620-8e09-570c268e9240.4daaec3f-d8da-46cc-a15f-f8d434f3d0e4 Jul 30 17:10:51 devstack sudo[108205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:51 devstack sudo[108198]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-506b8e2f-e534-4924-9826-0caead1fc2ff tempest-CreateVolumesFromImageTest-661222144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-94eea110-4dcd-4346-aed2-84180f622ca4 1073741824" returned: 0 in 0.426s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-506b8e2f-e534-4924-9826-0caead1fc2ff tempest-CreateVolumesFromImageTest-661222144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-94eea110-4dcd-4346-aed2-84180f622ca4 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:51 devstack sudo[108209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-94eea110-4dcd-4346-aed2-84180f622ca4 Jul 30 17:10:51 devstack sudo[108209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:51 devstack sudo[108205]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2a0b448e-5c3d-42c0-9cc5-44d7605936df tempest-CreateVolumesFromSnapshotTest-1648007070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d1d2cd2b-bc4e-4620-8e09-570c268e9240.4daaec3f-d8da-46cc-a15f-f8d434f3d0e4" returned: 0 in 0.275s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:51 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-2a0b448e-5c3d-42c0-9cc5-44d7605936df tempest-CreateVolumesFromSnapshotTest-1648007070 None] Lock "cinder-quobyte-4daaec3f-d8da-46cc-a15f-f8d434f3d0e4" released by "_delete_snapshot" :: held 1.753s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:51 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-2a0b448e-5c3d-42c0-9cc5-44d7605936df tempest-CreateVolumesFromSnapshotTest-1648007070 None] Lock "cinder-quobyte-d1d2cd2b-bc4e-4620-8e09-570c268e9240" released by "delete_snapshot" :: held 1.795s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:51 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-2a0b448e-5c3d-42c0-9cc5-44d7605936df tempest-CreateVolumesFromSnapshotTest-1648007070 None] Created reservations ['88191d29-6156-4e91-a004-27c29cea2cd2', '8a2d65cf-e8cd-40a8-967b-3577d2efa9c2', '3aa8582c-bc85-49af-9bb0-bcc7890b5c6b', '8d68cd2e-de87-4cf4-8c56-7bb4f2fb0849'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:10:51 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-2a0b448e-5c3d-42c0-9cc5-44d7605936df tempest-CreateVolumesFromSnapshotTest-1648007070 None] Delete snapshot completed successfully. Jul 30 17:10:51 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-2a0b448e-5c3d-42c0-9cc5-44d7605936df tempest-CreateVolumesFromSnapshotTest-1648007070 None] Lock "cinder-4daaec3f-d8da-46cc-a15f-f8d434f3d0e4-delete_snapshot" released by "delete_snapshot" :: held 1.978s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:51 devstack sudo[108209]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-506b8e2f-e534-4924-9826-0caead1fc2ff tempest-CreateVolumesFromImageTest-661222144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-94eea110-4dcd-4346-aed2-84180f622ca4" returned: 0 in 0.281s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:51 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-506b8e2f-e534-4924-9826-0caead1fc2ff tempest-CreateVolumesFromImageTest-661222144 None] <== create_volume: return (747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:10:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-506b8e2f-e534-4924-9826-0caead1fc2ff tempest-CreateVolumesFromImageTest-661222144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-42a7da2b-c594-4cc9-baa4-33aa5080d57c tempest-VolumeDependencyTests-33890977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.044s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:51 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-42a7da2b-c594-4cc9-baa4-33aa5080d57c tempest-VolumeDependencyTests-33890977 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:10:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1222253912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d08a8f36-1b3e-424a-a39d-24894a89403e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12e0e28ab7d7453ea9d75301f1aa2c90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:10:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:10:49Z,use_quota=True,user_id='edc86705b5bd4a2791ee0338325cbc64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:10:51 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-42a7da2b-c594-4cc9-baa4-33aa5080d57c tempest-VolumeDependencyTests-33890977 None] Creating volume d08a8f36-1b3e-424a-a39d-24894a89403e {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:10:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-42a7da2b-c594-4cc9-baa4-33aa5080d57c tempest-VolumeDependencyTests-33890977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-42a7da2b-c594-4cc9-baa4-33aa5080d57c tempest-VolumeDependencyTests-33890977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:51 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-42a7da2b-c594-4cc9-baa4-33aa5080d57c tempest-VolumeDependencyTests-33890977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:10:51 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-42a7da2b-c594-4cc9-baa4-33aa5080d57c tempest-VolumeDependencyTests-33890977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:10:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-42a7da2b-c594-4cc9-baa4-33aa5080d57c tempest-VolumeDependencyTests-33890977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:51 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-42a7da2b-c594-4cc9-baa4-33aa5080d57c tempest-VolumeDependencyTests-33890977 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:10:51 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-42a7da2b-c594-4cc9-baa4-33aa5080d57c tempest-VolumeDependencyTests-33890977 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:10:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-42a7da2b-c594-4cc9-baa4-33aa5080d57c tempest-VolumeDependencyTests-33890977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d08a8f36-1b3e-424a-a39d-24894a89403e 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:51 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-506b8e2f-e534-4924-9826-0caead1fc2ff tempest-CreateVolumesFromImageTest-661222144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d782b0f9-fb0f-4bc7-bf04-11fd75280cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94eea110-4dcd-4346-aed2-84180f622ca4', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:51 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-506b8e2f-e534-4924-9826-0caead1fc2ff tempest-CreateVolumesFromImageTest-661222144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc1ea41d-ebfd-465b-badf-351b8d875c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:51 devstack sudo[108212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d08a8f36-1b3e-424a-a39d-24894a89403e 1073741824 Jul 30 17:10:51 devstack sudo[108212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:51 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-506b8e2f-e534-4924-9826-0caead1fc2ff tempest-CreateVolumesFromImageTest-661222144 None] Volume volume-94eea110-4dcd-4346-aed2-84180f622ca4 (94eea110-4dcd-4346-aed2-84180f622ca4): created successfully Jul 30 17:10:51 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-506b8e2f-e534-4924-9826-0caead1fc2ff tempest-CreateVolumesFromImageTest-661222144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc1ea41d-ebfd-465b-badf-351b8d875c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:51 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-506b8e2f-e534-4924-9826-0caead1fc2ff tempest-CreateVolumesFromImageTest-661222144 None] Flow 'volume_create_manager' (3e5bf806-57d5-4e26-9cb8-a4d6e7c366b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:10:51 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-506b8e2f-e534-4924-9826-0caead1fc2ff tempest-CreateVolumesFromImageTest-661222144 None] Created volume successfully. Jul 30 17:10:51 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-94baf80d-7140-4cb3-a51d-46365f095755 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Acquiring lock "cinder-d1d2cd2b-bc4e-4620-8e09-570c268e9240-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:51 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-94baf80d-7140-4cb3-a51d-46365f095755 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Lock "cinder-d1d2cd2b-bc4e-4620-8e09-570c268e9240-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:51 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-94baf80d-7140-4cb3-a51d-46365f095755 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Acquiring lock "cinder-quobyte-d1d2cd2b-bc4e-4620-8e09-570c268e9240" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:51 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-94baf80d-7140-4cb3-a51d-46365f095755 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Lock "cinder-quobyte-d1d2cd2b-bc4e-4620-8e09-570c268e9240" acquired by "delete_volume" :: waited 0.020s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:52 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c8f901-1bdd-4c3a-b3dc-045c8de2c04d]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:10:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-94baf80d-7140-4cb3-a51d-46365f095755 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d1d2cd2b-bc4e-4620-8e09-570c268e9240 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:52 devstack sudo[108216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d1d2cd2b-bc4e-4620-8e09-570c268e9240 Jul 30 17:10:52 devstack sudo[108216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:52 devstack sudo[108212]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-42a7da2b-c594-4cc9-baa4-33aa5080d57c tempest-VolumeDependencyTests-33890977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d08a8f36-1b3e-424a-a39d-24894a89403e 1073741824" returned: 0 in 0.517s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-42a7da2b-c594-4cc9-baa4-33aa5080d57c tempest-VolumeDependencyTests-33890977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d08a8f36-1b3e-424a-a39d-24894a89403e {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:52 devstack sudo[108220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d08a8f36-1b3e-424a-a39d-24894a89403e Jul 30 17:10:52 devstack sudo[108220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:52 devstack sudo[108216]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-94baf80d-7140-4cb3-a51d-46365f095755 tempest-CreateVolumesFromSnapshotTest-1648007070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d1d2cd2b-bc4e-4620-8e09-570c268e9240" returned: 0 in 0.422s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-94baf80d-7140-4cb3-a51d-46365f095755 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d1d2cd2b-bc4e-4620-8e09-570c268e9240 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:52 devstack sudo[108225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d1d2cd2b-bc4e-4620-8e09-570c268e9240 Jul 30 17:10:52 devstack sudo[108225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:52 devstack cinder-volume[88568]: DEBUG oslo_service.periodic_task [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 17:10:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:52 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:10:52 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:10:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:52 devstack sudo[108228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:10:52 devstack sudo[108228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:52 devstack sudo[108220]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-42a7da2b-c594-4cc9-baa4-33aa5080d57c tempest-VolumeDependencyTests-33890977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d08a8f36-1b3e-424a-a39d-24894a89403e" returned: 0 in 0.318s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:52 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-42a7da2b-c594-4cc9-baa4-33aa5080d57c tempest-VolumeDependencyTests-33890977 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:10:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-42a7da2b-c594-4cc9-baa4-33aa5080d57c tempest-VolumeDependencyTests-33890977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:52 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-42a7da2b-c594-4cc9-baa4-33aa5080d57c tempest-VolumeDependencyTests-33890977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (949d2f40-a5fb-4413-b934-b120f683982d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d08a8f36-1b3e-424a-a39d-24894a89403e', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:52 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-42a7da2b-c594-4cc9-baa4-33aa5080d57c tempest-VolumeDependencyTests-33890977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1b82cdc-abec-4aa6-84b6-57b7b30366fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:52 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-42a7da2b-c594-4cc9-baa4-33aa5080d57c tempest-VolumeDependencyTests-33890977 None] Volume volume-d08a8f36-1b3e-424a-a39d-24894a89403e (d08a8f36-1b3e-424a-a39d-24894a89403e): created successfully Jul 30 17:10:52 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-42a7da2b-c594-4cc9-baa4-33aa5080d57c tempest-VolumeDependencyTests-33890977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1b82cdc-abec-4aa6-84b6-57b7b30366fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:52 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-42a7da2b-c594-4cc9-baa4-33aa5080d57c tempest-VolumeDependencyTests-33890977 None] Flow 'volume_create_manager' (e2d0c634-4e35-49de-b72d-edb5863df2a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:10:52 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-42a7da2b-c594-4cc9-baa4-33aa5080d57c tempest-VolumeDependencyTests-33890977 None] Created volume successfully. Jul 30 17:10:52 devstack sudo[108225]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-94baf80d-7140-4cb3-a51d-46365f095755 tempest-CreateVolumesFromSnapshotTest-1648007070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d1d2cd2b-bc4e-4620-8e09-570c268e9240" returned: 0 in 0.281s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:52 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-94baf80d-7140-4cb3-a51d-46365f095755 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Lock "cinder-quobyte-d1d2cd2b-bc4e-4620-8e09-570c268e9240" released by "delete_volume" :: held 0.778s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:52 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-94baf80d-7140-4cb3-a51d-46365f095755 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Created reservations ['944df58a-f2ed-4eb6-94f2-0754c23b9fc8', 'e7a7fd01-dda5-4065-88a0-e4bc0f4d87c1', '9bd4c40f-a43a-4038-89b1-851532905c58', '6bdb0ef9-bcc6-42ca-8806-d35e7768d291'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:10:52 devstack sudo[108228]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.299s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:52 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:10:52 devstack cinder-volume[88568]: DEBUG oslo_service.periodic_task [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Running periodic task VolumeManager._thread_info {{(pid=88568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 17:10:52 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] thread count: 28 {{(pid=88568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 17:10:52 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] thread info: [<_MainThread(MainThread, started 127406866608256)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 17:10:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-94baf80d-7140-4cb3-a51d-46365f095755 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-94baf80d-7140-4cb3-a51d-46365f095755 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:52 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-94baf80d-7140-4cb3-a51d-46365f095755 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:10:52 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-94baf80d-7140-4cb3-a51d-46365f095755 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:10:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-94baf80d-7140-4cb3-a51d-46365f095755 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-94baf80d-7140-4cb3-a51d-46365f095755 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:52 devstack sudo[108232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:10:52 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-c92ba18c-0f5c-4af1-a71d-3942cd8f0bfe tempest-CreateVolumesFromImageTest-661222144 None] Acquiring lock "cinder-94eea110-4dcd-4346-aed2-84180f622ca4-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:52 devstack sudo[108232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:53 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-c92ba18c-0f5c-4af1-a71d-3942cd8f0bfe tempest-CreateVolumesFromImageTest-661222144 None] Lock "cinder-94eea110-4dcd-4346-aed2-84180f622ca4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:53 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-c92ba18c-0f5c-4af1-a71d-3942cd8f0bfe tempest-CreateVolumesFromImageTest-661222144 None] Acquiring lock "cinder-quobyte-94eea110-4dcd-4346-aed2-84180f622ca4" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:53 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-c92ba18c-0f5c-4af1-a71d-3942cd8f0bfe tempest-CreateVolumesFromImageTest-661222144 None] Lock "cinder-quobyte-94eea110-4dcd-4346-aed2-84180f622ca4" acquired by "delete_volume" :: waited 0.035s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:53 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[479c21bf-ffe4-482c-ba03-a9b649da7d3e]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:10:53 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-c92ba18c-0f5c-4af1-a71d-3942cd8f0bfe tempest-CreateVolumesFromImageTest-661222144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-94eea110-4dcd-4346-aed2-84180f622ca4 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:53 devstack sudo[108234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-94eea110-4dcd-4346-aed2-84180f622ca4 Jul 30 17:10:53 devstack sudo[108234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:53 devstack sudo[108232]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:53 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-94baf80d-7140-4cb3-a51d-46365f095755 tempest-CreateVolumesFromSnapshotTest-1648007070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.347s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:53 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-94baf80d-7140-4cb3-a51d-46365f095755 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:10:53 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-94baf80d-7140-4cb3-a51d-46365f095755 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Deleted volume successfully. Jul 30 17:10:53 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-94baf80d-7140-4cb3-a51d-46365f095755 tempest-CreateVolumesFromSnapshotTest-1648007070 None] Lock "cinder-d1d2cd2b-bc4e-4620-8e09-570c268e9240-delete_volume" released by "delete_volume" :: held 1.404s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:53 devstack sudo[108234]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:53 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-c92ba18c-0f5c-4af1-a71d-3942cd8f0bfe tempest-CreateVolumesFromImageTest-661222144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-94eea110-4dcd-4346-aed2-84180f622ca4" returned: 0 in 0.438s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:53 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-c92ba18c-0f5c-4af1-a71d-3942cd8f0bfe tempest-CreateVolumesFromImageTest-661222144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-94eea110-4dcd-4346-aed2-84180f622ca4 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:53 devstack sudo[108240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-94eea110-4dcd-4346-aed2-84180f622ca4 Jul 30 17:10:53 devstack sudo[108240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:53 devstack sudo[108240]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:53 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-c92ba18c-0f5c-4af1-a71d-3942cd8f0bfe tempest-CreateVolumesFromImageTest-661222144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-94eea110-4dcd-4346-aed2-84180f622ca4" returned: 0 in 0.365s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:53 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-c92ba18c-0f5c-4af1-a71d-3942cd8f0bfe tempest-CreateVolumesFromImageTest-661222144 None] Lock "cinder-quobyte-94eea110-4dcd-4346-aed2-84180f622ca4" released by "delete_volume" :: held 0.875s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:54 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-c92ba18c-0f5c-4af1-a71d-3942cd8f0bfe tempest-CreateVolumesFromImageTest-661222144 None] Created reservations ['0e775f97-cc69-4dbb-aaa4-5075f7ba26a7', '9419f88e-1194-4c74-8ac6-e281a8a36bec', '34bf04b8-42c1-428c-9685-798592911f4e', 'aa1b7ee7-d6c5-4f54-8549-79d601142afc'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:10:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-6c7f61be-a891-4940-8184-ebfdcc25ca13 tempest-VolumeDependencyTests-33890977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-6c7f61be-a891-4940-8184-ebfdcc25ca13 tempest-VolumeDependencyTests-33890977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:54 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-6c7f61be-a891-4940-8184-ebfdcc25ca13 tempest-VolumeDependencyTests-33890977 None] Creating offline snapshot 5c0b8139-5f9b-4700-a102-750ded053ad2 of volume d08a8f36-1b3e-424a-a39d-24894a89403e {{(pid=88568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:10:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-c92ba18c-0f5c-4af1-a71d-3942cd8f0bfe tempest-CreateVolumesFromImageTest-661222144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-c92ba18c-0f5c-4af1-a71d-3942cd8f0bfe tempest-CreateVolumesFromImageTest-661222144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:54 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-c92ba18c-0f5c-4af1-a71d-3942cd8f0bfe tempest-CreateVolumesFromImageTest-661222144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:10:54 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-c92ba18c-0f5c-4af1-a71d-3942cd8f0bfe tempest-CreateVolumesFromImageTest-661222144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:10:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-c92ba18c-0f5c-4af1-a71d-3942cd8f0bfe tempest-CreateVolumesFromImageTest-661222144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-c92ba18c-0f5c-4af1-a71d-3942cd8f0bfe tempest-CreateVolumesFromImageTest-661222144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:54 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[27daae62-c2a3-443f-b8c8-0789e1885021]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:10:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-6c7f61be-a891-4940-8184-ebfdcc25ca13 tempest-VolumeDependencyTests-33890977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d08a8f36-1b3e-424a-a39d-24894a89403e {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:54 devstack sudo[108243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:10:54 devstack sudo[108243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:54 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-9d1a2d13-2574-4f85-a109-8eb5a645b38e tempest-CreateVolumesFromImageTest-661222144 None] Acquiring lock "cinder-8c6a7417-58d8-45e9-9608-08c5da9c0297-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:54 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-9d1a2d13-2574-4f85-a109-8eb5a645b38e tempest-CreateVolumesFromImageTest-661222144 None] Lock "cinder-8c6a7417-58d8-45e9-9608-08c5da9c0297-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:54 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-9d1a2d13-2574-4f85-a109-8eb5a645b38e tempest-CreateVolumesFromImageTest-661222144 None] Acquiring lock "cinder-quobyte-8c6a7417-58d8-45e9-9608-08c5da9c0297" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:54 devstack sudo[108244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d08a8f36-1b3e-424a-a39d-24894a89403e Jul 30 17:10:54 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-9d1a2d13-2574-4f85-a109-8eb5a645b38e tempest-CreateVolumesFromImageTest-661222144 None] Lock "cinder-quobyte-8c6a7417-58d8-45e9-9608-08c5da9c0297" acquired by "delete_volume" :: waited 0.033s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:54 devstack sudo[108244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:54 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff27376-aaa4-4207-83e4-135d7284e4cc]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:10:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9d1a2d13-2574-4f85-a109-8eb5a645b38e tempest-CreateVolumesFromImageTest-661222144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8c6a7417-58d8-45e9-9608-08c5da9c0297 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:54 devstack sudo[108243]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-c92ba18c-0f5c-4af1-a71d-3942cd8f0bfe tempest-CreateVolumesFromImageTest-661222144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.473s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:54 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-c92ba18c-0f5c-4af1-a71d-3942cd8f0bfe tempest-CreateVolumesFromImageTest-661222144 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:10:54 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-c92ba18c-0f5c-4af1-a71d-3942cd8f0bfe tempest-CreateVolumesFromImageTest-661222144 None] Deleted volume successfully. Jul 30 17:10:54 devstack sudo[108247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8c6a7417-58d8-45e9-9608-08c5da9c0297 Jul 30 17:10:54 devstack sudo[108247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:54 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-c92ba18c-0f5c-4af1-a71d-3942cd8f0bfe tempest-CreateVolumesFromImageTest-661222144 None] Lock "cinder-94eea110-4dcd-4346-aed2-84180f622ca4-delete_volume" released by "delete_volume" :: held 1.716s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:54 devstack sudo[108244]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-6c7f61be-a891-4940-8184-ebfdcc25ca13 tempest-VolumeDependencyTests-33890977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d08a8f36-1b3e-424a-a39d-24894a89403e" returned: 0 in 0.606s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-6c7f61be-a891-4940-8184-ebfdcc25ca13 tempest-VolumeDependencyTests-33890977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d08a8f36-1b3e-424a-a39d-24894a89403e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d08a8f36-1b3e-424a-a39d-24894a89403e.5c0b8139-5f9b-4700-a102-750ded053ad2 1G {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:54 devstack sudo[108253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d08a8f36-1b3e-424a-a39d-24894a89403e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d08a8f36-1b3e-424a-a39d-24894a89403e.5c0b8139-5f9b-4700-a102-750ded053ad2 1G Jul 30 17:10:54 devstack sudo[108253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:55 devstack sudo[108247]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9d1a2d13-2574-4f85-a109-8eb5a645b38e tempest-CreateVolumesFromImageTest-661222144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8c6a7417-58d8-45e9-9608-08c5da9c0297" returned: 0 in 0.566s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9d1a2d13-2574-4f85-a109-8eb5a645b38e tempest-CreateVolumesFromImageTest-661222144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8c6a7417-58d8-45e9-9608-08c5da9c0297 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:55 devstack sudo[108259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8c6a7417-58d8-45e9-9608-08c5da9c0297 Jul 30 17:10:55 devstack sudo[108259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:55 devstack sudo[108253]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-6c7f61be-a891-4940-8184-ebfdcc25ca13 tempest-VolumeDependencyTests-33890977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d08a8f36-1b3e-424a-a39d-24894a89403e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d08a8f36-1b3e-424a-a39d-24894a89403e.5c0b8139-5f9b-4700-a102-750ded053ad2 1G" returned: 0 in 0.512s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-6c7f61be-a891-4940-8184-ebfdcc25ca13 tempest-VolumeDependencyTests-33890977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d08a8f36-1b3e-424a-a39d-24894a89403e -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d08a8f36-1b3e-424a-a39d-24894a89403e.5c0b8139-5f9b-4700-a102-750ded053ad2 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:55 devstack sudo[108259]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9d1a2d13-2574-4f85-a109-8eb5a645b38e tempest-CreateVolumesFromImageTest-661222144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-8c6a7417-58d8-45e9-9608-08c5da9c0297" returned: 0 in 0.314s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:55 devstack sudo[108267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d08a8f36-1b3e-424a-a39d-24894a89403e -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d08a8f36-1b3e-424a-a39d-24894a89403e.5c0b8139-5f9b-4700-a102-750ded053ad2 Jul 30 17:10:55 devstack sudo[108267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:55 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-9d1a2d13-2574-4f85-a109-8eb5a645b38e tempest-CreateVolumesFromImageTest-661222144 None] Lock "cinder-quobyte-8c6a7417-58d8-45e9-9608-08c5da9c0297" released by "delete_volume" :: held 0.965s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:55 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-9d1a2d13-2574-4f85-a109-8eb5a645b38e tempest-CreateVolumesFromImageTest-661222144 None] Created reservations ['006d2511-e3cd-43b5-bf93-359d0ffb8c43', '04cc5e5b-a26b-4392-8e5a-3fa8f1a0c406', '3ccf4968-e92c-4e84-9a6f-ae35bef2a562', 'd4910857-64af-40a2-bb6a-e4d779975137'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:10:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-9d1a2d13-2574-4f85-a109-8eb5a645b38e tempest-CreateVolumesFromImageTest-661222144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-9d1a2d13-2574-4f85-a109-8eb5a645b38e tempest-CreateVolumesFromImageTest-661222144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:55 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-9d1a2d13-2574-4f85-a109-8eb5a645b38e tempest-CreateVolumesFromImageTest-661222144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:10:55 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-9d1a2d13-2574-4f85-a109-8eb5a645b38e tempest-CreateVolumesFromImageTest-661222144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:10:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-9d1a2d13-2574-4f85-a109-8eb5a645b38e tempest-CreateVolumesFromImageTest-661222144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9d1a2d13-2574-4f85-a109-8eb5a645b38e tempest-CreateVolumesFromImageTest-661222144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:55 devstack sudo[108271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:10:55 devstack sudo[108271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:55 devstack sudo[108267]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-6c7f61be-a891-4940-8184-ebfdcc25ca13 tempest-VolumeDependencyTests-33890977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d08a8f36-1b3e-424a-a39d-24894a89403e -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d08a8f36-1b3e-424a-a39d-24894a89403e.5c0b8139-5f9b-4700-a102-750ded053ad2" returned: 0 in 0.331s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:55 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-6c7f61be-a891-4940-8184-ebfdcc25ca13 tempest-VolumeDependencyTests-33890977 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d08a8f36-1b3e-424a-a39d-24894a89403e.5c0b8139-5f9b-4700-a102-750ded053ad2 is being set with open permissions: ugo+rw Jul 30 17:10:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-6c7f61be-a891-4940-8184-ebfdcc25ca13 tempest-VolumeDependencyTests-33890977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d08a8f36-1b3e-424a-a39d-24894a89403e.5c0b8139-5f9b-4700-a102-750ded053ad2 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:55 devstack sudo[108274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d08a8f36-1b3e-424a-a39d-24894a89403e.5c0b8139-5f9b-4700-a102-750ded053ad2 Jul 30 17:10:55 devstack sudo[108274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:55 devstack sudo[108271]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9d1a2d13-2574-4f85-a109-8eb5a645b38e tempest-CreateVolumesFromImageTest-661222144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.342s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:55 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-9d1a2d13-2574-4f85-a109-8eb5a645b38e tempest-CreateVolumesFromImageTest-661222144 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:10:55 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-9d1a2d13-2574-4f85-a109-8eb5a645b38e tempest-CreateVolumesFromImageTest-661222144 None] Deleted volume successfully. Jul 30 17:10:55 devstack sudo[108274]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-6c7f61be-a891-4940-8184-ebfdcc25ca13 tempest-VolumeDependencyTests-33890977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d08a8f36-1b3e-424a-a39d-24894a89403e.5c0b8139-5f9b-4700-a102-750ded053ad2" returned: 0 in 0.288s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:55 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-9d1a2d13-2574-4f85-a109-8eb5a645b38e tempest-CreateVolumesFromImageTest-661222144 None] Lock "cinder-8c6a7417-58d8-45e9-9608-08c5da9c0297-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-6c7f61be-a891-4940-8184-ebfdcc25ca13 tempest-VolumeDependencyTests-33890977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d08a8f36-1b3e-424a-a39d-24894a89403e.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:56 devstack sudo[108278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d08a8f36-1b3e-424a-a39d-24894a89403e.info Jul 30 17:10:56 devstack sudo[108278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:56 devstack sudo[108278]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-6c7f61be-a891-4940-8184-ebfdcc25ca13 tempest-VolumeDependencyTests-33890977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d08a8f36-1b3e-424a-a39d-24894a89403e.info" returned: 0 in 0.295s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:56 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-6c7f61be-a891-4940-8184-ebfdcc25ca13 tempest-VolumeDependencyTests-33890977 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d08a8f36-1b3e-424a-a39d-24894a89403e.info is being set with open permissions: ugo+rw Jul 30 17:10:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-6c7f61be-a891-4940-8184-ebfdcc25ca13 tempest-VolumeDependencyTests-33890977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d08a8f36-1b3e-424a-a39d-24894a89403e.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:56 devstack sudo[108281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d08a8f36-1b3e-424a-a39d-24894a89403e.info Jul 30 17:10:56 devstack sudo[108281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:56 devstack sudo[108281]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-6c7f61be-a891-4940-8184-ebfdcc25ca13 tempest-VolumeDependencyTests-33890977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d08a8f36-1b3e-424a-a39d-24894a89403e.info" returned: 0 in 0.277s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-6c7f61be-a891-4940-8184-ebfdcc25ca13 tempest-VolumeDependencyTests-33890977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.454s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:56 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-6c7f61be-a891-4940-8184-ebfdcc25ca13 tempest-VolumeDependencyTests-33890977 None] Create snapshot completed successfully Jul 30 17:10:56 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-8c46ba04-4016-4c9b-9439-91a04b2d354b tempest-CreateVolumesFromImageTest-661222144 None] Acquiring lock "cinder-e51486e9-5713-45da-81d0-fd4adc681793-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:56 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-8c46ba04-4016-4c9b-9439-91a04b2d354b tempest-CreateVolumesFromImageTest-661222144 None] Lock "cinder-e51486e9-5713-45da-81d0-fd4adc681793-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:56 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-8c46ba04-4016-4c9b-9439-91a04b2d354b tempest-CreateVolumesFromImageTest-661222144 None] Acquiring lock "cinder-quobyte-e51486e9-5713-45da-81d0-fd4adc681793" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:56 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-8c46ba04-4016-4c9b-9439-91a04b2d354b tempest-CreateVolumesFromImageTest-661222144 None] Lock "cinder-quobyte-e51486e9-5713-45da-81d0-fd4adc681793" acquired by "delete_volume" :: waited 0.019s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:56 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[21246116-a6df-4038-8646-a87307790c8a]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:10:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8c46ba04-4016-4c9b-9439-91a04b2d354b tempest-CreateVolumesFromImageTest-661222144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e51486e9-5713-45da-81d0-fd4adc681793 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:56 devstack sudo[108284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e51486e9-5713-45da-81d0-fd4adc681793 Jul 30 17:10:56 devstack sudo[108284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:57 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-07151a75-c400-4d8b-9fe1-af4533c5e271 tempest-ProjectAdminTests-613066796 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6410598754883, 'free_capacity_gb': 1775.6410598754883, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88568) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 30 17:10:57 devstack sudo[108284]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8c46ba04-4016-4c9b-9439-91a04b2d354b tempest-CreateVolumesFromImageTest-661222144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e51486e9-5713-45da-81d0-fd4adc681793" returned: 0 in 0.464s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8c46ba04-4016-4c9b-9439-91a04b2d354b tempest-CreateVolumesFromImageTest-661222144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e51486e9-5713-45da-81d0-fd4adc681793 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:57 devstack sudo[108289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e51486e9-5713-45da-81d0-fd4adc681793 Jul 30 17:10:57 devstack sudo[108289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:57 devstack sudo[108289]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8c46ba04-4016-4c9b-9439-91a04b2d354b tempest-CreateVolumesFromImageTest-661222144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e51486e9-5713-45da-81d0-fd4adc681793" returned: 0 in 0.343s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:57 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-8c46ba04-4016-4c9b-9439-91a04b2d354b tempest-CreateVolumesFromImageTest-661222144 None] Lock "cinder-quobyte-e51486e9-5713-45da-81d0-fd4adc681793" released by "delete_volume" :: held 0.867s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:57 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-8c46ba04-4016-4c9b-9439-91a04b2d354b tempest-CreateVolumesFromImageTest-661222144 None] Created reservations ['b13ddb1f-2886-431f-bfea-c09a0be08692', '2b44c2c2-08a3-4eb6-8222-1424f370b0f5', 'cf7f9a6c-c492-409b-8730-9f2e33a1d3cf', '4f43de20-8f33-4e17-9cfa-6665b714e558'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:10:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-8c46ba04-4016-4c9b-9439-91a04b2d354b tempest-CreateVolumesFromImageTest-661222144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-8c46ba04-4016-4c9b-9439-91a04b2d354b tempest-CreateVolumesFromImageTest-661222144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:57 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-8c46ba04-4016-4c9b-9439-91a04b2d354b tempest-CreateVolumesFromImageTest-661222144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:10:57 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-8c46ba04-4016-4c9b-9439-91a04b2d354b tempest-CreateVolumesFromImageTest-661222144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:10:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-8c46ba04-4016-4c9b-9439-91a04b2d354b tempest-CreateVolumesFromImageTest-661222144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8c46ba04-4016-4c9b-9439-91a04b2d354b tempest-CreateVolumesFromImageTest-661222144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:57 devstack sudo[108292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:10:57 devstack sudo[108292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:58 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-d39260f6-517b-4aa9-beb7-e8eafd90c736 tempest-CreateVolumesFromImageTest-661222144 None] Acquiring lock "cinder-f346bfc4-3baa-4e08-b83f-8ac445af2d84-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:58 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-d39260f6-517b-4aa9-beb7-e8eafd90c736 tempest-CreateVolumesFromImageTest-661222144 None] Lock "cinder-f346bfc4-3baa-4e08-b83f-8ac445af2d84-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:58 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ffd6a74-1a36-4442-974a-e30976f0568e tempest-VolumeDependencyTests-33890977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:10:58 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7ffd6a74-1a36-4442-974a-e30976f0568e tempest-VolumeDependencyTests-33890977 None] Flow 'volume_create_manager' (0a1463ef-84cc-4a44-9c2d-f497d24c677d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:10:58 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7ffd6a74-1a36-4442-974a-e30976f0568e tempest-VolumeDependencyTests-33890977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee402bbd-0831-40c3-9a7d-0c141266a0b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:58 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7ffd6a74-1a36-4442-974a-e30976f0568e tempest-VolumeDependencyTests-33890977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee402bbd-0831-40c3-9a7d-0c141266a0b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:10:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1622596066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c714adb8-bfa8-45f3-92f4-b330bc2dca5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12e0e28ab7d7453ea9d75301f1aa2c90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:10:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5c0b8139-5f9b-4700-a102-750ded053ad2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:10:58Z,use_quota=True,user_id='edc86705b5bd4a2791ee0338325cbc64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:58 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7ffd6a74-1a36-4442-974a-e30976f0568e tempest-VolumeDependencyTests-33890977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c32edb15-a045-4432-81b1-5dedef84f7c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:58 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7ffd6a74-1a36-4442-974a-e30976f0568e tempest-VolumeDependencyTests-33890977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c32edb15-a045-4432-81b1-5dedef84f7c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:58 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7ffd6a74-1a36-4442-974a-e30976f0568e tempest-VolumeDependencyTests-33890977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bd0fdce-de63-45cb-9841-677ca8e2f2b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:58 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7ffd6a74-1a36-4442-974a-e30976f0568e tempest-VolumeDependencyTests-33890977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bd0fdce-de63-45cb-9841-677ca8e2f2b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c714adb8-bfa8-45f3-92f4-b330bc2dca5b', 'volume_name': 'volume-c714adb8-bfa8-45f3-92f4-b330bc2dca5b', 'volume_size': 1, 'snapshot_id': '5c0b8139-5f9b-4700-a102-750ded053ad2'}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:58 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7ffd6a74-1a36-4442-974a-e30976f0568e tempest-VolumeDependencyTests-33890977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (815c1074-6706-44ed-8228-7abe0bc7eb90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:58 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7ffd6a74-1a36-4442-974a-e30976f0568e tempest-VolumeDependencyTests-33890977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (815c1074-6706-44ed-8228-7abe0bc7eb90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:58 devstack sudo[108292]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:58 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7ffd6a74-1a36-4442-974a-e30976f0568e tempest-VolumeDependencyTests-33890977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba75fd9e-7501-4ee9-aef2-fde3fd8a3dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:58 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-7ffd6a74-1a36-4442-974a-e30976f0568e tempest-VolumeDependencyTests-33890977 None] Volume c714adb8-bfa8-45f3-92f4-b330bc2dca5b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c714adb8-bfa8-45f3-92f4-b330bc2dca5b', 'volume_size': 1, 'snapshot_id': '5c0b8139-5f9b-4700-a102-750ded053ad2'} Jul 30 17:10:58 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-d39260f6-517b-4aa9-beb7-e8eafd90c736 tempest-CreateVolumesFromImageTest-661222144 None] Acquiring lock "cinder-quobyte-f346bfc4-3baa-4e08-b83f-8ac445af2d84" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8c46ba04-4016-4c9b-9439-91a04b2d354b tempest-CreateVolumesFromImageTest-661222144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.467s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:58 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-8c46ba04-4016-4c9b-9439-91a04b2d354b tempest-CreateVolumesFromImageTest-661222144 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:10:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-7ffd6a74-1a36-4442-974a-e30976f0568e tempest-VolumeDependencyTests-33890977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-7ffd6a74-1a36-4442-974a-e30976f0568e tempest-VolumeDependencyTests-33890977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:58 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-7ffd6a74-1a36-4442-974a-e30976f0568e tempest-VolumeDependencyTests-33890977 None] Acquiring lock "cinder-quobyte-5c0b8139-5f9b-4700-a102-750ded053ad2-c714adb8-bfa8-45f3-92f4-b330bc2dca5b" by "_create_volume_from_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:58 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-8c46ba04-4016-4c9b-9439-91a04b2d354b tempest-CreateVolumesFromImageTest-661222144 None] Deleted volume successfully. Jul 30 17:10:58 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-d39260f6-517b-4aa9-beb7-e8eafd90c736 tempest-CreateVolumesFromImageTest-661222144 None] Lock "cinder-quobyte-f346bfc4-3baa-4e08-b83f-8ac445af2d84" acquired by "delete_volume" :: waited 0.037s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:58 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-7ffd6a74-1a36-4442-974a-e30976f0568e tempest-VolumeDependencyTests-33890977 None] Lock "cinder-quobyte-5c0b8139-5f9b-4700-a102-750ded053ad2-c714adb8-bfa8-45f3-92f4-b330bc2dca5b" acquired by "_create_volume_from_snapshot" :: waited 0.047s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:58 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-7ffd6a74-1a36-4442-974a-e30976f0568e tempest-VolumeDependencyTests-33890977 None] Creating volume c714adb8-bfa8-45f3-92f4-b330bc2dca5b from snapshot 5c0b8139-5f9b-4700-a102-750ded053ad2 {{(pid=88568) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 30 17:10:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-7ffd6a74-1a36-4442-974a-e30976f0568e tempest-VolumeDependencyTests-33890977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-7ffd6a74-1a36-4442-974a-e30976f0568e tempest-VolumeDependencyTests-33890977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:58 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-7ffd6a74-1a36-4442-974a-e30976f0568e tempest-VolumeDependencyTests-33890977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:10:58 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-7ffd6a74-1a36-4442-974a-e30976f0568e tempest-VolumeDependencyTests-33890977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:10:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-7ffd6a74-1a36-4442-974a-e30976f0568e tempest-VolumeDependencyTests-33890977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:58 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-7ffd6a74-1a36-4442-974a-e30976f0568e tempest-VolumeDependencyTests-33890977 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:10:58 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-7ffd6a74-1a36-4442-974a-e30976f0568e tempest-VolumeDependencyTests-33890977 None] Acquiring lock "cinder-quobyte-c714adb8-bfa8-45f3-92f4-b330bc2dca5b" by "_copy_volume_from_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:58 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf22595-04c3-43f8-a3e2-9ad907894a2a]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:10:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d39260f6-517b-4aa9-beb7-e8eafd90c736 tempest-CreateVolumesFromImageTest-661222144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f346bfc4-3baa-4e08-b83f-8ac445af2d84 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:58 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-8c46ba04-4016-4c9b-9439-91a04b2d354b tempest-CreateVolumesFromImageTest-661222144 None] Lock "cinder-e51486e9-5713-45da-81d0-fd4adc681793-delete_volume" released by "delete_volume" :: held 1.684s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:58 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-7ffd6a74-1a36-4442-974a-e30976f0568e tempest-VolumeDependencyTests-33890977 None] Lock "cinder-quobyte-c714adb8-bfa8-45f3-92f4-b330bc2dca5b" acquired by "_copy_volume_from_snapshot" :: waited 0.049s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:58 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-7ffd6a74-1a36-4442-974a-e30976f0568e tempest-VolumeDependencyTests-33890977 None] snapshot: 5c0b8139-5f9b-4700-a102-750ded053ad2, volume: c714adb8-bfa8-45f3-92f4-b330bc2dca5b, {{(pid=88568) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 30 17:10:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-7ffd6a74-1a36-4442-974a-e30976f0568e tempest-VolumeDependencyTests-33890977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-7ffd6a74-1a36-4442-974a-e30976f0568e tempest-VolumeDependencyTests-33890977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:58 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-7ffd6a74-1a36-4442-974a-e30976f0568e tempest-VolumeDependencyTests-33890977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:10:58 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-7ffd6a74-1a36-4442-974a-e30976f0568e tempest-VolumeDependencyTests-33890977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:10:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-7ffd6a74-1a36-4442-974a-e30976f0568e tempest-VolumeDependencyTests-33890977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:58 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e1212ce-f078-4109-a678-acf5b84393f7]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:10:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7ffd6a74-1a36-4442-974a-e30976f0568e tempest-VolumeDependencyTests-33890977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d08a8f36-1b3e-424a-a39d-24894a89403e.5c0b8139-5f9b-4700-a102-750ded053ad2 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:58 devstack sudo[108295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f346bfc4-3baa-4e08-b83f-8ac445af2d84 Jul 30 17:10:58 devstack sudo[108295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:58 devstack sudo[108296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d08a8f36-1b3e-424a-a39d-24894a89403e.5c0b8139-5f9b-4700-a102-750ded053ad2 Jul 30 17:10:58 devstack sudo[108296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:58 devstack sudo[108295]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d39260f6-517b-4aa9-beb7-e8eafd90c736 tempest-CreateVolumesFromImageTest-661222144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f346bfc4-3baa-4e08-b83f-8ac445af2d84" returned: 0 in 0.557s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d39260f6-517b-4aa9-beb7-e8eafd90c736 tempest-CreateVolumesFromImageTest-661222144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f346bfc4-3baa-4e08-b83f-8ac445af2d84 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:58 devstack sudo[108305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f346bfc4-3baa-4e08-b83f-8ac445af2d84 Jul 30 17:10:58 devstack sudo[108305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:58 devstack sudo[108296]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7ffd6a74-1a36-4442-974a-e30976f0568e tempest-VolumeDependencyTests-33890977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d08a8f36-1b3e-424a-a39d-24894a89403e.5c0b8139-5f9b-4700-a102-750ded053ad2" returned: 0 in 0.518s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:58 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-7ffd6a74-1a36-4442-974a-e30976f0568e tempest-VolumeDependencyTests-33890977 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d08a8f36-1b3e-424a-a39d-24894a89403e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:10:59 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[6139f4ad-abb4-4c4e-8d73-e561e82fa8ca]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:10:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7ffd6a74-1a36-4442-974a-e30976f0568e tempest-VolumeDependencyTests-33890977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d08a8f36-1b3e-424a-a39d-24894a89403e {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:59 devstack sudo[108307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d08a8f36-1b3e-424a-a39d-24894a89403e Jul 30 17:10:59 devstack sudo[108307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:59 devstack sudo[108305]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d39260f6-517b-4aa9-beb7-e8eafd90c736 tempest-CreateVolumesFromImageTest-661222144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-f346bfc4-3baa-4e08-b83f-8ac445af2d84" returned: 0 in 0.391s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:59 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-d39260f6-517b-4aa9-beb7-e8eafd90c736 tempest-CreateVolumesFromImageTest-661222144 None] Lock "cinder-quobyte-f346bfc4-3baa-4e08-b83f-8ac445af2d84" released by "delete_volume" :: held 1.009s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:59 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-d39260f6-517b-4aa9-beb7-e8eafd90c736 tempest-CreateVolumesFromImageTest-661222144 None] Created reservations ['d59e8b5e-2578-4e7d-93ec-84a75d0d4332', 'b199d68a-ebb6-4cee-a1fc-c35f027ce048', '7f43f081-c5b2-43f1-b277-1bb83e31d24f', '667af66f-b32e-4c25-9ad4-17a3d9331b99'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:10:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-d39260f6-517b-4aa9-beb7-e8eafd90c736 tempest-CreateVolumesFromImageTest-661222144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-d39260f6-517b-4aa9-beb7-e8eafd90c736 tempest-CreateVolumesFromImageTest-661222144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:59 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-d39260f6-517b-4aa9-beb7-e8eafd90c736 tempest-CreateVolumesFromImageTest-661222144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:10:59 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-d39260f6-517b-4aa9-beb7-e8eafd90c736 tempest-CreateVolumesFromImageTest-661222144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:10:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-d39260f6-517b-4aa9-beb7-e8eafd90c736 tempest-CreateVolumesFromImageTest-661222144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d39260f6-517b-4aa9-beb7-e8eafd90c736 tempest-CreateVolumesFromImageTest-661222144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:59 devstack sudo[108313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:10:59 devstack sudo[108313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:59 devstack sudo[108307]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7ffd6a74-1a36-4442-974a-e30976f0568e tempest-VolumeDependencyTests-33890977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d08a8f36-1b3e-424a-a39d-24894a89403e" returned: 0 in 0.582s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:59 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-7ffd6a74-1a36-4442-974a-e30976f0568e tempest-VolumeDependencyTests-33890977 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d08a8f36-1b3e-424a-a39d-24894a89403e {{(pid=88568) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 30 17:10:59 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-7ffd6a74-1a36-4442-974a-e30976f0568e tempest-VolumeDependencyTests-33890977 None] Creating direct copy from snapshot {{(pid=88568) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 30 17:10:59 devstack cinder-volume[88568]: DEBUG cinder.utils [None req-7ffd6a74-1a36-4442-974a-e30976f0568e tempest-VolumeDependencyTests-33890977 None] Path /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c714adb8-bfa8-45f3-92f4-b330bc2dca5b not found in is_blk_device check {{(pid=88568) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 30 17:10:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7ffd6a74-1a36-4442-974a-e30976f0568e tempest-VolumeDependencyTests-33890977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d08a8f36-1b3e-424a-a39d-24894a89403e /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c714adb8-bfa8-45f3-92f4-b330bc2dca5b {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:59 devstack sudo[108315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d08a8f36-1b3e-424a-a39d-24894a89403e /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c714adb8-bfa8-45f3-92f4-b330bc2dca5b Jul 30 17:10:59 devstack sudo[108315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:59 devstack sudo[108313]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d39260f6-517b-4aa9-beb7-e8eafd90c736 tempest-CreateVolumesFromImageTest-661222144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.327s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:59 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-d39260f6-517b-4aa9-beb7-e8eafd90c736 tempest-CreateVolumesFromImageTest-661222144 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:10:59 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-d39260f6-517b-4aa9-beb7-e8eafd90c736 tempest-CreateVolumesFromImageTest-661222144 None] Deleted volume successfully. Jul 30 17:10:59 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-d39260f6-517b-4aa9-beb7-e8eafd90c736 tempest-CreateVolumesFromImageTest-661222144 None] Lock "cinder-f346bfc4-3baa-4e08-b83f-8ac445af2d84-delete_volume" released by "delete_volume" :: held 1.799s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:00 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-d5cfba84-67b4-4f43-b71e-da1388f2dc53 tempest-CreateVolumesFromImageTest-661222144 None] Acquiring lock "cinder-042b7cdc-d0d5-49cc-8042-dd03d28d31cb-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:00 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-d5cfba84-67b4-4f43-b71e-da1388f2dc53 tempest-CreateVolumesFromImageTest-661222144 None] Lock "cinder-042b7cdc-d0d5-49cc-8042-dd03d28d31cb-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:00 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-d5cfba84-67b4-4f43-b71e-da1388f2dc53 tempest-CreateVolumesFromImageTest-661222144 None] Acquiring lock "cinder-quobyte-042b7cdc-d0d5-49cc-8042-dd03d28d31cb" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:00 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-d5cfba84-67b4-4f43-b71e-da1388f2dc53 tempest-CreateVolumesFromImageTest-661222144 None] Lock "cinder-quobyte-042b7cdc-d0d5-49cc-8042-dd03d28d31cb" acquired by "delete_volume" :: waited 0.037s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:00 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[48677be2-a882-43b5-bfaa-a4c26f43ad99]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:11:00 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d5cfba84-67b4-4f43-b71e-da1388f2dc53 tempest-CreateVolumesFromImageTest-661222144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-042b7cdc-d0d5-49cc-8042-dd03d28d31cb {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:00 devstack sudo[108329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-042b7cdc-d0d5-49cc-8042-dd03d28d31cb Jul 30 17:11:00 devstack sudo[108329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:01 devstack sudo[108329]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d5cfba84-67b4-4f43-b71e-da1388f2dc53 tempest-CreateVolumesFromImageTest-661222144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-042b7cdc-d0d5-49cc-8042-dd03d28d31cb" returned: 0 in 0.608s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d5cfba84-67b4-4f43-b71e-da1388f2dc53 tempest-CreateVolumesFromImageTest-661222144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-042b7cdc-d0d5-49cc-8042-dd03d28d31cb {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:01 devstack sudo[108334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-042b7cdc-d0d5-49cc-8042-dd03d28d31cb Jul 30 17:11:01 devstack sudo[108334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:02 devstack sudo[108334]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d5cfba84-67b4-4f43-b71e-da1388f2dc53 tempest-CreateVolumesFromImageTest-661222144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-042b7cdc-d0d5-49cc-8042-dd03d28d31cb" returned: 0 in 0.665s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:02 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-d5cfba84-67b4-4f43-b71e-da1388f2dc53 tempest-CreateVolumesFromImageTest-661222144 None] Lock "cinder-quobyte-042b7cdc-d0d5-49cc-8042-dd03d28d31cb" released by "delete_volume" :: held 1.396s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:02 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-d5cfba84-67b4-4f43-b71e-da1388f2dc53 tempest-CreateVolumesFromImageTest-661222144 None] Created reservations ['490cf87c-2a16-4b4d-ad86-601f6f9d784e', '3f7cf9ed-fcc9-49e1-bc57-1af18858962c', 'cf375640-9a41-45ff-989d-781190d84fd1', '07210568-d0e5-458a-a825-d250b5a7f282'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:11:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-d5cfba84-67b4-4f43-b71e-da1388f2dc53 tempest-CreateVolumesFromImageTest-661222144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-d5cfba84-67b4-4f43-b71e-da1388f2dc53 tempest-CreateVolumesFromImageTest-661222144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:02 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-d5cfba84-67b4-4f43-b71e-da1388f2dc53 tempest-CreateVolumesFromImageTest-661222144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:11:02 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-d5cfba84-67b4-4f43-b71e-da1388f2dc53 tempest-CreateVolumesFromImageTest-661222144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:11:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-d5cfba84-67b4-4f43-b71e-da1388f2dc53 tempest-CreateVolumesFromImageTest-661222144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d5cfba84-67b4-4f43-b71e-da1388f2dc53 tempest-CreateVolumesFromImageTest-661222144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:02 devstack sudo[108337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:11:02 devstack sudo[108337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:03 devstack sudo[108337]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d5cfba84-67b4-4f43-b71e-da1388f2dc53 tempest-CreateVolumesFromImageTest-661222144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.562s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:03 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-d5cfba84-67b4-4f43-b71e-da1388f2dc53 tempest-CreateVolumesFromImageTest-661222144 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:11:03 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-d5cfba84-67b4-4f43-b71e-da1388f2dc53 tempest-CreateVolumesFromImageTest-661222144 None] Deleted volume successfully. Jul 30 17:11:03 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-d5cfba84-67b4-4f43-b71e-da1388f2dc53 tempest-CreateVolumesFromImageTest-661222144 None] Lock "cinder-042b7cdc-d0d5-49cc-8042-dd03d28d31cb-delete_volume" released by "delete_volume" :: held 2.556s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:04 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-99ca45de-9777-4b50-af85-57c1ce87133d tempest-ProjectMemberTests-1556323482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:11:04 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-99ca45de-9777-4b50-af85-57c1ce87133d tempest-ProjectMemberTests-1556323482 None] Flow 'volume_create_manager' (3096a4db-59e9-45ba-be41-cd85fc78df4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:11:04 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-99ca45de-9777-4b50-af85-57c1ce87133d tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (628b3592-42df-4369-9839-b9ff73917cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:04 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-99ca45de-9777-4b50-af85-57c1ce87133d tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (628b3592-42df-4369-9839-b9ff73917cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:11:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1323005263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70e030cf-eddb-4d03-8967-507342ad6a62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72a0b0e3a199416698115290d71c6808',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:11:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:11:04Z,use_quota=True,user_id='8f2d7aa2b6ab4865b626b01a01acc0f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:04 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-99ca45de-9777-4b50-af85-57c1ce87133d tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b90edaee-a70d-4217-976d-be689f9aed98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:04 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-99ca45de-9777-4b50-af85-57c1ce87133d tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b90edaee-a70d-4217-976d-be689f9aed98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:04 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-99ca45de-9777-4b50-af85-57c1ce87133d tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4625be0-42b1-49c6-8492-7b487af6c26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:04 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-99ca45de-9777-4b50-af85-57c1ce87133d tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4625be0-42b1-49c6-8492-7b487af6c26a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70e030cf-eddb-4d03-8967-507342ad6a62', 'volume_name': 'volume-70e030cf-eddb-4d03-8967-507342ad6a62', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:04 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-99ca45de-9777-4b50-af85-57c1ce87133d tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (717e89fe-5db4-4282-8ec3-e02c4cc6039f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:04 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-99ca45de-9777-4b50-af85-57c1ce87133d tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (717e89fe-5db4-4282-8ec3-e02c4cc6039f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:04 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-99ca45de-9777-4b50-af85-57c1ce87133d tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba0e73ac-d184-4918-94c1-443d541e6aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:04 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-99ca45de-9777-4b50-af85-57c1ce87133d tempest-ProjectMemberTests-1556323482 None] Volume 70e030cf-eddb-4d03-8967-507342ad6a62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70e030cf-eddb-4d03-8967-507342ad6a62', 'volume_size': 1} Jul 30 17:11:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-99ca45de-9777-4b50-af85-57c1ce87133d tempest-ProjectMemberTests-1556323482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:05 devstack sudo[108315]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:05 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7ffd6a74-1a36-4442-974a-e30976f0568e tempest-VolumeDependencyTests-33890977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d08a8f36-1b3e-424a-a39d-24894a89403e /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c714adb8-bfa8-45f3-92f4-b330bc2dca5b" returned: 0 in 6.188s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:05 devstack cinder-volume[88568]: DEBUG cinder.image.image_utils [None req-7ffd6a74-1a36-4442-974a-e30976f0568e tempest-VolumeDependencyTests-33890977 None] Image conversion details: src /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d08a8f36-1b3e-424a-a39d-24894a89403e, size 1024.00 MB, duration 6.19 sec, destination /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c714adb8-bfa8-45f3-92f4-b330bc2dca5b {{(pid=88568) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 17:11:05 devstack cinder-volume[88568]: INFO cinder.image.image_utils [None req-7ffd6a74-1a36-4442-974a-e30976f0568e tempest-VolumeDependencyTests-33890977 None] Converted 1024.00 MB image at 165.46 MB/s Jul 30 17:11:05 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-7ffd6a74-1a36-4442-974a-e30976f0568e tempest-VolumeDependencyTests-33890977 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c714adb8-bfa8-45f3-92f4-b330bc2dca5b is being set with open permissions: ugo+rw Jul 30 17:11:05 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7ffd6a74-1a36-4442-974a-e30976f0568e tempest-VolumeDependencyTests-33890977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c714adb8-bfa8-45f3-92f4-b330bc2dca5b {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:05 devstack sudo[108341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c714adb8-bfa8-45f3-92f4-b330bc2dca5b Jul 30 17:11:05 devstack sudo[108341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:06 devstack sudo[108341]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7ffd6a74-1a36-4442-974a-e30976f0568e tempest-VolumeDependencyTests-33890977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c714adb8-bfa8-45f3-92f4-b330bc2dca5b" returned: 0 in 0.276s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:06 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-7ffd6a74-1a36-4442-974a-e30976f0568e tempest-VolumeDependencyTests-33890977 None] Lock "cinder-quobyte-c714adb8-bfa8-45f3-92f4-b330bc2dca5b" released by "_copy_volume_from_snapshot" :: held 7.693s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:06 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-7ffd6a74-1a36-4442-974a-e30976f0568e tempest-VolumeDependencyTests-33890977 None] Lock "cinder-quobyte-5c0b8139-5f9b-4700-a102-750ded053ad2-c714adb8-bfa8-45f3-92f4-b330bc2dca5b" released by "_create_volume_from_snapshot" :: held 7.817s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-7ffd6a74-1a36-4442-974a-e30976f0568e tempest-VolumeDependencyTests-33890977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.865s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-99ca45de-9777-4b50-af85-57c1ce87133d tempest-ProjectMemberTests-1556323482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.444s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:06 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-99ca45de-9777-4b50-af85-57c1ce87133d tempest-ProjectMemberTests-1556323482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:11:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1323005263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70e030cf-eddb-4d03-8967-507342ad6a62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72a0b0e3a199416698115290d71c6808',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:11:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:11:04Z,use_quota=True,user_id='8f2d7aa2b6ab4865b626b01a01acc0f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:11:06 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-99ca45de-9777-4b50-af85-57c1ce87133d tempest-ProjectMemberTests-1556323482 None] Creating volume 70e030cf-eddb-4d03-8967-507342ad6a62 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:11:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-99ca45de-9777-4b50-af85-57c1ce87133d tempest-ProjectMemberTests-1556323482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-99ca45de-9777-4b50-af85-57c1ce87133d tempest-ProjectMemberTests-1556323482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:06 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-99ca45de-9777-4b50-af85-57c1ce87133d tempest-ProjectMemberTests-1556323482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:11:06 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-99ca45de-9777-4b50-af85-57c1ce87133d tempest-ProjectMemberTests-1556323482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:11:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-99ca45de-9777-4b50-af85-57c1ce87133d tempest-ProjectMemberTests-1556323482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:06 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-99ca45de-9777-4b50-af85-57c1ce87133d tempest-ProjectMemberTests-1556323482 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:11:06 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-99ca45de-9777-4b50-af85-57c1ce87133d tempest-ProjectMemberTests-1556323482 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:11:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-99ca45de-9777-4b50-af85-57c1ce87133d tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-70e030cf-eddb-4d03-8967-507342ad6a62 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:06 devstack sudo[108344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-70e030cf-eddb-4d03-8967-507342ad6a62 1073741824 Jul 30 17:11:06 devstack sudo[108344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:06 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7ffd6a74-1a36-4442-974a-e30976f0568e tempest-VolumeDependencyTests-33890977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba75fd9e-7501-4ee9-aef2-fde3fd8a3dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c714adb8-bfa8-45f3-92f4-b330bc2dca5b', 'volume_size': 1, 'snapshot_id': '5c0b8139-5f9b-4700-a102-750ded053ad2'}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:06 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7ffd6a74-1a36-4442-974a-e30976f0568e tempest-VolumeDependencyTests-33890977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dabd83ba-b828-43dc-adad-e1b13f9b1e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:06 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-7ffd6a74-1a36-4442-974a-e30976f0568e tempest-VolumeDependencyTests-33890977 None] Volume volume-c714adb8-bfa8-45f3-92f4-b330bc2dca5b (c714adb8-bfa8-45f3-92f4-b330bc2dca5b): created successfully Jul 30 17:11:06 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7ffd6a74-1a36-4442-974a-e30976f0568e tempest-VolumeDependencyTests-33890977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dabd83ba-b828-43dc-adad-e1b13f9b1e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:06 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7ffd6a74-1a36-4442-974a-e30976f0568e tempest-VolumeDependencyTests-33890977 None] Flow 'volume_create_manager' (0a1463ef-84cc-4a44-9c2d-f497d24c677d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:11:06 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-7ffd6a74-1a36-4442-974a-e30976f0568e tempest-VolumeDependencyTests-33890977 None] Created volume successfully. Jul 30 17:11:06 devstack sudo[108344]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-99ca45de-9777-4b50-af85-57c1ce87133d tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-70e030cf-eddb-4d03-8967-507342ad6a62 1073741824" returned: 0 in 0.534s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:06 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-5efab18e-3e53-4079-b6e5-802517a3225a tempest-ProjectReaderTests-951549516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:11:06 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-5efab18e-3e53-4079-b6e5-802517a3225a tempest-ProjectReaderTests-951549516 None] Flow 'volume_create_manager' (c033ac0c-3633-4450-923b-de6a83650f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:11:06 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-5efab18e-3e53-4079-b6e5-802517a3225a tempest-ProjectReaderTests-951549516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (498a5355-0ada-439b-bce4-f25865eb1fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-99ca45de-9777-4b50-af85-57c1ce87133d tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-70e030cf-eddb-4d03-8967-507342ad6a62 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:06 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-5efab18e-3e53-4079-b6e5-802517a3225a tempest-ProjectReaderTests-951549516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (498a5355-0ada-439b-bce4-f25865eb1fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:11:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-320348985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06879016-ffba-4b03-b8ff-3805ed9c344f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8da42f52b5744b69919cd88f60236365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:11:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:11:07Z,use_quota=True,user_id='48aa3aa08a444121a7d4b6d51cee1fa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:06 devstack sudo[108350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-70e030cf-eddb-4d03-8967-507342ad6a62 Jul 30 17:11:06 devstack sudo[108350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:06 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-5efab18e-3e53-4079-b6e5-802517a3225a tempest-ProjectReaderTests-951549516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbf3c785-bf07-45e3-a85b-e47b52ff3590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:06 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-5efab18e-3e53-4079-b6e5-802517a3225a tempest-ProjectReaderTests-951549516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbf3c785-bf07-45e3-a85b-e47b52ff3590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:06 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-5efab18e-3e53-4079-b6e5-802517a3225a tempest-ProjectReaderTests-951549516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8991f670-102c-4859-90e6-7e8843050238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:06 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-5efab18e-3e53-4079-b6e5-802517a3225a tempest-ProjectReaderTests-951549516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8991f670-102c-4859-90e6-7e8843050238) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06879016-ffba-4b03-b8ff-3805ed9c344f', 'volume_name': 'volume-06879016-ffba-4b03-b8ff-3805ed9c344f', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:06 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-5efab18e-3e53-4079-b6e5-802517a3225a tempest-ProjectReaderTests-951549516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90b8ae02-719e-45c2-b83c-8d96aaa0ab16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:06 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-5efab18e-3e53-4079-b6e5-802517a3225a tempest-ProjectReaderTests-951549516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90b8ae02-719e-45c2-b83c-8d96aaa0ab16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:06 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-5efab18e-3e53-4079-b6e5-802517a3225a tempest-ProjectReaderTests-951549516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9f9f912-3243-4c85-881d-80e86153113a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:06 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-5efab18e-3e53-4079-b6e5-802517a3225a tempest-ProjectReaderTests-951549516 None] Volume 06879016-ffba-4b03-b8ff-3805ed9c344f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06879016-ffba-4b03-b8ff-3805ed9c344f', 'volume_size': 1} Jul 30 17:11:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-5efab18e-3e53-4079-b6e5-802517a3225a tempest-ProjectReaderTests-951549516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:06 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-43dabebc-cf7d-4846-bb3e-90fd4b270f3d tempest-VolumeDependencyTests-33890977 None] Acquiring lock "cinder-5c0b8139-5f9b-4700-a102-750ded053ad2-delete_snapshot" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:07 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-43dabebc-cf7d-4846-bb3e-90fd4b270f3d tempest-VolumeDependencyTests-33890977 None] Lock "cinder-5c0b8139-5f9b-4700-a102-750ded053ad2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:07 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-43dabebc-cf7d-4846-bb3e-90fd4b270f3d tempest-VolumeDependencyTests-33890977 None] Acquiring lock "cinder-quobyte-d08a8f36-1b3e-424a-a39d-24894a89403e" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:07 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-43dabebc-cf7d-4846-bb3e-90fd4b270f3d tempest-VolumeDependencyTests-33890977 None] Lock "cinder-quobyte-d08a8f36-1b3e-424a-a39d-24894a89403e" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:07 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-43dabebc-cf7d-4846-bb3e-90fd4b270f3d tempest-VolumeDependencyTests-33890977 None] Acquiring lock "cinder-quobyte-5c0b8139-5f9b-4700-a102-750ded053ad2" by "_delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:07 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-43dabebc-cf7d-4846-bb3e-90fd4b270f3d tempest-VolumeDependencyTests-33890977 None] Lock "cinder-quobyte-5c0b8139-5f9b-4700-a102-750ded053ad2" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:07 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-43dabebc-cf7d-4846-bb3e-90fd4b270f3d tempest-VolumeDependencyTests-33890977 None] Deleting offline snapshot 5c0b8139-5f9b-4700-a102-750ded053ad2 of volume d08a8f36-1b3e-424a-a39d-24894a89403e {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:11:07 devstack sudo[108350]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:07 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-43dabebc-cf7d-4846-bb3e-90fd4b270f3d tempest-VolumeDependencyTests-33890977 None] snapshot_file for this snap is: volume-d08a8f36-1b3e-424a-a39d-24894a89403e.5c0b8139-5f9b-4700-a102-750ded053ad2 {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:11:07 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-99ca45de-9777-4b50-af85-57c1ce87133d tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-70e030cf-eddb-4d03-8967-507342ad6a62" returned: 0 in 0.307s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:07 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-99ca45de-9777-4b50-af85-57c1ce87133d tempest-ProjectMemberTests-1556323482 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:11:07 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-99ca45de-9777-4b50-af85-57c1ce87133d tempest-ProjectMemberTests-1556323482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:07 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-5efab18e-3e53-4079-b6e5-802517a3225a tempest-ProjectReaderTests-951549516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.249s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:07 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-5efab18e-3e53-4079-b6e5-802517a3225a tempest-ProjectReaderTests-951549516 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:11:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-320348985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06879016-ffba-4b03-b8ff-3805ed9c344f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8da42f52b5744b69919cd88f60236365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:11:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:11:07Z,use_quota=True,user_id='48aa3aa08a444121a7d4b6d51cee1fa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:11:07 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-5efab18e-3e53-4079-b6e5-802517a3225a tempest-ProjectReaderTests-951549516 None] Creating volume 06879016-ffba-4b03-b8ff-3805ed9c344f {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:11:07 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-5efab18e-3e53-4079-b6e5-802517a3225a tempest-ProjectReaderTests-951549516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:07 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-5efab18e-3e53-4079-b6e5-802517a3225a tempest-ProjectReaderTests-951549516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:07 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-5efab18e-3e53-4079-b6e5-802517a3225a tempest-ProjectReaderTests-951549516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:11:07 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-5efab18e-3e53-4079-b6e5-802517a3225a tempest-ProjectReaderTests-951549516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:11:07 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-5efab18e-3e53-4079-b6e5-802517a3225a tempest-ProjectReaderTests-951549516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:07 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-5efab18e-3e53-4079-b6e5-802517a3225a tempest-ProjectReaderTests-951549516 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:11:07 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-5efab18e-3e53-4079-b6e5-802517a3225a tempest-ProjectReaderTests-951549516 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:11:07 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-5efab18e-3e53-4079-b6e5-802517a3225a tempest-ProjectReaderTests-951549516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-06879016-ffba-4b03-b8ff-3805ed9c344f 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:07 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd17b38c-26b0-4b50-b99b-15bc2fd7f0ab]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:11:07 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-43dabebc-cf7d-4846-bb3e-90fd4b270f3d tempest-VolumeDependencyTests-33890977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d08a8f36-1b3e-424a-a39d-24894a89403e.5c0b8139-5f9b-4700-a102-750ded053ad2 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:07 devstack sudo[108353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-06879016-ffba-4b03-b8ff-3805ed9c344f 1073741824 Jul 30 17:11:07 devstack sudo[108353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:07 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-99ca45de-9777-4b50-af85-57c1ce87133d tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba0e73ac-d184-4918-94c1-443d541e6aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70e030cf-eddb-4d03-8967-507342ad6a62', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:07 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-99ca45de-9777-4b50-af85-57c1ce87133d tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8c93584-2d8c-4896-9a41-9983d44849e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:07 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-99ca45de-9777-4b50-af85-57c1ce87133d tempest-ProjectMemberTests-1556323482 None] Volume volume-70e030cf-eddb-4d03-8967-507342ad6a62 (70e030cf-eddb-4d03-8967-507342ad6a62): created successfully Jul 30 17:11:07 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-99ca45de-9777-4b50-af85-57c1ce87133d tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8c93584-2d8c-4896-9a41-9983d44849e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:07 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-99ca45de-9777-4b50-af85-57c1ce87133d tempest-ProjectMemberTests-1556323482 None] Flow 'volume_create_manager' (3096a4db-59e9-45ba-be41-cd85fc78df4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:11:07 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-99ca45de-9777-4b50-af85-57c1ce87133d tempest-ProjectMemberTests-1556323482 None] Created volume successfully. Jul 30 17:11:07 devstack sudo[108354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d08a8f36-1b3e-424a-a39d-24894a89403e.5c0b8139-5f9b-4700-a102-750ded053ad2 Jul 30 17:11:07 devstack sudo[108354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:07 devstack sudo[108354]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:07 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-43dabebc-cf7d-4846-bb3e-90fd4b270f3d tempest-VolumeDependencyTests-33890977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d08a8f36-1b3e-424a-a39d-24894a89403e.5c0b8139-5f9b-4700-a102-750ded053ad2" returned: 0 in 0.419s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:07 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-43dabebc-cf7d-4846-bb3e-90fd4b270f3d tempest-VolumeDependencyTests-33890977 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d08a8f36-1b3e-424a-a39d-24894a89403e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:11:07 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f63e222-fae0-48e2-8132-a01d90291b1a]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:11:07 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-43dabebc-cf7d-4846-bb3e-90fd4b270f3d tempest-VolumeDependencyTests-33890977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d08a8f36-1b3e-424a-a39d-24894a89403e {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:07 devstack sudo[108353]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:07 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-5efab18e-3e53-4079-b6e5-802517a3225a tempest-ProjectReaderTests-951549516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-06879016-ffba-4b03-b8ff-3805ed9c344f 1073741824" returned: 0 in 0.497s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:07 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-5efab18e-3e53-4079-b6e5-802517a3225a tempest-ProjectReaderTests-951549516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-06879016-ffba-4b03-b8ff-3805ed9c344f {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:07 devstack sudo[108365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-06879016-ffba-4b03-b8ff-3805ed9c344f Jul 30 17:11:07 devstack sudo[108365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:07 devstack sudo[108364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d08a8f36-1b3e-424a-a39d-24894a89403e Jul 30 17:11:07 devstack sudo[108364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:07 devstack sudo[108365]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:07 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-5efab18e-3e53-4079-b6e5-802517a3225a tempest-ProjectReaderTests-951549516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-06879016-ffba-4b03-b8ff-3805ed9c344f" returned: 0 in 0.277s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:07 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-5efab18e-3e53-4079-b6e5-802517a3225a tempest-ProjectReaderTests-951549516 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:11:07 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-5efab18e-3e53-4079-b6e5-802517a3225a tempest-ProjectReaderTests-951549516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:07 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-5efab18e-3e53-4079-b6e5-802517a3225a tempest-ProjectReaderTests-951549516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9f9f912-3243-4c85-881d-80e86153113a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06879016-ffba-4b03-b8ff-3805ed9c344f', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:07 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-5efab18e-3e53-4079-b6e5-802517a3225a tempest-ProjectReaderTests-951549516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2918dae3-bd4c-40ac-8d10-d5ce2fad9327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:07 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-5efab18e-3e53-4079-b6e5-802517a3225a tempest-ProjectReaderTests-951549516 None] Volume volume-06879016-ffba-4b03-b8ff-3805ed9c344f (06879016-ffba-4b03-b8ff-3805ed9c344f): created successfully Jul 30 17:11:07 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-5efab18e-3e53-4079-b6e5-802517a3225a tempest-ProjectReaderTests-951549516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2918dae3-bd4c-40ac-8d10-d5ce2fad9327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:07 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-5efab18e-3e53-4079-b6e5-802517a3225a tempest-ProjectReaderTests-951549516 None] Flow 'volume_create_manager' (c033ac0c-3633-4450-923b-de6a83650f69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:11:08 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-5efab18e-3e53-4079-b6e5-802517a3225a tempest-ProjectReaderTests-951549516 None] Created volume successfully. Jul 30 17:11:08 devstack sudo[108364]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:08 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-43dabebc-cf7d-4846-bb3e-90fd4b270f3d tempest-VolumeDependencyTests-33890977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d08a8f36-1b3e-424a-a39d-24894a89403e" returned: 0 in 0.628s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:08 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-43dabebc-cf7d-4846-bb3e-90fd4b270f3d tempest-VolumeDependencyTests-33890977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d08a8f36-1b3e-424a-a39d-24894a89403e.5c0b8139-5f9b-4700-a102-750ded053ad2 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:08 devstack sudo[108372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d08a8f36-1b3e-424a-a39d-24894a89403e.5c0b8139-5f9b-4700-a102-750ded053ad2 Jul 30 17:11:08 devstack sudo[108372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:08 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-3bbd5d9a-2225-419f-a1a8-785cf20fb16b tempest-ProjectMemberTests-1556323482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:08 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-3bbd5d9a-2225-419f-a1a8-785cf20fb16b tempest-ProjectMemberTests-1556323482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:08 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-3bbd5d9a-2225-419f-a1a8-785cf20fb16b tempest-ProjectMemberTests-1556323482 None] Creating offline snapshot d117556d-b5be-4c1f-8cdf-8512c3bb9118 of volume 70e030cf-eddb-4d03-8967-507342ad6a62 {{(pid=88568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:11:08 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[5796786d-14d7-4663-8a1c-727c7e8712fa]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:11:08 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-3bbd5d9a-2225-419f-a1a8-785cf20fb16b tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-70e030cf-eddb-4d03-8967-507342ad6a62 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:08 devstack sudo[108374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-70e030cf-eddb-4d03-8967-507342ad6a62 Jul 30 17:11:08 devstack sudo[108374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:08 devstack sudo[108372]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:08 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-43dabebc-cf7d-4846-bb3e-90fd4b270f3d tempest-VolumeDependencyTests-33890977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d08a8f36-1b3e-424a-a39d-24894a89403e.5c0b8139-5f9b-4700-a102-750ded053ad2" returned: 0 in 0.385s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:08 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-43dabebc-cf7d-4846-bb3e-90fd4b270f3d tempest-VolumeDependencyTests-33890977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d08a8f36-1b3e-424a-a39d-24894a89403e.5c0b8139-5f9b-4700-a102-750ded053ad2 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:08 devstack sudo[108379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d08a8f36-1b3e-424a-a39d-24894a89403e.5c0b8139-5f9b-4700-a102-750ded053ad2 Jul 30 17:11:08 devstack sudo[108379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:08 devstack sudo[108374]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:08 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-3bbd5d9a-2225-419f-a1a8-785cf20fb16b tempest-ProjectMemberTests-1556323482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-70e030cf-eddb-4d03-8967-507342ad6a62" returned: 0 in 0.428s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:08 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-3bbd5d9a-2225-419f-a1a8-785cf20fb16b tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-70e030cf-eddb-4d03-8967-507342ad6a62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-70e030cf-eddb-4d03-8967-507342ad6a62.d117556d-b5be-4c1f-8cdf-8512c3bb9118 1G {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:08 devstack sudo[108384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-70e030cf-eddb-4d03-8967-507342ad6a62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-70e030cf-eddb-4d03-8967-507342ad6a62.d117556d-b5be-4c1f-8cdf-8512c3bb9118 1G Jul 30 17:11:08 devstack sudo[108384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:08 devstack sudo[108379]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:08 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-43dabebc-cf7d-4846-bb3e-90fd4b270f3d tempest-VolumeDependencyTests-33890977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d08a8f36-1b3e-424a-a39d-24894a89403e.5c0b8139-5f9b-4700-a102-750ded053ad2" returned: 0 in 0.309s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:08 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-43dabebc-cf7d-4846-bb3e-90fd4b270f3d tempest-VolumeDependencyTests-33890977 None] Lock "cinder-quobyte-5c0b8139-5f9b-4700-a102-750ded053ad2" released by "_delete_snapshot" :: held 1.904s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:08 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-43dabebc-cf7d-4846-bb3e-90fd4b270f3d tempest-VolumeDependencyTests-33890977 None] Lock "cinder-quobyte-d08a8f36-1b3e-424a-a39d-24894a89403e" released by "delete_snapshot" :: held 1.935s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:09 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-fe35b154-28bd-4a54-a3d5-eada8b8dd54f tempest-ProjectReaderTests-951549516 None] Acquiring lock "cinder-06879016-ffba-4b03-b8ff-3805ed9c344f-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:09 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-43dabebc-cf7d-4846-bb3e-90fd4b270f3d tempest-VolumeDependencyTests-33890977 None] Created reservations ['762c0a61-9a4a-472c-8a33-d8d207a89a98', '2ba5b43b-d237-400c-ad8a-b5f5ca57bf59', 'b115197d-952a-44d7-a948-6455eb053287', '634d41ad-1199-4150-98ea-c973dbeede4f'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:11:09 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-fe35b154-28bd-4a54-a3d5-eada8b8dd54f tempest-ProjectReaderTests-951549516 None] Lock "cinder-06879016-ffba-4b03-b8ff-3805ed9c344f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:09 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-fe35b154-28bd-4a54-a3d5-eada8b8dd54f tempest-ProjectReaderTests-951549516 None] Acquiring lock "cinder-quobyte-06879016-ffba-4b03-b8ff-3805ed9c344f" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:09 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-fe35b154-28bd-4a54-a3d5-eada8b8dd54f tempest-ProjectReaderTests-951549516 None] Lock "cinder-quobyte-06879016-ffba-4b03-b8ff-3805ed9c344f" acquired by "delete_volume" :: waited 0.019s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:09 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[d88392b4-9388-4bb1-b321-2d9c39ace8a6]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:11:09 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fe35b154-28bd-4a54-a3d5-eada8b8dd54f tempest-ProjectReaderTests-951549516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-06879016-ffba-4b03-b8ff-3805ed9c344f {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:09 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-43dabebc-cf7d-4846-bb3e-90fd4b270f3d tempest-VolumeDependencyTests-33890977 None] Delete snapshot completed successfully. Jul 30 17:11:09 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-43dabebc-cf7d-4846-bb3e-90fd4b270f3d tempest-VolumeDependencyTests-33890977 None] Lock "cinder-5c0b8139-5f9b-4700-a102-750ded053ad2-delete_snapshot" released by "delete_snapshot" :: held 2.242s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:09 devstack sudo[108384]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:09 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-3bbd5d9a-2225-419f-a1a8-785cf20fb16b tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-70e030cf-eddb-4d03-8967-507342ad6a62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-70e030cf-eddb-4d03-8967-507342ad6a62.d117556d-b5be-4c1f-8cdf-8512c3bb9118 1G" returned: 0 in 0.527s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:09 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-3bbd5d9a-2225-419f-a1a8-785cf20fb16b tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70e030cf-eddb-4d03-8967-507342ad6a62 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-70e030cf-eddb-4d03-8967-507342ad6a62.d117556d-b5be-4c1f-8cdf-8512c3bb9118 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:09 devstack sudo[108392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70e030cf-eddb-4d03-8967-507342ad6a62 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-70e030cf-eddb-4d03-8967-507342ad6a62.d117556d-b5be-4c1f-8cdf-8512c3bb9118 Jul 30 17:11:09 devstack sudo[108392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:09 devstack sudo[108391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-06879016-ffba-4b03-b8ff-3805ed9c344f Jul 30 17:11:09 devstack sudo[108391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:09 devstack sudo[108392]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:09 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-3bbd5d9a-2225-419f-a1a8-785cf20fb16b tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70e030cf-eddb-4d03-8967-507342ad6a62 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-70e030cf-eddb-4d03-8967-507342ad6a62.d117556d-b5be-4c1f-8cdf-8512c3bb9118" returned: 0 in 0.320s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:09 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-3bbd5d9a-2225-419f-a1a8-785cf20fb16b tempest-ProjectMemberTests-1556323482 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-70e030cf-eddb-4d03-8967-507342ad6a62.d117556d-b5be-4c1f-8cdf-8512c3bb9118 is being set with open permissions: ugo+rw Jul 30 17:11:09 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-3bbd5d9a-2225-419f-a1a8-785cf20fb16b tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-70e030cf-eddb-4d03-8967-507342ad6a62.d117556d-b5be-4c1f-8cdf-8512c3bb9118 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:09 devstack sudo[108391]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:09 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fe35b154-28bd-4a54-a3d5-eada8b8dd54f tempest-ProjectReaderTests-951549516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-06879016-ffba-4b03-b8ff-3805ed9c344f" returned: 0 in 0.418s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:09 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fe35b154-28bd-4a54-a3d5-eada8b8dd54f tempest-ProjectReaderTests-951549516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-06879016-ffba-4b03-b8ff-3805ed9c344f {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:09 devstack sudo[108401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-70e030cf-eddb-4d03-8967-507342ad6a62.d117556d-b5be-4c1f-8cdf-8512c3bb9118 Jul 30 17:11:09 devstack sudo[108401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:09 devstack sudo[108402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-06879016-ffba-4b03-b8ff-3805ed9c344f Jul 30 17:11:09 devstack sudo[108402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:09 devstack sudo[108401]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:09 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-3bbd5d9a-2225-419f-a1a8-785cf20fb16b tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-70e030cf-eddb-4d03-8967-507342ad6a62.d117556d-b5be-4c1f-8cdf-8512c3bb9118" returned: 0 in 0.297s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:09 devstack sudo[108402]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:09 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fe35b154-28bd-4a54-a3d5-eada8b8dd54f tempest-ProjectReaderTests-951549516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-06879016-ffba-4b03-b8ff-3805ed9c344f" returned: 0 in 0.289s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:09 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-fe35b154-28bd-4a54-a3d5-eada8b8dd54f tempest-ProjectReaderTests-951549516 None] Lock "cinder-quobyte-06879016-ffba-4b03-b8ff-3805ed9c344f" released by "delete_volume" :: held 0.755s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:09 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-3bbd5d9a-2225-419f-a1a8-785cf20fb16b tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-70e030cf-eddb-4d03-8967-507342ad6a62.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:10 devstack sudo[108407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-70e030cf-eddb-4d03-8967-507342ad6a62.info Jul 30 17:11:10 devstack sudo[108407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:10 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-fe35b154-28bd-4a54-a3d5-eada8b8dd54f tempest-ProjectReaderTests-951549516 None] Created reservations ['04f2bf6a-1235-44b0-a122-6075edf6afdc', 'a721d60e-eebe-4ea0-a992-3312a0c93810', 'add4bb84-9b2a-429b-bc52-c6a35adebdc3', '5530d81d-4120-4496-a369-9e1764934544'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:11:10 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-fe35b154-28bd-4a54-a3d5-eada8b8dd54f tempest-ProjectReaderTests-951549516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:10 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-fe35b154-28bd-4a54-a3d5-eada8b8dd54f tempest-ProjectReaderTests-951549516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:10 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-fe35b154-28bd-4a54-a3d5-eada8b8dd54f tempest-ProjectReaderTests-951549516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:11:10 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-fe35b154-28bd-4a54-a3d5-eada8b8dd54f tempest-ProjectReaderTests-951549516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:11:10 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-fe35b154-28bd-4a54-a3d5-eada8b8dd54f tempest-ProjectReaderTests-951549516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:10 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fe35b154-28bd-4a54-a3d5-eada8b8dd54f tempest-ProjectReaderTests-951549516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:10 devstack sudo[108410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:11:10 devstack sudo[108410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:10 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-e534cc25-0c79-46a8-a009-285a12dce7f9 tempest-VolumeDependencyTests-33890977 None] Acquiring lock "cinder-d08a8f36-1b3e-424a-a39d-24894a89403e-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:10 devstack sudo[108407]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:10 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-e534cc25-0c79-46a8-a009-285a12dce7f9 tempest-VolumeDependencyTests-33890977 None] Lock "cinder-d08a8f36-1b3e-424a-a39d-24894a89403e-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:10 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-3bbd5d9a-2225-419f-a1a8-785cf20fb16b tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-70e030cf-eddb-4d03-8967-507342ad6a62.info" returned: 0 in 0.345s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:10 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-3bbd5d9a-2225-419f-a1a8-785cf20fb16b tempest-ProjectMemberTests-1556323482 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-70e030cf-eddb-4d03-8967-507342ad6a62.info is being set with open permissions: ugo+rw Jul 30 17:11:10 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-3bbd5d9a-2225-419f-a1a8-785cf20fb16b tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-70e030cf-eddb-4d03-8967-507342ad6a62.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:10 devstack sudo[108414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-70e030cf-eddb-4d03-8967-507342ad6a62.info Jul 30 17:11:10 devstack sudo[108414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:10 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-e534cc25-0c79-46a8-a009-285a12dce7f9 tempest-VolumeDependencyTests-33890977 None] Acquiring lock "cinder-quobyte-d08a8f36-1b3e-424a-a39d-24894a89403e" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:10 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-e534cc25-0c79-46a8-a009-285a12dce7f9 tempest-VolumeDependencyTests-33890977 None] Lock "cinder-quobyte-d08a8f36-1b3e-424a-a39d-24894a89403e" acquired by "delete_volume" :: waited 0.026s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:10 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f7ef4e-e70d-4072-9f65-8cf53e77c22e]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:11:10 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e534cc25-0c79-46a8-a009-285a12dce7f9 tempest-VolumeDependencyTests-33890977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d08a8f36-1b3e-424a-a39d-24894a89403e {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:10 devstack sudo[108410]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:10 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fe35b154-28bd-4a54-a3d5-eada8b8dd54f tempest-ProjectReaderTests-951549516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.582s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:10 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-fe35b154-28bd-4a54-a3d5-eada8b8dd54f tempest-ProjectReaderTests-951549516 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:11:10 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-fe35b154-28bd-4a54-a3d5-eada8b8dd54f tempest-ProjectReaderTests-951549516 None] Deleted volume successfully. Jul 30 17:11:10 devstack sudo[108414]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:10 devstack sudo[108416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d08a8f36-1b3e-424a-a39d-24894a89403e Jul 30 17:11:10 devstack sudo[108416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:10 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-3bbd5d9a-2225-419f-a1a8-785cf20fb16b tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-70e030cf-eddb-4d03-8967-507342ad6a62.info" returned: 0 in 0.436s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:10 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-3bbd5d9a-2225-419f-a1a8-785cf20fb16b tempest-ProjectMemberTests-1556323482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.470s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:10 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-fe35b154-28bd-4a54-a3d5-eada8b8dd54f tempest-ProjectReaderTests-951549516 None] Lock "cinder-06879016-ffba-4b03-b8ff-3805ed9c344f-delete_volume" released by "delete_volume" :: held 1.700s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:10 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-3bbd5d9a-2225-419f-a1a8-785cf20fb16b tempest-ProjectMemberTests-1556323482 None] Create snapshot completed successfully Jul 30 17:11:11 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-93d6da83-3541-4d67-a2f5-34899721c882 tempest-ProjectReaderTests-951549516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:11:11 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-93d6da83-3541-4d67-a2f5-34899721c882 tempest-ProjectReaderTests-951549516 None] Flow 'volume_create_manager' (50027953-b9e4-4f24-8028-c73d52f7b3bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:11:11 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-93d6da83-3541-4d67-a2f5-34899721c882 tempest-ProjectReaderTests-951549516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f83c67d5-b7e3-47ab-adba-c2e0f9959811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:11 devstack sudo[108416]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e534cc25-0c79-46a8-a009-285a12dce7f9 tempest-VolumeDependencyTests-33890977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d08a8f36-1b3e-424a-a39d-24894a89403e" returned: 0 in 0.582s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e534cc25-0c79-46a8-a009-285a12dce7f9 tempest-VolumeDependencyTests-33890977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d08a8f36-1b3e-424a-a39d-24894a89403e {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:11 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-93d6da83-3541-4d67-a2f5-34899721c882 tempest-ProjectReaderTests-951549516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f83c67d5-b7e3-47ab-adba-c2e0f9959811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:11:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1171657433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0aa912a9-658d-499e-be97-cf11d3a1c74a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8da42f52b5744b69919cd88f60236365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:11:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:11:11Z,use_quota=True,user_id='48aa3aa08a444121a7d4b6d51cee1fa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:11 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-93d6da83-3541-4d67-a2f5-34899721c882 tempest-ProjectReaderTests-951549516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c06b0a2-d2f6-473a-a3db-5a891d0e438b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:11 devstack sudo[108423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d08a8f36-1b3e-424a-a39d-24894a89403e Jul 30 17:11:11 devstack sudo[108423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:11 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-93d6da83-3541-4d67-a2f5-34899721c882 tempest-ProjectReaderTests-951549516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c06b0a2-d2f6-473a-a3db-5a891d0e438b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:11 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-93d6da83-3541-4d67-a2f5-34899721c882 tempest-ProjectReaderTests-951549516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41c28b2f-53b4-4c66-8388-a86517a6ece5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:11 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-93d6da83-3541-4d67-a2f5-34899721c882 tempest-ProjectReaderTests-951549516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41c28b2f-53b4-4c66-8388-a86517a6ece5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0aa912a9-658d-499e-be97-cf11d3a1c74a', 'volume_name': 'volume-0aa912a9-658d-499e-be97-cf11d3a1c74a', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:11 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-93d6da83-3541-4d67-a2f5-34899721c882 tempest-ProjectReaderTests-951549516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f2a0ddc-0e5f-4bad-9a43-9b02bc0ef54a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:11 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-93d6da83-3541-4d67-a2f5-34899721c882 tempest-ProjectReaderTests-951549516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f2a0ddc-0e5f-4bad-9a43-9b02bc0ef54a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:11 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-93d6da83-3541-4d67-a2f5-34899721c882 tempest-ProjectReaderTests-951549516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c840abc7-8fd8-499e-92cc-479b92ab5ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:11 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-93d6da83-3541-4d67-a2f5-34899721c882 tempest-ProjectReaderTests-951549516 None] Volume 0aa912a9-658d-499e-be97-cf11d3a1c74a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0aa912a9-658d-499e-be97-cf11d3a1c74a', 'volume_size': 1} Jul 30 17:11:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-93d6da83-3541-4d67-a2f5-34899721c882 tempest-ProjectReaderTests-951549516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-93d6da83-3541-4d67-a2f5-34899721c882 tempest-ProjectReaderTests-951549516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:11 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-93d6da83-3541-4d67-a2f5-34899721c882 tempest-ProjectReaderTests-951549516 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:11:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1171657433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0aa912a9-658d-499e-be97-cf11d3a1c74a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8da42f52b5744b69919cd88f60236365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:11:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:11:11Z,use_quota=True,user_id='48aa3aa08a444121a7d4b6d51cee1fa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:11:11 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-93d6da83-3541-4d67-a2f5-34899721c882 tempest-ProjectReaderTests-951549516 None] Creating volume 0aa912a9-658d-499e-be97-cf11d3a1c74a {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:11:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-93d6da83-3541-4d67-a2f5-34899721c882 tempest-ProjectReaderTests-951549516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-93d6da83-3541-4d67-a2f5-34899721c882 tempest-ProjectReaderTests-951549516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:11 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-93d6da83-3541-4d67-a2f5-34899721c882 tempest-ProjectReaderTests-951549516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:11:11 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-93d6da83-3541-4d67-a2f5-34899721c882 tempest-ProjectReaderTests-951549516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:11:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-93d6da83-3541-4d67-a2f5-34899721c882 tempest-ProjectReaderTests-951549516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:11 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-93d6da83-3541-4d67-a2f5-34899721c882 tempest-ProjectReaderTests-951549516 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:11:11 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-93d6da83-3541-4d67-a2f5-34899721c882 tempest-ProjectReaderTests-951549516 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:11:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-93d6da83-3541-4d67-a2f5-34899721c882 tempest-ProjectReaderTests-951549516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0aa912a9-658d-499e-be97-cf11d3a1c74a 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:11 devstack sudo[108425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0aa912a9-658d-499e-be97-cf11d3a1c74a 1073741824 Jul 30 17:11:11 devstack sudo[108425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:11 devstack sudo[108423]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e534cc25-0c79-46a8-a009-285a12dce7f9 tempest-VolumeDependencyTests-33890977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d08a8f36-1b3e-424a-a39d-24894a89403e" returned: 0 in 0.380s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:11 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-e534cc25-0c79-46a8-a009-285a12dce7f9 tempest-VolumeDependencyTests-33890977 None] Lock "cinder-quobyte-d08a8f36-1b3e-424a-a39d-24894a89403e" released by "delete_volume" :: held 1.076s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:11 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-9fc47d79-5816-4ece-ab26-aa057876430a tempest-ProjectMemberTests-1556323482 None] Acquiring lock "cinder-d117556d-b5be-4c1f-8cdf-8512c3bb9118-delete_snapshot" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:11 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-9fc47d79-5816-4ece-ab26-aa057876430a tempest-ProjectMemberTests-1556323482 None] Lock "cinder-d117556d-b5be-4c1f-8cdf-8512c3bb9118-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:11 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-9fc47d79-5816-4ece-ab26-aa057876430a tempest-ProjectMemberTests-1556323482 None] Acquiring lock "cinder-quobyte-70e030cf-eddb-4d03-8967-507342ad6a62" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:11 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-9fc47d79-5816-4ece-ab26-aa057876430a tempest-ProjectMemberTests-1556323482 None] Lock "cinder-quobyte-70e030cf-eddb-4d03-8967-507342ad6a62" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:11 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-9fc47d79-5816-4ece-ab26-aa057876430a tempest-ProjectMemberTests-1556323482 None] Acquiring lock "cinder-quobyte-d117556d-b5be-4c1f-8cdf-8512c3bb9118" by "_delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:11 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-e534cc25-0c79-46a8-a009-285a12dce7f9 tempest-VolumeDependencyTests-33890977 None] Created reservations ['ad387e76-2c98-4878-8315-bb09da7e5314', '226ca884-66bf-46d4-abc6-a27e2ad504fb', '7aa4ac6f-fcd7-41a6-912e-892686c4b707', 'dabcfb23-b997-418d-9a9a-fd064aae8566'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:11:11 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-9fc47d79-5816-4ece-ab26-aa057876430a tempest-ProjectMemberTests-1556323482 None] Lock "cinder-quobyte-d117556d-b5be-4c1f-8cdf-8512c3bb9118" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:11 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-9fc47d79-5816-4ece-ab26-aa057876430a tempest-ProjectMemberTests-1556323482 None] Deleting offline snapshot d117556d-b5be-4c1f-8cdf-8512c3bb9118 of volume 70e030cf-eddb-4d03-8967-507342ad6a62 {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:11:11 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-9fc47d79-5816-4ece-ab26-aa057876430a tempest-ProjectMemberTests-1556323482 None] snapshot_file for this snap is: volume-70e030cf-eddb-4d03-8967-507342ad6a62.d117556d-b5be-4c1f-8cdf-8512c3bb9118 {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:11:11 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7bc0281-5aba-4715-919e-139b68ec0012]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:11:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9fc47d79-5816-4ece-ab26-aa057876430a tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-70e030cf-eddb-4d03-8967-507342ad6a62.d117556d-b5be-4c1f-8cdf-8512c3bb9118 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-e534cc25-0c79-46a8-a009-285a12dce7f9 tempest-VolumeDependencyTests-33890977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-e534cc25-0c79-46a8-a009-285a12dce7f9 tempest-VolumeDependencyTests-33890977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:11 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-e534cc25-0c79-46a8-a009-285a12dce7f9 tempest-VolumeDependencyTests-33890977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:11:11 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-e534cc25-0c79-46a8-a009-285a12dce7f9 tempest-VolumeDependencyTests-33890977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:11:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-e534cc25-0c79-46a8-a009-285a12dce7f9 tempest-VolumeDependencyTests-33890977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e534cc25-0c79-46a8-a009-285a12dce7f9 tempest-VolumeDependencyTests-33890977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:11 devstack sudo[108425]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-93d6da83-3541-4d67-a2f5-34899721c882 tempest-ProjectReaderTests-951549516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0aa912a9-658d-499e-be97-cf11d3a1c74a 1073741824" returned: 0 in 0.607s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:11 devstack sudo[108433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:11:11 devstack sudo[108433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:11 devstack sudo[108432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-70e030cf-eddb-4d03-8967-507342ad6a62.d117556d-b5be-4c1f-8cdf-8512c3bb9118 Jul 30 17:11:11 devstack sudo[108432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-93d6da83-3541-4d67-a2f5-34899721c882 tempest-ProjectReaderTests-951549516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0aa912a9-658d-499e-be97-cf11d3a1c74a {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:11 devstack sudo[108436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0aa912a9-658d-499e-be97-cf11d3a1c74a Jul 30 17:11:11 devstack sudo[108436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:12 devstack sudo[108433]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e534cc25-0c79-46a8-a009-285a12dce7f9 tempest-VolumeDependencyTests-33890977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.340s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:12 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-e534cc25-0c79-46a8-a009-285a12dce7f9 tempest-VolumeDependencyTests-33890977 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:11:12 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-e534cc25-0c79-46a8-a009-285a12dce7f9 tempest-VolumeDependencyTests-33890977 None] Deleted volume successfully. Jul 30 17:11:12 devstack sudo[108432]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9fc47d79-5816-4ece-ab26-aa057876430a tempest-ProjectMemberTests-1556323482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-70e030cf-eddb-4d03-8967-507342ad6a62.d117556d-b5be-4c1f-8cdf-8512c3bb9118" returned: 0 in 0.450s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:12 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-9fc47d79-5816-4ece-ab26-aa057876430a tempest-ProjectMemberTests-1556323482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70e030cf-eddb-4d03-8967-507342ad6a62(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:11:12 devstack sudo[108436]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-93d6da83-3541-4d67-a2f5-34899721c882 tempest-ProjectReaderTests-951549516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0aa912a9-658d-499e-be97-cf11d3a1c74a" returned: 0 in 0.321s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:12 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-93d6da83-3541-4d67-a2f5-34899721c882 tempest-ProjectReaderTests-951549516 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:11:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-93d6da83-3541-4d67-a2f5-34899721c882 tempest-ProjectReaderTests-951549516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:12 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[137ab8e3-f138-4ef9-b0a9-2526a00c2e04]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:11:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9fc47d79-5816-4ece-ab26-aa057876430a tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-70e030cf-eddb-4d03-8967-507342ad6a62 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:12 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-e534cc25-0c79-46a8-a009-285a12dce7f9 tempest-VolumeDependencyTests-33890977 None] Lock "cinder-d08a8f36-1b3e-424a-a39d-24894a89403e-delete_volume" released by "delete_volume" :: held 1.889s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:12 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-93d6da83-3541-4d67-a2f5-34899721c882 tempest-ProjectReaderTests-951549516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c840abc7-8fd8-499e-92cc-479b92ab5ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0aa912a9-658d-499e-be97-cf11d3a1c74a', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:12 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-93d6da83-3541-4d67-a2f5-34899721c882 tempest-ProjectReaderTests-951549516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0fa7734-acae-4a74-8400-99eff171967f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:12 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-93d6da83-3541-4d67-a2f5-34899721c882 tempest-ProjectReaderTests-951549516 None] Volume volume-0aa912a9-658d-499e-be97-cf11d3a1c74a (0aa912a9-658d-499e-be97-cf11d3a1c74a): created successfully Jul 30 17:11:12 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-93d6da83-3541-4d67-a2f5-34899721c882 tempest-ProjectReaderTests-951549516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0fa7734-acae-4a74-8400-99eff171967f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:12 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-93d6da83-3541-4d67-a2f5-34899721c882 tempest-ProjectReaderTests-951549516 None] Flow 'volume_create_manager' (50027953-b9e4-4f24-8028-c73d52f7b3bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:11:12 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-93d6da83-3541-4d67-a2f5-34899721c882 tempest-ProjectReaderTests-951549516 None] Created volume successfully. Jul 30 17:11:12 devstack sudo[108444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-70e030cf-eddb-4d03-8967-507342ad6a62 Jul 30 17:11:12 devstack sudo[108444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:12 devstack sudo[108444]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9fc47d79-5816-4ece-ab26-aa057876430a tempest-ProjectMemberTests-1556323482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-70e030cf-eddb-4d03-8967-507342ad6a62" returned: 0 in 0.392s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9fc47d79-5816-4ece-ab26-aa057876430a tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-70e030cf-eddb-4d03-8967-507342ad6a62.d117556d-b5be-4c1f-8cdf-8512c3bb9118 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:12 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-891249ad-4551-4390-b659-70e411c0c1c0 tempest-VolumeDependencyTests-33890977 None] Acquiring lock "cinder-c714adb8-bfa8-45f3-92f4-b330bc2dca5b-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:12 devstack sudo[108449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-70e030cf-eddb-4d03-8967-507342ad6a62.d117556d-b5be-4c1f-8cdf-8512c3bb9118 Jul 30 17:11:12 devstack sudo[108449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:12 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-891249ad-4551-4390-b659-70e411c0c1c0 tempest-VolumeDependencyTests-33890977 None] Lock "cinder-c714adb8-bfa8-45f3-92f4-b330bc2dca5b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:12 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-891249ad-4551-4390-b659-70e411c0c1c0 tempest-VolumeDependencyTests-33890977 None] Acquiring lock "cinder-quobyte-c714adb8-bfa8-45f3-92f4-b330bc2dca5b" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:12 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-891249ad-4551-4390-b659-70e411c0c1c0 tempest-VolumeDependencyTests-33890977 None] Lock "cinder-quobyte-c714adb8-bfa8-45f3-92f4-b330bc2dca5b" acquired by "delete_volume" :: waited 0.020s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:12 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[27162950-2f7c-4735-b6d4-accb7d14e450]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:11:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-891249ad-4551-4390-b659-70e411c0c1c0 tempest-VolumeDependencyTests-33890977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c714adb8-bfa8-45f3-92f4-b330bc2dca5b {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:12 devstack sudo[108453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c714adb8-bfa8-45f3-92f4-b330bc2dca5b Jul 30 17:11:12 devstack sudo[108453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:12 devstack sudo[108449]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9fc47d79-5816-4ece-ab26-aa057876430a tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-70e030cf-eddb-4d03-8967-507342ad6a62.d117556d-b5be-4c1f-8cdf-8512c3bb9118" returned: 0 in 0.406s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9fc47d79-5816-4ece-ab26-aa057876430a tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-70e030cf-eddb-4d03-8967-507342ad6a62.d117556d-b5be-4c1f-8cdf-8512c3bb9118 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:13 devstack sudo[108458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-70e030cf-eddb-4d03-8967-507342ad6a62.d117556d-b5be-4c1f-8cdf-8512c3bb9118 Jul 30 17:11:13 devstack sudo[108458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:13 devstack sudo[108453]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-891249ad-4551-4390-b659-70e411c0c1c0 tempest-VolumeDependencyTests-33890977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c714adb8-bfa8-45f3-92f4-b330bc2dca5b" returned: 0 in 0.410s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-891249ad-4551-4390-b659-70e411c0c1c0 tempest-VolumeDependencyTests-33890977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c714adb8-bfa8-45f3-92f4-b330bc2dca5b {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:13 devstack sudo[108463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c714adb8-bfa8-45f3-92f4-b330bc2dca5b Jul 30 17:11:13 devstack sudo[108463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:13 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-15ec27aa-210a-4b5e-a5b6-90bd4cf7aa2e tempest-ProjectReaderTests-951549516 None] Acquiring lock "cinder-0aa912a9-658d-499e-be97-cf11d3a1c74a-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:13 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-15ec27aa-210a-4b5e-a5b6-90bd4cf7aa2e tempest-ProjectReaderTests-951549516 None] Lock "cinder-0aa912a9-658d-499e-be97-cf11d3a1c74a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:13 devstack cinder-volume[88568]: DEBUG dbcounter [-] [88568] Writing DB stats cinder:SELECT=183,cinder:UPDATE=274,cinder:DELETE=19,cinder:INSERT=68 {{(pid=88568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 17:11:13 devstack sudo[108458]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9fc47d79-5816-4ece-ab26-aa057876430a tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-70e030cf-eddb-4d03-8967-507342ad6a62.d117556d-b5be-4c1f-8cdf-8512c3bb9118" returned: 0 in 0.314s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:13 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-15ec27aa-210a-4b5e-a5b6-90bd4cf7aa2e tempest-ProjectReaderTests-951549516 None] Acquiring lock "cinder-quobyte-0aa912a9-658d-499e-be97-cf11d3a1c74a" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:13 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-9fc47d79-5816-4ece-ab26-aa057876430a tempest-ProjectMemberTests-1556323482 None] Lock "cinder-quobyte-d117556d-b5be-4c1f-8cdf-8512c3bb9118" released by "_delete_snapshot" :: held 1.697s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:13 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-15ec27aa-210a-4b5e-a5b6-90bd4cf7aa2e tempest-ProjectReaderTests-951549516 None] Lock "cinder-quobyte-0aa912a9-658d-499e-be97-cf11d3a1c74a" acquired by "delete_volume" :: waited 0.045s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:13 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-9fc47d79-5816-4ece-ab26-aa057876430a tempest-ProjectMemberTests-1556323482 None] Lock "cinder-quobyte-70e030cf-eddb-4d03-8967-507342ad6a62" released by "delete_snapshot" :: held 1.765s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:13 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[826e6b22-ec82-4dd1-b747-7586bc225b0a]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:11:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-15ec27aa-210a-4b5e-a5b6-90bd4cf7aa2e tempest-ProjectReaderTests-951549516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0aa912a9-658d-499e-be97-cf11d3a1c74a {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:13 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-9fc47d79-5816-4ece-ab26-aa057876430a tempest-ProjectMemberTests-1556323482 None] Created reservations ['c552b9fc-def2-4f0e-b87c-600af95d0390', '13abc0f9-3abc-4098-ad21-eac567f822dc', '16b98f54-1c35-4c49-b080-2331f90517ca', 'b076beca-8c19-44c1-8223-42d3e1975454'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:11:13 devstack sudo[108463]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-891249ad-4551-4390-b659-70e411c0c1c0 tempest-VolumeDependencyTests-33890977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-c714adb8-bfa8-45f3-92f4-b330bc2dca5b" returned: 0 in 0.365s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:13 devstack cinder-volume[88568]: DEBUG dbcounter [-] [88568] Writing DB stats cinder:UPDATE=247,cinder:SELECT=203,cinder:INSERT=72,cinder:DELETE=29 {{(pid=88568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 17:11:13 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-891249ad-4551-4390-b659-70e411c0c1c0 tempest-VolumeDependencyTests-33890977 None] Lock "cinder-quobyte-c714adb8-bfa8-45f3-92f4-b330bc2dca5b" released by "delete_volume" :: held 0.826s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:13 devstack sudo[108466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0aa912a9-658d-499e-be97-cf11d3a1c74a Jul 30 17:11:13 devstack sudo[108466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:13 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-9fc47d79-5816-4ece-ab26-aa057876430a tempest-ProjectMemberTests-1556323482 None] Delete snapshot completed successfully. Jul 30 17:11:13 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-9fc47d79-5816-4ece-ab26-aa057876430a tempest-ProjectMemberTests-1556323482 None] Lock "cinder-d117556d-b5be-4c1f-8cdf-8512c3bb9118-delete_snapshot" released by "delete_snapshot" :: held 2.016s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:13 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-891249ad-4551-4390-b659-70e411c0c1c0 tempest-VolumeDependencyTests-33890977 None] Created reservations ['380f6b87-f1a2-453d-bdfc-d5c48b4375d8', 'e9905755-8e3b-4eaa-a85d-8da0f726612a', '217905ad-8f9f-4ae6-abe9-ff5d3a4a72d3', 'e6fec2b4-4036-44ca-a15b-2122aa69f75c'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:11:13 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-75e4cb8f-3f68-40a4-9860-1f95ee661835 tempest-ProjectMemberTests-1556323482 None] Acquiring lock "cinder-70e030cf-eddb-4d03-8967-507342ad6a62-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-891249ad-4551-4390-b659-70e411c0c1c0 tempest-VolumeDependencyTests-33890977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-891249ad-4551-4390-b659-70e411c0c1c0 tempest-VolumeDependencyTests-33890977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:13 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-891249ad-4551-4390-b659-70e411c0c1c0 tempest-VolumeDependencyTests-33890977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:11:13 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-891249ad-4551-4390-b659-70e411c0c1c0 tempest-VolumeDependencyTests-33890977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:11:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-891249ad-4551-4390-b659-70e411c0c1c0 tempest-VolumeDependencyTests-33890977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-891249ad-4551-4390-b659-70e411c0c1c0 tempest-VolumeDependencyTests-33890977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:13 devstack sudo[108469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:11:13 devstack sudo[108469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:13 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-75e4cb8f-3f68-40a4-9860-1f95ee661835 tempest-ProjectMemberTests-1556323482 None] Lock "cinder-70e030cf-eddb-4d03-8967-507342ad6a62-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:13 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-75e4cb8f-3f68-40a4-9860-1f95ee661835 tempest-ProjectMemberTests-1556323482 None] Acquiring lock "cinder-quobyte-70e030cf-eddb-4d03-8967-507342ad6a62" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:13 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-75e4cb8f-3f68-40a4-9860-1f95ee661835 tempest-ProjectMemberTests-1556323482 None] Lock "cinder-quobyte-70e030cf-eddb-4d03-8967-507342ad6a62" acquired by "delete_volume" :: waited 0.030s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:13 devstack sudo[108466]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-15ec27aa-210a-4b5e-a5b6-90bd4cf7aa2e tempest-ProjectReaderTests-951549516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0aa912a9-658d-499e-be97-cf11d3a1c74a" returned: 0 in 0.564s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-15ec27aa-210a-4b5e-a5b6-90bd4cf7aa2e tempest-ProjectReaderTests-951549516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0aa912a9-658d-499e-be97-cf11d3a1c74a {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:13 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[c09577b4-85e7-4d85-9a8c-a26c78c4cd4c]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:11:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-75e4cb8f-3f68-40a4-9860-1f95ee661835 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-70e030cf-eddb-4d03-8967-507342ad6a62 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:13 devstack sudo[108474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0aa912a9-658d-499e-be97-cf11d3a1c74a Jul 30 17:11:13 devstack sudo[108474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:14 devstack sudo[108475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-70e030cf-eddb-4d03-8967-507342ad6a62 Jul 30 17:11:14 devstack sudo[108475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:14 devstack sudo[108469]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-891249ad-4551-4390-b659-70e411c0c1c0 tempest-VolumeDependencyTests-33890977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.344s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:14 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-891249ad-4551-4390-b659-70e411c0c1c0 tempest-VolumeDependencyTests-33890977 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:11:14 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-891249ad-4551-4390-b659-70e411c0c1c0 tempest-VolumeDependencyTests-33890977 None] Deleted volume successfully. Jul 30 17:11:14 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-891249ad-4551-4390-b659-70e411c0c1c0 tempest-VolumeDependencyTests-33890977 None] Lock "cinder-c714adb8-bfa8-45f3-92f4-b330bc2dca5b-delete_volume" released by "delete_volume" :: held 1.518s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:14 devstack sudo[108474]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-15ec27aa-210a-4b5e-a5b6-90bd4cf7aa2e tempest-ProjectReaderTests-951549516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-0aa912a9-658d-499e-be97-cf11d3a1c74a" returned: 0 in 0.299s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:14 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-15ec27aa-210a-4b5e-a5b6-90bd4cf7aa2e tempest-ProjectReaderTests-951549516 None] Lock "cinder-quobyte-0aa912a9-658d-499e-be97-cf11d3a1c74a" released by "delete_volume" :: held 0.916s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:14 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-15ec27aa-210a-4b5e-a5b6-90bd4cf7aa2e tempest-ProjectReaderTests-951549516 None] Created reservations ['acd135cd-3ce7-47de-b161-199130cf51a2', 'fead2fe1-77e5-4d6c-aeb3-c3aedfe6702b', '9fdcf65a-3953-41e5-accd-c3d78952fa53', 'b7bc3454-6be7-4fc9-98a6-18a6dfe707d6'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:11:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-15ec27aa-210a-4b5e-a5b6-90bd4cf7aa2e tempest-ProjectReaderTests-951549516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-15ec27aa-210a-4b5e-a5b6-90bd4cf7aa2e tempest-ProjectReaderTests-951549516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:14 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-15ec27aa-210a-4b5e-a5b6-90bd4cf7aa2e tempest-ProjectReaderTests-951549516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:11:14 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-15ec27aa-210a-4b5e-a5b6-90bd4cf7aa2e tempest-ProjectReaderTests-951549516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:11:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-15ec27aa-210a-4b5e-a5b6-90bd4cf7aa2e tempest-ProjectReaderTests-951549516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-15ec27aa-210a-4b5e-a5b6-90bd4cf7aa2e tempest-ProjectReaderTests-951549516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:14 devstack sudo[108475]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-75e4cb8f-3f68-40a4-9860-1f95ee661835 tempest-ProjectMemberTests-1556323482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-70e030cf-eddb-4d03-8967-507342ad6a62" returned: 0 in 0.443s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-75e4cb8f-3f68-40a4-9860-1f95ee661835 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-70e030cf-eddb-4d03-8967-507342ad6a62 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:14 devstack sudo[108484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:11:14 devstack sudo[108484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:14 devstack sudo[108485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-70e030cf-eddb-4d03-8967-507342ad6a62 Jul 30 17:11:14 devstack sudo[108485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:14 devstack sudo[108485]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:14 devstack sudo[108484]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-75e4cb8f-3f68-40a4-9860-1f95ee661835 tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-70e030cf-eddb-4d03-8967-507342ad6a62" returned: 0 in 0.258s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-15ec27aa-210a-4b5e-a5b6-90bd4cf7aa2e tempest-ProjectReaderTests-951549516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.289s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:14 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-15ec27aa-210a-4b5e-a5b6-90bd4cf7aa2e tempest-ProjectReaderTests-951549516 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:11:14 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-75e4cb8f-3f68-40a4-9860-1f95ee661835 tempest-ProjectMemberTests-1556323482 None] Lock "cinder-quobyte-70e030cf-eddb-4d03-8967-507342ad6a62" released by "delete_volume" :: held 0.790s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:14 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-15ec27aa-210a-4b5e-a5b6-90bd4cf7aa2e tempest-ProjectReaderTests-951549516 None] Deleted volume successfully. Jul 30 17:11:14 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-15ec27aa-210a-4b5e-a5b6-90bd4cf7aa2e tempest-ProjectReaderTests-951549516 None] Lock "cinder-0aa912a9-658d-499e-be97-cf11d3a1c74a-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:14 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-75e4cb8f-3f68-40a4-9860-1f95ee661835 tempest-ProjectMemberTests-1556323482 None] Created reservations ['606d3eae-e360-4ca6-809c-4a8963b550bb', '586b669c-ec40-40c8-93f3-6fc50de4a4db', '45d086b0-d213-408f-81bf-95dbeeac2bdf', 'da4f1465-fc82-4fd2-984c-6c589e83892c'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:11:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-75e4cb8f-3f68-40a4-9860-1f95ee661835 tempest-ProjectMemberTests-1556323482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-75e4cb8f-3f68-40a4-9860-1f95ee661835 tempest-ProjectMemberTests-1556323482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:14 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-75e4cb8f-3f68-40a4-9860-1f95ee661835 tempest-ProjectMemberTests-1556323482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:11:14 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-75e4cb8f-3f68-40a4-9860-1f95ee661835 tempest-ProjectMemberTests-1556323482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:11:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-75e4cb8f-3f68-40a4-9860-1f95ee661835 tempest-ProjectMemberTests-1556323482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-75e4cb8f-3f68-40a4-9860-1f95ee661835 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:14 devstack sudo[108490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:11:14 devstack sudo[108490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:15 devstack sudo[108490]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:15 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-75e4cb8f-3f68-40a4-9860-1f95ee661835 tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.427s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:15 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-75e4cb8f-3f68-40a4-9860-1f95ee661835 tempest-ProjectMemberTests-1556323482 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:11:15 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-75e4cb8f-3f68-40a4-9860-1f95ee661835 tempest-ProjectMemberTests-1556323482 None] Deleted volume successfully. Jul 30 17:11:15 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-75e4cb8f-3f68-40a4-9860-1f95ee661835 tempest-ProjectMemberTests-1556323482 None] Lock "cinder-70e030cf-eddb-4d03-8967-507342ad6a62-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:15 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-d808b5a5-79bb-4827-9806-f53d4153a70d tempest-ProjectMemberTests-1556323482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:11:15 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-d808b5a5-79bb-4827-9806-f53d4153a70d tempest-ProjectMemberTests-1556323482 None] Flow 'volume_create_manager' (7bc81734-28f9-46ac-8b7e-245c25e19c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:11:15 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-d808b5a5-79bb-4827-9806-f53d4153a70d tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35795373-2495-4408-8740-e893c0a1aa39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:15 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-d808b5a5-79bb-4827-9806-f53d4153a70d tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35795373-2495-4408-8740-e893c0a1aa39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:11:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-957701177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a9f3cf0-b839-4d7e-baa7-7e0b8dddc1b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72a0b0e3a199416698115290d71c6808',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:11:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:11:15Z,use_quota=True,user_id='8f2d7aa2b6ab4865b626b01a01acc0f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:15 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-d808b5a5-79bb-4827-9806-f53d4153a70d tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de261b5a-02e1-49c1-9360-5ee56bc9582a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:15 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-d808b5a5-79bb-4827-9806-f53d4153a70d tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de261b5a-02e1-49c1-9360-5ee56bc9582a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:15 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-d808b5a5-79bb-4827-9806-f53d4153a70d tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f880369-fde4-4d52-a97a-7aad0cb4f5db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:15 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-d808b5a5-79bb-4827-9806-f53d4153a70d tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f880369-fde4-4d52-a97a-7aad0cb4f5db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a9f3cf0-b839-4d7e-baa7-7e0b8dddc1b1', 'volume_name': 'volume-4a9f3cf0-b839-4d7e-baa7-7e0b8dddc1b1', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:15 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-d808b5a5-79bb-4827-9806-f53d4153a70d tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (506fc2d9-6e31-44c1-90eb-fdca52c8fabe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:15 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-d808b5a5-79bb-4827-9806-f53d4153a70d tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (506fc2d9-6e31-44c1-90eb-fdca52c8fabe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:15 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-d808b5a5-79bb-4827-9806-f53d4153a70d tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c08bfe3-674d-427b-bd1f-6fa8ad0ec3b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:15 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-d808b5a5-79bb-4827-9806-f53d4153a70d tempest-ProjectMemberTests-1556323482 None] Volume 4a9f3cf0-b839-4d7e-baa7-7e0b8dddc1b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a9f3cf0-b839-4d7e-baa7-7e0b8dddc1b1', 'volume_size': 1} Jul 30 17:11:15 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-d808b5a5-79bb-4827-9806-f53d4153a70d tempest-ProjectMemberTests-1556323482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:15 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-d808b5a5-79bb-4827-9806-f53d4153a70d tempest-ProjectMemberTests-1556323482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:15 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-d808b5a5-79bb-4827-9806-f53d4153a70d tempest-ProjectMemberTests-1556323482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:11:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-957701177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a9f3cf0-b839-4d7e-baa7-7e0b8dddc1b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72a0b0e3a199416698115290d71c6808',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:11:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:11:15Z,use_quota=True,user_id='8f2d7aa2b6ab4865b626b01a01acc0f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:11:15 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-d808b5a5-79bb-4827-9806-f53d4153a70d tempest-ProjectMemberTests-1556323482 None] Creating volume 4a9f3cf0-b839-4d7e-baa7-7e0b8dddc1b1 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:11:15 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-d808b5a5-79bb-4827-9806-f53d4153a70d tempest-ProjectMemberTests-1556323482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:15 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-d808b5a5-79bb-4827-9806-f53d4153a70d tempest-ProjectMemberTests-1556323482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:15 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-d808b5a5-79bb-4827-9806-f53d4153a70d tempest-ProjectMemberTests-1556323482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:11:15 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-d808b5a5-79bb-4827-9806-f53d4153a70d tempest-ProjectMemberTests-1556323482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:11:15 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-d808b5a5-79bb-4827-9806-f53d4153a70d tempest-ProjectMemberTests-1556323482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:15 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-d808b5a5-79bb-4827-9806-f53d4153a70d tempest-ProjectMemberTests-1556323482 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:11:15 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-d808b5a5-79bb-4827-9806-f53d4153a70d tempest-ProjectMemberTests-1556323482 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:11:15 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d808b5a5-79bb-4827-9806-f53d4153a70d tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4a9f3cf0-b839-4d7e-baa7-7e0b8dddc1b1 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:15 devstack sudo[108494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4a9f3cf0-b839-4d7e-baa7-7e0b8dddc1b1 1073741824 Jul 30 17:11:15 devstack sudo[108494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:16 devstack sudo[108494]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:16 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d808b5a5-79bb-4827-9806-f53d4153a70d tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4a9f3cf0-b839-4d7e-baa7-7e0b8dddc1b1 1073741824" returned: 0 in 0.558s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:16 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d808b5a5-79bb-4827-9806-f53d4153a70d tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4a9f3cf0-b839-4d7e-baa7-7e0b8dddc1b1 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:16 devstack sudo[108500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4a9f3cf0-b839-4d7e-baa7-7e0b8dddc1b1 Jul 30 17:11:16 devstack sudo[108500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:16 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-e63d28a0-85bd-4eae-b63c-8abe6327507a tempest-ProjectReaderTests-951549516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:11:16 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e63d28a0-85bd-4eae-b63c-8abe6327507a tempest-ProjectReaderTests-951549516 None] Flow 'volume_create_manager' (2b60d686-40b0-42f1-8b97-94b0da82f574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:11:16 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e63d28a0-85bd-4eae-b63c-8abe6327507a tempest-ProjectReaderTests-951549516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c520476-7887-4075-8223-9fc8518a376e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:16 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e63d28a0-85bd-4eae-b63c-8abe6327507a tempest-ProjectReaderTests-951549516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c520476-7887-4075-8223-9fc8518a376e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:11:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1436243418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02e0250c-4370-42e4-b38c-106a3f09c616,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8da42f52b5744b69919cd88f60236365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:11:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:11:16Z,use_quota=True,user_id='48aa3aa08a444121a7d4b6d51cee1fa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:16 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e63d28a0-85bd-4eae-b63c-8abe6327507a tempest-ProjectReaderTests-951549516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06d72241-a0fb-4f72-86a6-69ee063d5784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:16 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e63d28a0-85bd-4eae-b63c-8abe6327507a tempest-ProjectReaderTests-951549516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06d72241-a0fb-4f72-86a6-69ee063d5784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:16 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e63d28a0-85bd-4eae-b63c-8abe6327507a tempest-ProjectReaderTests-951549516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4b57e8d-d060-46f6-81a8-61f9b447c552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:16 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e63d28a0-85bd-4eae-b63c-8abe6327507a tempest-ProjectReaderTests-951549516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4b57e8d-d060-46f6-81a8-61f9b447c552) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02e0250c-4370-42e4-b38c-106a3f09c616', 'volume_name': 'volume-02e0250c-4370-42e4-b38c-106a3f09c616', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:16 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e63d28a0-85bd-4eae-b63c-8abe6327507a tempest-ProjectReaderTests-951549516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a21d6f48-94fc-4c09-9742-c8e85e9e5169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:16 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e63d28a0-85bd-4eae-b63c-8abe6327507a tempest-ProjectReaderTests-951549516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a21d6f48-94fc-4c09-9742-c8e85e9e5169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:16 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e63d28a0-85bd-4eae-b63c-8abe6327507a tempest-ProjectReaderTests-951549516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d9d8d45-04f0-454d-b88e-3d268e818c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:16 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-e63d28a0-85bd-4eae-b63c-8abe6327507a tempest-ProjectReaderTests-951549516 None] Volume 02e0250c-4370-42e4-b38c-106a3f09c616: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02e0250c-4370-42e4-b38c-106a3f09c616', 'volume_size': 1} Jul 30 17:11:16 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-e63d28a0-85bd-4eae-b63c-8abe6327507a tempest-ProjectReaderTests-951549516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:16 devstack sudo[108500]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:16 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d808b5a5-79bb-4827-9806-f53d4153a70d tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4a9f3cf0-b839-4d7e-baa7-7e0b8dddc1b1" returned: 0 in 0.309s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:16 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-d808b5a5-79bb-4827-9806-f53d4153a70d tempest-ProjectMemberTests-1556323482 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:11:16 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-d808b5a5-79bb-4827-9806-f53d4153a70d tempest-ProjectMemberTests-1556323482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:16 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-e63d28a0-85bd-4eae-b63c-8abe6327507a tempest-ProjectReaderTests-951549516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.106s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:16 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-e63d28a0-85bd-4eae-b63c-8abe6327507a tempest-ProjectReaderTests-951549516 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:11:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1436243418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02e0250c-4370-42e4-b38c-106a3f09c616,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8da42f52b5744b69919cd88f60236365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:11:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:11:16Z,use_quota=True,user_id='48aa3aa08a444121a7d4b6d51cee1fa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:11:16 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-e63d28a0-85bd-4eae-b63c-8abe6327507a tempest-ProjectReaderTests-951549516 None] Creating volume 02e0250c-4370-42e4-b38c-106a3f09c616 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:11:16 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-e63d28a0-85bd-4eae-b63c-8abe6327507a tempest-ProjectReaderTests-951549516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:16 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-e63d28a0-85bd-4eae-b63c-8abe6327507a tempest-ProjectReaderTests-951549516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:16 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-e63d28a0-85bd-4eae-b63c-8abe6327507a tempest-ProjectReaderTests-951549516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:11:16 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-e63d28a0-85bd-4eae-b63c-8abe6327507a tempest-ProjectReaderTests-951549516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:11:16 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-e63d28a0-85bd-4eae-b63c-8abe6327507a tempest-ProjectReaderTests-951549516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:16 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-e63d28a0-85bd-4eae-b63c-8abe6327507a tempest-ProjectReaderTests-951549516 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:11:16 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-e63d28a0-85bd-4eae-b63c-8abe6327507a tempest-ProjectReaderTests-951549516 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:11:16 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e63d28a0-85bd-4eae-b63c-8abe6327507a tempest-ProjectReaderTests-951549516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02e0250c-4370-42e4-b38c-106a3f09c616 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:16 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-d808b5a5-79bb-4827-9806-f53d4153a70d tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c08bfe3-674d-427b-bd1f-6fa8ad0ec3b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a9f3cf0-b839-4d7e-baa7-7e0b8dddc1b1', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:16 devstack sudo[108503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02e0250c-4370-42e4-b38c-106a3f09c616 1073741824 Jul 30 17:11:16 devstack sudo[108503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:16 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-d808b5a5-79bb-4827-9806-f53d4153a70d tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d16f9ed1-ac90-485d-bad9-ee15686372af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:16 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-d808b5a5-79bb-4827-9806-f53d4153a70d tempest-ProjectMemberTests-1556323482 None] Volume volume-4a9f3cf0-b839-4d7e-baa7-7e0b8dddc1b1 (4a9f3cf0-b839-4d7e-baa7-7e0b8dddc1b1): created successfully Jul 30 17:11:16 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-d808b5a5-79bb-4827-9806-f53d4153a70d tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d16f9ed1-ac90-485d-bad9-ee15686372af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:16 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-d808b5a5-79bb-4827-9806-f53d4153a70d tempest-ProjectMemberTests-1556323482 None] Flow 'volume_create_manager' (7bc81734-28f9-46ac-8b7e-245c25e19c7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:11:16 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-d808b5a5-79bb-4827-9806-f53d4153a70d tempest-ProjectMemberTests-1556323482 None] Created volume successfully. Jul 30 17:11:17 devstack sudo[108503]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e63d28a0-85bd-4eae-b63c-8abe6327507a tempest-ProjectReaderTests-951549516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02e0250c-4370-42e4-b38c-106a3f09c616 1073741824" returned: 0 in 0.546s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e63d28a0-85bd-4eae-b63c-8abe6327507a tempest-ProjectReaderTests-951549516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02e0250c-4370-42e4-b38c-106a3f09c616 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:17 devstack sudo[108511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02e0250c-4370-42e4-b38c-106a3f09c616 Jul 30 17:11:17 devstack sudo[108511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:17 devstack sudo[108511]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-e63d28a0-85bd-4eae-b63c-8abe6327507a tempest-ProjectReaderTests-951549516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02e0250c-4370-42e4-b38c-106a3f09c616" returned: 0 in 0.329s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:17 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-e63d28a0-85bd-4eae-b63c-8abe6327507a tempest-ProjectReaderTests-951549516 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:11:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-e63d28a0-85bd-4eae-b63c-8abe6327507a tempest-ProjectReaderTests-951549516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:17 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fd53af9-ac09-44c1-be74-eabb99fe4992 tempest-CinderUnicodeTest-333851401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:11:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1fd53af9-ac09-44c1-be74-eabb99fe4992 tempest-CinderUnicodeTest-333851401 None] Flow 'volume_create_manager' (666ccb6f-702b-4440-acc2-4527286061f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:11:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1fd53af9-ac09-44c1-be74-eabb99fe4992 tempest-CinderUnicodeTest-333851401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8b8be28-4c00-4ee9-9d0b-fe4547ead82e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e63d28a0-85bd-4eae-b63c-8abe6327507a tempest-ProjectReaderTests-951549516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d9d8d45-04f0-454d-b88e-3d268e818c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02e0250c-4370-42e4-b38c-106a3f09c616', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e63d28a0-85bd-4eae-b63c-8abe6327507a tempest-ProjectReaderTests-951549516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04a3cf3e-ff73-4f14-b68d-0755bb7654d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1fd53af9-ac09-44c1-be74-eabb99fe4992 tempest-CinderUnicodeTest-333851401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8b8be28-4c00-4ee9-9d0b-fe4547ead82e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:11:17Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e773cb47-4f7a-4e18-b67d-0b1d44ffddc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='652e2b0d8e744a54be3c3c988475b7e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:11:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:11:17Z,use_quota=True,user_id='25ee1f8d5f874aa2ac625900368ef408',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1fd53af9-ac09-44c1-be74-eabb99fe4992 tempest-CinderUnicodeTest-333851401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab8b8bdf-f800-411e-9c02-42afbd3271c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1fd53af9-ac09-44c1-be74-eabb99fe4992 tempest-CinderUnicodeTest-333851401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab8b8bdf-f800-411e-9c02-42afbd3271c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1fd53af9-ac09-44c1-be74-eabb99fe4992 tempest-CinderUnicodeTest-333851401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d013821-c535-4b49-88c6-8bb310d0f2d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1fd53af9-ac09-44c1-be74-eabb99fe4992 tempest-CinderUnicodeTest-333851401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d013821-c535-4b49-88c6-8bb310d0f2d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e773cb47-4f7a-4e18-b67d-0b1d44ffddc4', 'volume_name': 'volume-e773cb47-4f7a-4e18-b67d-0b1d44ffddc4', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1fd53af9-ac09-44c1-be74-eabb99fe4992 tempest-CinderUnicodeTest-333851401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c86abd47-fb80-44ee-901d-2a65d722dedf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1fd53af9-ac09-44c1-be74-eabb99fe4992 tempest-CinderUnicodeTest-333851401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c86abd47-fb80-44ee-901d-2a65d722dedf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1fd53af9-ac09-44c1-be74-eabb99fe4992 tempest-CinderUnicodeTest-333851401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e87cd5a-a689-4a79-9b17-3afc01b3a693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:17 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-1fd53af9-ac09-44c1-be74-eabb99fe4992 tempest-CinderUnicodeTest-333851401 None] Volume e773cb47-4f7a-4e18-b67d-0b1d44ffddc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e773cb47-4f7a-4e18-b67d-0b1d44ffddc4', 'volume_size': 1} Jul 30 17:11:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-1fd53af9-ac09-44c1-be74-eabb99fe4992 tempest-CinderUnicodeTest-333851401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-1fd53af9-ac09-44c1-be74-eabb99fe4992 tempest-CinderUnicodeTest-333851401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:17 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-1fd53af9-ac09-44c1-be74-eabb99fe4992 tempest-CinderUnicodeTest-333851401 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:11:17Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e773cb47-4f7a-4e18-b67d-0b1d44ffddc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='652e2b0d8e744a54be3c3c988475b7e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:11:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:11:17Z,use_quota=True,user_id='25ee1f8d5f874aa2ac625900368ef408',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:11:17 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-1fd53af9-ac09-44c1-be74-eabb99fe4992 tempest-CinderUnicodeTest-333851401 None] Creating volume e773cb47-4f7a-4e18-b67d-0b1d44ffddc4 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:11:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-1fd53af9-ac09-44c1-be74-eabb99fe4992 tempest-CinderUnicodeTest-333851401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-1fd53af9-ac09-44c1-be74-eabb99fe4992 tempest-CinderUnicodeTest-333851401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:17 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-1fd53af9-ac09-44c1-be74-eabb99fe4992 tempest-CinderUnicodeTest-333851401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:11:17 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-1fd53af9-ac09-44c1-be74-eabb99fe4992 tempest-CinderUnicodeTest-333851401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:11:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-1fd53af9-ac09-44c1-be74-eabb99fe4992 tempest-CinderUnicodeTest-333851401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:17 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-1fd53af9-ac09-44c1-be74-eabb99fe4992 tempest-CinderUnicodeTest-333851401 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:11:17 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-1fd53af9-ac09-44c1-be74-eabb99fe4992 tempest-CinderUnicodeTest-333851401 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:11:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-1fd53af9-ac09-44c1-be74-eabb99fe4992 tempest-CinderUnicodeTest-333851401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e773cb47-4f7a-4e18-b67d-0b1d44ffddc4 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:17 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-e63d28a0-85bd-4eae-b63c-8abe6327507a tempest-ProjectReaderTests-951549516 None] Volume volume-02e0250c-4370-42e4-b38c-106a3f09c616 (02e0250c-4370-42e4-b38c-106a3f09c616): created successfully Jul 30 17:11:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e63d28a0-85bd-4eae-b63c-8abe6327507a tempest-ProjectReaderTests-951549516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04a3cf3e-ff73-4f14-b68d-0755bb7654d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:17 devstack sudo[108514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e773cb47-4f7a-4e18-b67d-0b1d44ffddc4 1073741824 Jul 30 17:11:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-e63d28a0-85bd-4eae-b63c-8abe6327507a tempest-ProjectReaderTests-951549516 None] Flow 'volume_create_manager' (2b60d686-40b0-42f1-8b97-94b0da82f574) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:11:17 devstack sudo[108514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:17 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-e63d28a0-85bd-4eae-b63c-8abe6327507a tempest-ProjectReaderTests-951549516 None] Created volume successfully. Jul 30 17:11:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-aa2ad737-7d60-45f7-b4da-7244b80fae96 tempest-ProjectMemberTests-1556323482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:18 devstack sudo[108514]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-1fd53af9-ac09-44c1-be74-eabb99fe4992 tempest-CinderUnicodeTest-333851401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e773cb47-4f7a-4e18-b67d-0b1d44ffddc4 1073741824" returned: 0 in 0.481s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-1fd53af9-ac09-44c1-be74-eabb99fe4992 tempest-CinderUnicodeTest-333851401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e773cb47-4f7a-4e18-b67d-0b1d44ffddc4 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:18 devstack sudo[108519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e773cb47-4f7a-4e18-b67d-0b1d44ffddc4 Jul 30 17:11:18 devstack sudo[108519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:18 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-29986c69-4893-4e49-aad8-3bc97b6e172b tempest-ProjectReaderTests-951549516 None] Acquiring lock "cinder-02e0250c-4370-42e4-b38c-106a3f09c616-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:18 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-29986c69-4893-4e49-aad8-3bc97b6e172b tempest-ProjectReaderTests-951549516 None] Lock "cinder-02e0250c-4370-42e4-b38c-106a3f09c616-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:18 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-29986c69-4893-4e49-aad8-3bc97b6e172b tempest-ProjectReaderTests-951549516 None] Acquiring lock "cinder-quobyte-02e0250c-4370-42e4-b38c-106a3f09c616" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:18 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-29986c69-4893-4e49-aad8-3bc97b6e172b tempest-ProjectReaderTests-951549516 None] Lock "cinder-quobyte-02e0250c-4370-42e4-b38c-106a3f09c616" acquired by "delete_volume" :: waited 0.014s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:18 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ef3160-2014-4a82-bfda-000865edab49]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:11:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-29986c69-4893-4e49-aad8-3bc97b6e172b tempest-ProjectReaderTests-951549516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02e0250c-4370-42e4-b38c-106a3f09c616 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:18 devstack sudo[108519]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-1fd53af9-ac09-44c1-be74-eabb99fe4992 tempest-CinderUnicodeTest-333851401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e773cb47-4f7a-4e18-b67d-0b1d44ffddc4" returned: 0 in 0.259s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:18 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-1fd53af9-ac09-44c1-be74-eabb99fe4992 tempest-CinderUnicodeTest-333851401 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:11:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-1fd53af9-ac09-44c1-be74-eabb99fe4992 tempest-CinderUnicodeTest-333851401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-aa2ad737-7d60-45f7-b4da-7244b80fae96 tempest-ProjectMemberTests-1556323482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.635s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:18 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1fd53af9-ac09-44c1-be74-eabb99fe4992 tempest-CinderUnicodeTest-333851401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e87cd5a-a689-4a79-9b17-3afc01b3a693) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e773cb47-4f7a-4e18-b67d-0b1d44ffddc4', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:18 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1fd53af9-ac09-44c1-be74-eabb99fe4992 tempest-CinderUnicodeTest-333851401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (648cf664-2b58-44ae-805c-ee001d0b9ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:18 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-aa2ad737-7d60-45f7-b4da-7244b80fae96 tempest-ProjectMemberTests-1556323482 None] Creating offline snapshot 43830ccc-c91a-4e11-9000-e16c04e516ac of volume 4a9f3cf0-b839-4d7e-baa7-7e0b8dddc1b1 {{(pid=88568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:11:18 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-1fd53af9-ac09-44c1-be74-eabb99fe4992 tempest-CinderUnicodeTest-333851401 None] Volume volume-e773cb47-4f7a-4e18-b67d-0b1d44ffddc4 (e773cb47-4f7a-4e18-b67d-0b1d44ffddc4): created successfully Jul 30 17:11:18 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1fd53af9-ac09-44c1-be74-eabb99fe4992 tempest-CinderUnicodeTest-333851401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (648cf664-2b58-44ae-805c-ee001d0b9ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:18 devstack sudo[108521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02e0250c-4370-42e4-b38c-106a3f09c616 Jul 30 17:11:18 devstack sudo[108521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:18 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1fd53af9-ac09-44c1-be74-eabb99fe4992 tempest-CinderUnicodeTest-333851401 None] Flow 'volume_create_manager' (666ccb6f-702b-4440-acc2-4527286061f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:11:18 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b946f4-7d10-4502-8514-fbad331f87e8]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:11:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-aa2ad737-7d60-45f7-b4da-7244b80fae96 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4a9f3cf0-b839-4d7e-baa7-7e0b8dddc1b1 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:18 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-1fd53af9-ac09-44c1-be74-eabb99fe4992 tempest-CinderUnicodeTest-333851401 None] Created volume successfully. Jul 30 17:11:18 devstack sudo[108524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4a9f3cf0-b839-4d7e-baa7-7e0b8dddc1b1 Jul 30 17:11:18 devstack sudo[108524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:18 devstack sudo[108521]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-29986c69-4893-4e49-aad8-3bc97b6e172b tempest-ProjectReaderTests-951549516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02e0250c-4370-42e4-b38c-106a3f09c616" returned: 0 in 0.378s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-29986c69-4893-4e49-aad8-3bc97b6e172b tempest-ProjectReaderTests-951549516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02e0250c-4370-42e4-b38c-106a3f09c616 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:18 devstack sudo[108529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02e0250c-4370-42e4-b38c-106a3f09c616 Jul 30 17:11:18 devstack sudo[108529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:18 devstack sudo[108524]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-aa2ad737-7d60-45f7-b4da-7244b80fae96 tempest-ProjectMemberTests-1556323482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4a9f3cf0-b839-4d7e-baa7-7e0b8dddc1b1" returned: 0 in 0.376s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-aa2ad737-7d60-45f7-b4da-7244b80fae96 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4a9f3cf0-b839-4d7e-baa7-7e0b8dddc1b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4a9f3cf0-b839-4d7e-baa7-7e0b8dddc1b1.43830ccc-c91a-4e11-9000-e16c04e516ac 1G {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:18 devstack sudo[108534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4a9f3cf0-b839-4d7e-baa7-7e0b8dddc1b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4a9f3cf0-b839-4d7e-baa7-7e0b8dddc1b1.43830ccc-c91a-4e11-9000-e16c04e516ac 1G Jul 30 17:11:18 devstack sudo[108534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:18 devstack sudo[108529]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-29986c69-4893-4e49-aad8-3bc97b6e172b tempest-ProjectReaderTests-951549516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-02e0250c-4370-42e4-b38c-106a3f09c616" returned: 0 in 0.268s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:18 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-29986c69-4893-4e49-aad8-3bc97b6e172b tempest-ProjectReaderTests-951549516 None] Lock "cinder-quobyte-02e0250c-4370-42e4-b38c-106a3f09c616" released by "delete_volume" :: held 0.695s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:19 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-29986c69-4893-4e49-aad8-3bc97b6e172b tempest-ProjectReaderTests-951549516 None] Created reservations ['10fc1b13-bce0-4127-b070-df2990f5e03d', '1b764b7d-3918-40a8-9761-7f54fb632037', 'fddff82e-b9f3-4af6-9c09-a86f987b5d8d', 'bd94bc53-5a0a-4ac5-b78b-b251ae0818ee'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:11:19 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-29986c69-4893-4e49-aad8-3bc97b6e172b tempest-ProjectReaderTests-951549516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:19 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-29986c69-4893-4e49-aad8-3bc97b6e172b tempest-ProjectReaderTests-951549516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:19 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-29986c69-4893-4e49-aad8-3bc97b6e172b tempest-ProjectReaderTests-951549516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:11:19 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-29986c69-4893-4e49-aad8-3bc97b6e172b tempest-ProjectReaderTests-951549516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:11:19 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-29986c69-4893-4e49-aad8-3bc97b6e172b tempest-ProjectReaderTests-951549516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:19 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-29986c69-4893-4e49-aad8-3bc97b6e172b tempest-ProjectReaderTests-951549516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:19 devstack sudo[108540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:11:19 devstack sudo[108540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:19 devstack sudo[108534]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:19 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-aa2ad737-7d60-45f7-b4da-7244b80fae96 tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4a9f3cf0-b839-4d7e-baa7-7e0b8dddc1b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4a9f3cf0-b839-4d7e-baa7-7e0b8dddc1b1.43830ccc-c91a-4e11-9000-e16c04e516ac 1G" returned: 0 in 0.496s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:19 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-aa2ad737-7d60-45f7-b4da-7244b80fae96 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a9f3cf0-b839-4d7e-baa7-7e0b8dddc1b1 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4a9f3cf0-b839-4d7e-baa7-7e0b8dddc1b1.43830ccc-c91a-4e11-9000-e16c04e516ac {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:19 devstack sudo[108543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a9f3cf0-b839-4d7e-baa7-7e0b8dddc1b1 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4a9f3cf0-b839-4d7e-baa7-7e0b8dddc1b1.43830ccc-c91a-4e11-9000-e16c04e516ac Jul 30 17:11:19 devstack sudo[108543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:19 devstack sudo[108540]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:19 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-29986c69-4893-4e49-aad8-3bc97b6e172b tempest-ProjectReaderTests-951549516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.296s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:19 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-29986c69-4893-4e49-aad8-3bc97b6e172b tempest-ProjectReaderTests-951549516 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:11:19 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-29986c69-4893-4e49-aad8-3bc97b6e172b tempest-ProjectReaderTests-951549516 None] Deleted volume successfully. Jul 30 17:11:19 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-29986c69-4893-4e49-aad8-3bc97b6e172b tempest-ProjectReaderTests-951549516 None] Lock "cinder-02e0250c-4370-42e4-b38c-106a3f09c616-delete_volume" released by "delete_volume" :: held 1.237s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:19 devstack sudo[108543]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:19 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-aa2ad737-7d60-45f7-b4da-7244b80fae96 tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a9f3cf0-b839-4d7e-baa7-7e0b8dddc1b1 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4a9f3cf0-b839-4d7e-baa7-7e0b8dddc1b1.43830ccc-c91a-4e11-9000-e16c04e516ac" returned: 0 in 0.375s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:19 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-aa2ad737-7d60-45f7-b4da-7244b80fae96 tempest-ProjectMemberTests-1556323482 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4a9f3cf0-b839-4d7e-baa7-7e0b8dddc1b1.43830ccc-c91a-4e11-9000-e16c04e516ac is being set with open permissions: ugo+rw Jul 30 17:11:19 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-aa2ad737-7d60-45f7-b4da-7244b80fae96 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4a9f3cf0-b839-4d7e-baa7-7e0b8dddc1b1.43830ccc-c91a-4e11-9000-e16c04e516ac {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:19 devstack sudo[108549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4a9f3cf0-b839-4d7e-baa7-7e0b8dddc1b1.43830ccc-c91a-4e11-9000-e16c04e516ac Jul 30 17:11:19 devstack sudo[108549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:20 devstack sudo[108549]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-aa2ad737-7d60-45f7-b4da-7244b80fae96 tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4a9f3cf0-b839-4d7e-baa7-7e0b8dddc1b1.43830ccc-c91a-4e11-9000-e16c04e516ac" returned: 0 in 0.381s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-aa2ad737-7d60-45f7-b4da-7244b80fae96 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4a9f3cf0-b839-4d7e-baa7-7e0b8dddc1b1.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:20 devstack sudo[108552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4a9f3cf0-b839-4d7e-baa7-7e0b8dddc1b1.info Jul 30 17:11:20 devstack sudo[108552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:20 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-b48f50ba-d57f-46c7-be97-58bd9f6c5a22 tempest-ProjectReaderTests-951549516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:11:20 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b48f50ba-d57f-46c7-be97-58bd9f6c5a22 tempest-ProjectReaderTests-951549516 None] Flow 'volume_create_manager' (4fffbd53-7a7f-413f-bb10-23288a24a96a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:11:20 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b48f50ba-d57f-46c7-be97-58bd9f6c5a22 tempest-ProjectReaderTests-951549516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6bd826c-371f-45b0-816c-71be02e11b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:20 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b48f50ba-d57f-46c7-be97-58bd9f6c5a22 tempest-ProjectReaderTests-951549516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6bd826c-371f-45b0-816c-71be02e11b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:11:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2066461066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a632bbb-f295-4c60-b417-15778e1e96ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8da42f52b5744b69919cd88f60236365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:11:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:11:20Z,use_quota=True,user_id='48aa3aa08a444121a7d4b6d51cee1fa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:20 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b48f50ba-d57f-46c7-be97-58bd9f6c5a22 tempest-ProjectReaderTests-951549516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1e5b23d-a3ca-4209-9715-2a2a7185a990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:20 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b48f50ba-d57f-46c7-be97-58bd9f6c5a22 tempest-ProjectReaderTests-951549516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1e5b23d-a3ca-4209-9715-2a2a7185a990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:20 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b48f50ba-d57f-46c7-be97-58bd9f6c5a22 tempest-ProjectReaderTests-951549516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3893480-bddc-4015-8d1b-e63a99987770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:20 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b48f50ba-d57f-46c7-be97-58bd9f6c5a22 tempest-ProjectReaderTests-951549516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3893480-bddc-4015-8d1b-e63a99987770) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a632bbb-f295-4c60-b417-15778e1e96ad', 'volume_name': 'volume-6a632bbb-f295-4c60-b417-15778e1e96ad', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:20 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b48f50ba-d57f-46c7-be97-58bd9f6c5a22 tempest-ProjectReaderTests-951549516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e38b05bb-7b9a-4aa7-9bfe-2b5c407550c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:20 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b48f50ba-d57f-46c7-be97-58bd9f6c5a22 tempest-ProjectReaderTests-951549516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e38b05bb-7b9a-4aa7-9bfe-2b5c407550c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:20 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b48f50ba-d57f-46c7-be97-58bd9f6c5a22 tempest-ProjectReaderTests-951549516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07229dda-15cc-4313-a1cc-d83440118bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:20 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-b48f50ba-d57f-46c7-be97-58bd9f6c5a22 tempest-ProjectReaderTests-951549516 None] Volume 6a632bbb-f295-4c60-b417-15778e1e96ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a632bbb-f295-4c60-b417-15778e1e96ad', 'volume_size': 1} Jul 30 17:11:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-b48f50ba-d57f-46c7-be97-58bd9f6c5a22 tempest-ProjectReaderTests-951549516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:20 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-aacdd703-217d-4de3-8c32-f211d2a22788 tempest-CinderUnicodeTest-333851401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:11:20 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-aacdd703-217d-4de3-8c32-f211d2a22788 tempest-CinderUnicodeTest-333851401 None] Flow 'volume_create_manager' (6fd50b36-bace-4747-8166-df110b09a130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:11:20 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-aacdd703-217d-4de3-8c32-f211d2a22788 tempest-CinderUnicodeTest-333851401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e226006-fa6d-42b5-8a96-9e33fe9986c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:20 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-aacdd703-217d-4de3-8c32-f211d2a22788 tempest-CinderUnicodeTest-333851401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e226006-fa6d-42b5-8a96-9e33fe9986c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:11:20Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1512056443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=953b1aaf-f3b2-47f8-8f21-6ba3608035aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='652e2b0d8e744a54be3c3c988475b7e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:11:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:11:20Z,use_quota=True,user_id='25ee1f8d5f874aa2ac625900368ef408',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:20 devstack sudo[108552]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:20 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-aacdd703-217d-4de3-8c32-f211d2a22788 tempest-CinderUnicodeTest-333851401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (705e6969-2f2e-482a-a25f-0ee4361faea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:20 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-aacdd703-217d-4de3-8c32-f211d2a22788 tempest-CinderUnicodeTest-333851401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (705e6969-2f2e-482a-a25f-0ee4361faea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:20 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-aacdd703-217d-4de3-8c32-f211d2a22788 tempest-CinderUnicodeTest-333851401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afe028f4-3b15-49a3-bf37-ee02a341816e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:20 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-aacdd703-217d-4de3-8c32-f211d2a22788 tempest-CinderUnicodeTest-333851401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afe028f4-3b15-49a3-bf37-ee02a341816e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '953b1aaf-f3b2-47f8-8f21-6ba3608035aa', 'volume_name': 'volume-953b1aaf-f3b2-47f8-8f21-6ba3608035aa', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:20 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-aacdd703-217d-4de3-8c32-f211d2a22788 tempest-CinderUnicodeTest-333851401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84030956-2d3a-407a-9aaa-4327d58dfaf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:20 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-aacdd703-217d-4de3-8c32-f211d2a22788 tempest-CinderUnicodeTest-333851401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84030956-2d3a-407a-9aaa-4327d58dfaf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:20 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-aacdd703-217d-4de3-8c32-f211d2a22788 tempest-CinderUnicodeTest-333851401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69bb364f-9358-46a6-a570-d692263b912d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:20 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-aacdd703-217d-4de3-8c32-f211d2a22788 tempest-CinderUnicodeTest-333851401 None] Volume 953b1aaf-f3b2-47f8-8f21-6ba3608035aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-953b1aaf-f3b2-47f8-8f21-6ba3608035aa', 'volume_size': 1} Jul 30 17:11:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-aacdd703-217d-4de3-8c32-f211d2a22788 tempest-CinderUnicodeTest-333851401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-aa2ad737-7d60-45f7-b4da-7244b80fae96 tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4a9f3cf0-b839-4d7e-baa7-7e0b8dddc1b1.info" returned: 0 in 0.355s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:20 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-aa2ad737-7d60-45f7-b4da-7244b80fae96 tempest-ProjectMemberTests-1556323482 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4a9f3cf0-b839-4d7e-baa7-7e0b8dddc1b1.info is being set with open permissions: ugo+rw Jul 30 17:11:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-aa2ad737-7d60-45f7-b4da-7244b80fae96 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4a9f3cf0-b839-4d7e-baa7-7e0b8dddc1b1.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:20 devstack sudo[108555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4a9f3cf0-b839-4d7e-baa7-7e0b8dddc1b1.info Jul 30 17:11:20 devstack sudo[108555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:20 devstack sudo[108555]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-aa2ad737-7d60-45f7-b4da-7244b80fae96 tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4a9f3cf0-b839-4d7e-baa7-7e0b8dddc1b1.info" returned: 0 in 0.267s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-aa2ad737-7d60-45f7-b4da-7244b80fae96 tempest-ProjectMemberTests-1556323482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.388s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-b48f50ba-d57f-46c7-be97-58bd9f6c5a22 tempest-ProjectReaderTests-951549516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.512s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:20 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-b48f50ba-d57f-46c7-be97-58bd9f6c5a22 tempest-ProjectReaderTests-951549516 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:11:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2066461066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a632bbb-f295-4c60-b417-15778e1e96ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8da42f52b5744b69919cd88f60236365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:11:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:11:20Z,use_quota=True,user_id='48aa3aa08a444121a7d4b6d51cee1fa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:11:20 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-b48f50ba-d57f-46c7-be97-58bd9f6c5a22 tempest-ProjectReaderTests-951549516 None] Creating volume 6a632bbb-f295-4c60-b417-15778e1e96ad {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:11:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-b48f50ba-d57f-46c7-be97-58bd9f6c5a22 tempest-ProjectReaderTests-951549516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-b48f50ba-d57f-46c7-be97-58bd9f6c5a22 tempest-ProjectReaderTests-951549516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:20 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-b48f50ba-d57f-46c7-be97-58bd9f6c5a22 tempest-ProjectReaderTests-951549516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:11:20 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-b48f50ba-d57f-46c7-be97-58bd9f6c5a22 tempest-ProjectReaderTests-951549516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:11:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-b48f50ba-d57f-46c7-be97-58bd9f6c5a22 tempest-ProjectReaderTests-951549516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:20 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-b48f50ba-d57f-46c7-be97-58bd9f6c5a22 tempest-ProjectReaderTests-951549516 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:11:20 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-b48f50ba-d57f-46c7-be97-58bd9f6c5a22 tempest-ProjectReaderTests-951549516 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:11:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-b48f50ba-d57f-46c7-be97-58bd9f6c5a22 tempest-ProjectReaderTests-951549516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6a632bbb-f295-4c60-b417-15778e1e96ad 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:20 devstack sudo[108558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6a632bbb-f295-4c60-b417-15778e1e96ad 1073741824 Jul 30 17:11:20 devstack sudo[108558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:20 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-aa2ad737-7d60-45f7-b4da-7244b80fae96 tempest-ProjectMemberTests-1556323482 None] Create snapshot completed successfully Jul 30 17:11:20 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-a4d0c913-1620-4256-ba7b-27fceebd6f83 tempest-ProjectMemberTests-1556323482 None] Acquiring lock "cinder-43830ccc-c91a-4e11-9000-e16c04e516ac-delete_snapshot" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:21 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-a4d0c913-1620-4256-ba7b-27fceebd6f83 tempest-ProjectMemberTests-1556323482 None] Lock "cinder-43830ccc-c91a-4e11-9000-e16c04e516ac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:21 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-a4d0c913-1620-4256-ba7b-27fceebd6f83 tempest-ProjectMemberTests-1556323482 None] Acquiring lock "cinder-quobyte-4a9f3cf0-b839-4d7e-baa7-7e0b8dddc1b1" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:21 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-a4d0c913-1620-4256-ba7b-27fceebd6f83 tempest-ProjectMemberTests-1556323482 None] Lock "cinder-quobyte-4a9f3cf0-b839-4d7e-baa7-7e0b8dddc1b1" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:21 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-a4d0c913-1620-4256-ba7b-27fceebd6f83 tempest-ProjectMemberTests-1556323482 None] Acquiring lock "cinder-quobyte-43830ccc-c91a-4e11-9000-e16c04e516ac" by "_delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:21 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-a4d0c913-1620-4256-ba7b-27fceebd6f83 tempest-ProjectMemberTests-1556323482 None] Lock "cinder-quobyte-43830ccc-c91a-4e11-9000-e16c04e516ac" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:21 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-a4d0c913-1620-4256-ba7b-27fceebd6f83 tempest-ProjectMemberTests-1556323482 None] Deleting offline snapshot 43830ccc-c91a-4e11-9000-e16c04e516ac of volume 4a9f3cf0-b839-4d7e-baa7-7e0b8dddc1b1 {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:11:21 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-a4d0c913-1620-4256-ba7b-27fceebd6f83 tempest-ProjectMemberTests-1556323482 None] snapshot_file for this snap is: volume-4a9f3cf0-b839-4d7e-baa7-7e0b8dddc1b1.43830ccc-c91a-4e11-9000-e16c04e516ac {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:11:21 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa8d75ac-ed54-4e24-87e3-dfc20d3bde1c]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:11:21 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a4d0c913-1620-4256-ba7b-27fceebd6f83 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4a9f3cf0-b839-4d7e-baa7-7e0b8dddc1b1.43830ccc-c91a-4e11-9000-e16c04e516ac {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:21 devstack sudo[108562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4a9f3cf0-b839-4d7e-baa7-7e0b8dddc1b1.43830ccc-c91a-4e11-9000-e16c04e516ac Jul 30 17:11:21 devstack sudo[108562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:21 devstack sudo[108558]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:21 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-b48f50ba-d57f-46c7-be97-58bd9f6c5a22 tempest-ProjectReaderTests-951549516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6a632bbb-f295-4c60-b417-15778e1e96ad 1073741824" returned: 0 in 0.585s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:21 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-b48f50ba-d57f-46c7-be97-58bd9f6c5a22 tempest-ProjectReaderTests-951549516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6a632bbb-f295-4c60-b417-15778e1e96ad {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:21 devstack sudo[108565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6a632bbb-f295-4c60-b417-15778e1e96ad Jul 30 17:11:21 devstack sudo[108565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:21 devstack sudo[108562]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:21 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a4d0c913-1620-4256-ba7b-27fceebd6f83 tempest-ProjectMemberTests-1556323482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4a9f3cf0-b839-4d7e-baa7-7e0b8dddc1b1.43830ccc-c91a-4e11-9000-e16c04e516ac" returned: 0 in 0.429s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:21 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-a4d0c913-1620-4256-ba7b-27fceebd6f83 tempest-ProjectMemberTests-1556323482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a9f3cf0-b839-4d7e-baa7-7e0b8dddc1b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:11:21 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[654ff2c8-d4ee-4957-8701-1970dbb30d82]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:11:21 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a4d0c913-1620-4256-ba7b-27fceebd6f83 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4a9f3cf0-b839-4d7e-baa7-7e0b8dddc1b1 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:21 devstack sudo[108565]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:21 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-b48f50ba-d57f-46c7-be97-58bd9f6c5a22 tempest-ProjectReaderTests-951549516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6a632bbb-f295-4c60-b417-15778e1e96ad" returned: 0 in 0.279s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:21 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-b48f50ba-d57f-46c7-be97-58bd9f6c5a22 tempest-ProjectReaderTests-951549516 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:11:21 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-b48f50ba-d57f-46c7-be97-58bd9f6c5a22 tempest-ProjectReaderTests-951549516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:21 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-aacdd703-217d-4de3-8c32-f211d2a22788 tempest-CinderUnicodeTest-333851401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.215s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:21 devstack sudo[108570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4a9f3cf0-b839-4d7e-baa7-7e0b8dddc1b1 Jul 30 17:11:21 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-aacdd703-217d-4de3-8c32-f211d2a22788 tempest-CinderUnicodeTest-333851401 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:11:20Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1512056443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=953b1aaf-f3b2-47f8-8f21-6ba3608035aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='652e2b0d8e744a54be3c3c988475b7e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:11:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:11:20Z,use_quota=True,user_id='25ee1f8d5f874aa2ac625900368ef408',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:11:21 devstack sudo[108570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:21 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-aacdd703-217d-4de3-8c32-f211d2a22788 tempest-CinderUnicodeTest-333851401 None] Creating volume 953b1aaf-f3b2-47f8-8f21-6ba3608035aa {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:11:21 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-aacdd703-217d-4de3-8c32-f211d2a22788 tempest-CinderUnicodeTest-333851401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:21 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-aacdd703-217d-4de3-8c32-f211d2a22788 tempest-CinderUnicodeTest-333851401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:21 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-aacdd703-217d-4de3-8c32-f211d2a22788 tempest-CinderUnicodeTest-333851401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:11:21 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-aacdd703-217d-4de3-8c32-f211d2a22788 tempest-CinderUnicodeTest-333851401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:11:21 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-aacdd703-217d-4de3-8c32-f211d2a22788 tempest-CinderUnicodeTest-333851401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:21 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-aacdd703-217d-4de3-8c32-f211d2a22788 tempest-CinderUnicodeTest-333851401 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:11:21 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-aacdd703-217d-4de3-8c32-f211d2a22788 tempest-CinderUnicodeTest-333851401 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:11:21 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-aacdd703-217d-4de3-8c32-f211d2a22788 tempest-CinderUnicodeTest-333851401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-953b1aaf-f3b2-47f8-8f21-6ba3608035aa 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:21 devstack sudo[108573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-953b1aaf-f3b2-47f8-8f21-6ba3608035aa 1073741824 Jul 30 17:11:21 devstack sudo[108573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:21 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b48f50ba-d57f-46c7-be97-58bd9f6c5a22 tempest-ProjectReaderTests-951549516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07229dda-15cc-4313-a1cc-d83440118bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a632bbb-f295-4c60-b417-15778e1e96ad', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:21 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b48f50ba-d57f-46c7-be97-58bd9f6c5a22 tempest-ProjectReaderTests-951549516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a66dcc85-4e28-4179-aae5-0d5bf9971796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:21 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-b48f50ba-d57f-46c7-be97-58bd9f6c5a22 tempest-ProjectReaderTests-951549516 None] Volume volume-6a632bbb-f295-4c60-b417-15778e1e96ad (6a632bbb-f295-4c60-b417-15778e1e96ad): created successfully Jul 30 17:11:21 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b48f50ba-d57f-46c7-be97-58bd9f6c5a22 tempest-ProjectReaderTests-951549516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a66dcc85-4e28-4179-aae5-0d5bf9971796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:21 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b48f50ba-d57f-46c7-be97-58bd9f6c5a22 tempest-ProjectReaderTests-951549516 None] Flow 'volume_create_manager' (4fffbd53-7a7f-413f-bb10-23288a24a96a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:11:21 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-b48f50ba-d57f-46c7-be97-58bd9f6c5a22 tempest-ProjectReaderTests-951549516 None] Created volume successfully. Jul 30 17:11:21 devstack sudo[108570]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:21 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a4d0c913-1620-4256-ba7b-27fceebd6f83 tempest-ProjectMemberTests-1556323482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4a9f3cf0-b839-4d7e-baa7-7e0b8dddc1b1" returned: 0 in 0.418s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:21 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a4d0c913-1620-4256-ba7b-27fceebd6f83 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4a9f3cf0-b839-4d7e-baa7-7e0b8dddc1b1.43830ccc-c91a-4e11-9000-e16c04e516ac {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:22 devstack sudo[108582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4a9f3cf0-b839-4d7e-baa7-7e0b8dddc1b1.43830ccc-c91a-4e11-9000-e16c04e516ac Jul 30 17:11:22 devstack sudo[108582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:22 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-95eec59f-6fde-4db7-8bd8-4ad4ffe26a3e tempest-ProjectReaderTests-951549516 None] Acquiring lock "cinder-6a632bbb-f295-4c60-b417-15778e1e96ad-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:22 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-95eec59f-6fde-4db7-8bd8-4ad4ffe26a3e tempest-ProjectReaderTests-951549516 None] Lock "cinder-6a632bbb-f295-4c60-b417-15778e1e96ad-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:22 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-95eec59f-6fde-4db7-8bd8-4ad4ffe26a3e tempest-ProjectReaderTests-951549516 None] Acquiring lock "cinder-quobyte-6a632bbb-f295-4c60-b417-15778e1e96ad" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:22 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-95eec59f-6fde-4db7-8bd8-4ad4ffe26a3e tempest-ProjectReaderTests-951549516 None] Lock "cinder-quobyte-6a632bbb-f295-4c60-b417-15778e1e96ad" acquired by "delete_volume" :: waited 0.028s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:22 devstack sudo[108573]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:22 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-aacdd703-217d-4de3-8c32-f211d2a22788 tempest-CinderUnicodeTest-333851401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-953b1aaf-f3b2-47f8-8f21-6ba3608035aa 1073741824" returned: 0 in 0.617s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:22 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[a588766a-c770-4aa7-a8e3-17606078b4ee]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:11:22 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-95eec59f-6fde-4db7-8bd8-4ad4ffe26a3e tempest-ProjectReaderTests-951549516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6a632bbb-f295-4c60-b417-15778e1e96ad {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:22 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-aacdd703-217d-4de3-8c32-f211d2a22788 tempest-CinderUnicodeTest-333851401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-953b1aaf-f3b2-47f8-8f21-6ba3608035aa {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:22 devstack sudo[108582]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:22 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a4d0c913-1620-4256-ba7b-27fceebd6f83 tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4a9f3cf0-b839-4d7e-baa7-7e0b8dddc1b1.43830ccc-c91a-4e11-9000-e16c04e516ac" returned: 0 in 0.438s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:22 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a4d0c913-1620-4256-ba7b-27fceebd6f83 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4a9f3cf0-b839-4d7e-baa7-7e0b8dddc1b1.43830ccc-c91a-4e11-9000-e16c04e516ac {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:22 devstack sudo[108590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-953b1aaf-f3b2-47f8-8f21-6ba3608035aa Jul 30 17:11:22 devstack sudo[108590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:22 devstack sudo[108592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4a9f3cf0-b839-4d7e-baa7-7e0b8dddc1b1.43830ccc-c91a-4e11-9000-e16c04e516ac Jul 30 17:11:22 devstack sudo[108592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:22 devstack sudo[108589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6a632bbb-f295-4c60-b417-15778e1e96ad Jul 30 17:11:22 devstack sudo[108589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:22 devstack sudo[108590]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:22 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-aacdd703-217d-4de3-8c32-f211d2a22788 tempest-CinderUnicodeTest-333851401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-953b1aaf-f3b2-47f8-8f21-6ba3608035aa" returned: 0 in 0.278s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:22 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-aacdd703-217d-4de3-8c32-f211d2a22788 tempest-CinderUnicodeTest-333851401 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:11:22 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-aacdd703-217d-4de3-8c32-f211d2a22788 tempest-CinderUnicodeTest-333851401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:22 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-aacdd703-217d-4de3-8c32-f211d2a22788 tempest-CinderUnicodeTest-333851401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69bb364f-9358-46a6-a570-d692263b912d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-953b1aaf-f3b2-47f8-8f21-6ba3608035aa', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:22 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-aacdd703-217d-4de3-8c32-f211d2a22788 tempest-CinderUnicodeTest-333851401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18bb14ae-92c6-4dc4-a9de-cbd8c49978b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:22 devstack sudo[108592]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:22 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a4d0c913-1620-4256-ba7b-27fceebd6f83 tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4a9f3cf0-b839-4d7e-baa7-7e0b8dddc1b1.43830ccc-c91a-4e11-9000-e16c04e516ac" returned: 0 in 0.287s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:22 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-aacdd703-217d-4de3-8c32-f211d2a22788 tempest-CinderUnicodeTest-333851401 None] Volume volume-953b1aaf-f3b2-47f8-8f21-6ba3608035aa (953b1aaf-f3b2-47f8-8f21-6ba3608035aa): created successfully Jul 30 17:11:22 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-aacdd703-217d-4de3-8c32-f211d2a22788 tempest-CinderUnicodeTest-333851401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18bb14ae-92c6-4dc4-a9de-cbd8c49978b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:22 devstack sudo[108589]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:22 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-aacdd703-217d-4de3-8c32-f211d2a22788 tempest-CinderUnicodeTest-333851401 None] Flow 'volume_create_manager' (6fd50b36-bace-4747-8166-df110b09a130) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:11:22 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-a4d0c913-1620-4256-ba7b-27fceebd6f83 tempest-ProjectMemberTests-1556323482 None] Lock "cinder-quobyte-43830ccc-c91a-4e11-9000-e16c04e516ac" released by "_delete_snapshot" :: held 1.707s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:22 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-95eec59f-6fde-4db7-8bd8-4ad4ffe26a3e tempest-ProjectReaderTests-951549516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6a632bbb-f295-4c60-b417-15778e1e96ad" returned: 0 in 0.436s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:22 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-95eec59f-6fde-4db7-8bd8-4ad4ffe26a3e tempest-ProjectReaderTests-951549516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6a632bbb-f295-4c60-b417-15778e1e96ad {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:22 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-a4d0c913-1620-4256-ba7b-27fceebd6f83 tempest-ProjectMemberTests-1556323482 None] Lock "cinder-quobyte-4a9f3cf0-b839-4d7e-baa7-7e0b8dddc1b1" released by "delete_snapshot" :: held 1.748s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:22 devstack sudo[108600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6a632bbb-f295-4c60-b417-15778e1e96ad Jul 30 17:11:22 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-aacdd703-217d-4de3-8c32-f211d2a22788 tempest-CinderUnicodeTest-333851401 None] Created volume successfully. Jul 30 17:11:22 devstack sudo[108600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:22 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-a4d0c913-1620-4256-ba7b-27fceebd6f83 tempest-ProjectMemberTests-1556323482 None] Created reservations ['c00cbbc1-f144-4f53-b7fa-bb503cf29934', 'cdbe2372-f29b-4a26-b7b9-7f4c887b3360', 'dfad31d0-bcad-4b0e-bf01-8e42213aa3c3', '34436548-9756-4928-b90d-21a160b71905'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:11:22 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-a4d0c913-1620-4256-ba7b-27fceebd6f83 tempest-ProjectMemberTests-1556323482 None] Delete snapshot completed successfully. Jul 30 17:11:22 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-a4d0c913-1620-4256-ba7b-27fceebd6f83 tempest-ProjectMemberTests-1556323482 None] Lock "cinder-43830ccc-c91a-4e11-9000-e16c04e516ac-delete_snapshot" released by "delete_snapshot" :: held 1.919s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:23 devstack sudo[108600]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:23 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-95eec59f-6fde-4db7-8bd8-4ad4ffe26a3e tempest-ProjectReaderTests-951549516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6a632bbb-f295-4c60-b417-15778e1e96ad" returned: 0 in 0.300s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:23 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-95eec59f-6fde-4db7-8bd8-4ad4ffe26a3e tempest-ProjectReaderTests-951549516 None] Lock "cinder-quobyte-6a632bbb-f295-4c60-b417-15778e1e96ad" released by "delete_volume" :: held 0.778s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:23 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-95eec59f-6fde-4db7-8bd8-4ad4ffe26a3e tempest-ProjectReaderTests-951549516 None] Created reservations ['6acfc0ae-b54f-4453-a3c1-38d44fb62088', 'dfe4d70a-9d16-4e6f-a2d6-86bac5c24ec6', 'dbfd76d7-766b-4351-9672-78278976a37f', '515fef19-f73d-46b5-8849-bf3ed1ec379d'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:11:23 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-95eec59f-6fde-4db7-8bd8-4ad4ffe26a3e tempest-ProjectReaderTests-951549516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:23 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-95eec59f-6fde-4db7-8bd8-4ad4ffe26a3e tempest-ProjectReaderTests-951549516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:23 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-95eec59f-6fde-4db7-8bd8-4ad4ffe26a3e tempest-ProjectReaderTests-951549516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:11:23 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-95eec59f-6fde-4db7-8bd8-4ad4ffe26a3e tempest-ProjectReaderTests-951549516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:11:23 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-95eec59f-6fde-4db7-8bd8-4ad4ffe26a3e tempest-ProjectReaderTests-951549516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:23 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-95eec59f-6fde-4db7-8bd8-4ad4ffe26a3e tempest-ProjectReaderTests-951549516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:23 devstack sudo[108603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:11:23 devstack sudo[108603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:23 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-2671b7c9-60b5-4f00-a512-a79efcf677e6 tempest-ProjectMemberTests-1556323482 None] Acquiring lock "cinder-4a9f3cf0-b839-4d7e-baa7-7e0b8dddc1b1-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:23 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-2671b7c9-60b5-4f00-a512-a79efcf677e6 tempest-ProjectMemberTests-1556323482 None] Lock "cinder-4a9f3cf0-b839-4d7e-baa7-7e0b8dddc1b1-delete_volume" acquired by "delete_volume" :: waited 0.190s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:23 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-2671b7c9-60b5-4f00-a512-a79efcf677e6 tempest-ProjectMemberTests-1556323482 None] Acquiring lock "cinder-quobyte-4a9f3cf0-b839-4d7e-baa7-7e0b8dddc1b1" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:23 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-2671b7c9-60b5-4f00-a512-a79efcf677e6 tempest-ProjectMemberTests-1556323482 None] Lock "cinder-quobyte-4a9f3cf0-b839-4d7e-baa7-7e0b8dddc1b1" acquired by "delete_volume" :: waited 0.019s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:23 devstack sudo[108603]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:23 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-95eec59f-6fde-4db7-8bd8-4ad4ffe26a3e tempest-ProjectReaderTests-951549516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.363s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:23 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-95eec59f-6fde-4db7-8bd8-4ad4ffe26a3e tempest-ProjectReaderTests-951549516 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:11:23 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b2ca631-8a01-4bbb-bec9-b8fc5375249d]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:11:23 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2671b7c9-60b5-4f00-a512-a79efcf677e6 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4a9f3cf0-b839-4d7e-baa7-7e0b8dddc1b1 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:23 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-95eec59f-6fde-4db7-8bd8-4ad4ffe26a3e tempest-ProjectReaderTests-951549516 None] Deleted volume successfully. Jul 30 17:11:23 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-95eec59f-6fde-4db7-8bd8-4ad4ffe26a3e tempest-ProjectReaderTests-951549516 None] Lock "cinder-6a632bbb-f295-4c60-b417-15778e1e96ad-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:23 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0f4138f-7c53-4dd7-abd7-84ecd4a281b7 tempest-ProjectReaderTests-1751321275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:11:23 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a0f4138f-7c53-4dd7-abd7-84ecd4a281b7 tempest-ProjectReaderTests-1751321275 None] Flow 'volume_create_manager' (792c8ab5-07f1-4254-8da9-3b31ce75b075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:11:23 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a0f4138f-7c53-4dd7-abd7-84ecd4a281b7 tempest-ProjectReaderTests-1751321275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19cf5442-7947-4d85-b309-614ad664d664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:23 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a0f4138f-7c53-4dd7-abd7-84ecd4a281b7 tempest-ProjectReaderTests-1751321275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19cf5442-7947-4d85-b309-614ad664d664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:11:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1453924374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b76a537-3240-4b02-8979-a2652cb56ab7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c2e1dbeba134328b1df968d75d88cf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:11:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:11:24Z,use_quota=True,user_id='afd6865e007047c58ec4822a3b207b25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:23 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a0f4138f-7c53-4dd7-abd7-84ecd4a281b7 tempest-ProjectReaderTests-1751321275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfa3195b-54d2-4c27-a44c-0346741267cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:23 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a0f4138f-7c53-4dd7-abd7-84ecd4a281b7 tempest-ProjectReaderTests-1751321275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfa3195b-54d2-4c27-a44c-0346741267cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:23 devstack sudo[108606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4a9f3cf0-b839-4d7e-baa7-7e0b8dddc1b1 Jul 30 17:11:23 devstack sudo[108606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:23 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a0f4138f-7c53-4dd7-abd7-84ecd4a281b7 tempest-ProjectReaderTests-1751321275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (088bf6b9-a868-48a1-9660-7b9adf4f797f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:23 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a0f4138f-7c53-4dd7-abd7-84ecd4a281b7 tempest-ProjectReaderTests-1751321275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (088bf6b9-a868-48a1-9660-7b9adf4f797f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b76a537-3240-4b02-8979-a2652cb56ab7', 'volume_name': 'volume-5b76a537-3240-4b02-8979-a2652cb56ab7', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:23 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a0f4138f-7c53-4dd7-abd7-84ecd4a281b7 tempest-ProjectReaderTests-1751321275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57258cfd-1945-4c86-a2ff-eda294e3f51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:23 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a0f4138f-7c53-4dd7-abd7-84ecd4a281b7 tempest-ProjectReaderTests-1751321275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57258cfd-1945-4c86-a2ff-eda294e3f51b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:23 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a0f4138f-7c53-4dd7-abd7-84ecd4a281b7 tempest-ProjectReaderTests-1751321275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18551e7c-0899-4d58-9879-83d730c91a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:23 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-a0f4138f-7c53-4dd7-abd7-84ecd4a281b7 tempest-ProjectReaderTests-1751321275 None] Volume 5b76a537-3240-4b02-8979-a2652cb56ab7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b76a537-3240-4b02-8979-a2652cb56ab7', 'volume_size': 1} Jul 30 17:11:23 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a0f4138f-7c53-4dd7-abd7-84ecd4a281b7 tempest-ProjectReaderTests-1751321275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:23 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a0f4138f-7c53-4dd7-abd7-84ecd4a281b7 tempest-ProjectReaderTests-1751321275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:23 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-a0f4138f-7c53-4dd7-abd7-84ecd4a281b7 tempest-ProjectReaderTests-1751321275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:11:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1453924374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b76a537-3240-4b02-8979-a2652cb56ab7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c2e1dbeba134328b1df968d75d88cf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:11:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:11:24Z,use_quota=True,user_id='afd6865e007047c58ec4822a3b207b25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:11:23 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-a0f4138f-7c53-4dd7-abd7-84ecd4a281b7 tempest-ProjectReaderTests-1751321275 None] Creating volume 5b76a537-3240-4b02-8979-a2652cb56ab7 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:11:23 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a0f4138f-7c53-4dd7-abd7-84ecd4a281b7 tempest-ProjectReaderTests-1751321275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:23 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a0f4138f-7c53-4dd7-abd7-84ecd4a281b7 tempest-ProjectReaderTests-1751321275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:23 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-a0f4138f-7c53-4dd7-abd7-84ecd4a281b7 tempest-ProjectReaderTests-1751321275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:11:23 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-a0f4138f-7c53-4dd7-abd7-84ecd4a281b7 tempest-ProjectReaderTests-1751321275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:11:23 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a0f4138f-7c53-4dd7-abd7-84ecd4a281b7 tempest-ProjectReaderTests-1751321275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:23 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-a0f4138f-7c53-4dd7-abd7-84ecd4a281b7 tempest-ProjectReaderTests-1751321275 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:11:23 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-a0f4138f-7c53-4dd7-abd7-84ecd4a281b7 tempest-ProjectReaderTests-1751321275 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:11:23 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a0f4138f-7c53-4dd7-abd7-84ecd4a281b7 tempest-ProjectReaderTests-1751321275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5b76a537-3240-4b02-8979-a2652cb56ab7 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:23 devstack sudo[108608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5b76a537-3240-4b02-8979-a2652cb56ab7 1073741824 Jul 30 17:11:23 devstack sudo[108608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:23 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-3650d074-7196-46e4-9d26-122738fdceaa tempest-CinderUnicodeTest-333851401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:24 devstack sudo[108606]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2671b7c9-60b5-4f00-a512-a79efcf677e6 tempest-ProjectMemberTests-1556323482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4a9f3cf0-b839-4d7e-baa7-7e0b8dddc1b1" returned: 0 in 0.512s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2671b7c9-60b5-4f00-a512-a79efcf677e6 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4a9f3cf0-b839-4d7e-baa7-7e0b8dddc1b1 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:24 devstack sudo[108615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4a9f3cf0-b839-4d7e-baa7-7e0b8dddc1b1 Jul 30 17:11:24 devstack sudo[108615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:24 devstack sudo[108608]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a0f4138f-7c53-4dd7-abd7-84ecd4a281b7 tempest-ProjectReaderTests-1751321275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5b76a537-3240-4b02-8979-a2652cb56ab7 1073741824" returned: 0 in 0.519s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:24 devstack sudo[108615]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2671b7c9-60b5-4f00-a512-a79efcf677e6 tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-4a9f3cf0-b839-4d7e-baa7-7e0b8dddc1b1" returned: 0 in 0.276s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a0f4138f-7c53-4dd7-abd7-84ecd4a281b7 tempest-ProjectReaderTests-1751321275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5b76a537-3240-4b02-8979-a2652cb56ab7 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:24 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-2671b7c9-60b5-4f00-a512-a79efcf677e6 tempest-ProjectMemberTests-1556323482 None] Lock "cinder-quobyte-4a9f3cf0-b839-4d7e-baa7-7e0b8dddc1b1" released by "delete_volume" :: held 0.885s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:24 devstack sudo[108620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5b76a537-3240-4b02-8979-a2652cb56ab7 Jul 30 17:11:24 devstack sudo[108620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:24 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-2671b7c9-60b5-4f00-a512-a79efcf677e6 tempest-ProjectMemberTests-1556323482 None] Created reservations ['faea75b7-2371-4bba-b50b-7ef5fb0e7a63', '48a9873a-de0b-4aae-aca2-95b914fb926a', '7d6096ff-d332-419e-af47-b0aefc2c4f43', 'dc77ab12-cb79-4487-aab1-e89af39973fe'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:11:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-2671b7c9-60b5-4f00-a512-a79efcf677e6 tempest-ProjectMemberTests-1556323482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-2671b7c9-60b5-4f00-a512-a79efcf677e6 tempest-ProjectMemberTests-1556323482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:24 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-2671b7c9-60b5-4f00-a512-a79efcf677e6 tempest-ProjectMemberTests-1556323482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:11:24 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-2671b7c9-60b5-4f00-a512-a79efcf677e6 tempest-ProjectMemberTests-1556323482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:11:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-2671b7c9-60b5-4f00-a512-a79efcf677e6 tempest-ProjectMemberTests-1556323482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2671b7c9-60b5-4f00-a512-a79efcf677e6 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:24 devstack sudo[108622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:11:24 devstack sudo[108622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:24 devstack sudo[108620]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a0f4138f-7c53-4dd7-abd7-84ecd4a281b7 tempest-ProjectReaderTests-1751321275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5b76a537-3240-4b02-8979-a2652cb56ab7" returned: 0 in 0.296s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:24 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-a0f4138f-7c53-4dd7-abd7-84ecd4a281b7 tempest-ProjectReaderTests-1751321275 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:11:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a0f4138f-7c53-4dd7-abd7-84ecd4a281b7 tempest-ProjectReaderTests-1751321275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-3650d074-7196-46e4-9d26-122738fdceaa tempest-CinderUnicodeTest-333851401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.826s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:24 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-3650d074-7196-46e4-9d26-122738fdceaa tempest-CinderUnicodeTest-333851401 None] Creating offline snapshot aed25e69-db04-4bd2-b72f-ce4b64faa43e of volume 953b1aaf-f3b2-47f8-8f21-6ba3608035aa {{(pid=88568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:11:24 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a0f4138f-7c53-4dd7-abd7-84ecd4a281b7 tempest-ProjectReaderTests-1751321275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18551e7c-0899-4d58-9879-83d730c91a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b76a537-3240-4b02-8979-a2652cb56ab7', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:24 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a0f4138f-7c53-4dd7-abd7-84ecd4a281b7 tempest-ProjectReaderTests-1751321275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b147831a-a882-4d4c-a982-54b8d402bce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:24 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffbd1d59-990e-4430-a32f-4e35f3287014]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:11:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-3650d074-7196-46e4-9d26-122738fdceaa tempest-CinderUnicodeTest-333851401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-953b1aaf-f3b2-47f8-8f21-6ba3608035aa {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:24 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-a0f4138f-7c53-4dd7-abd7-84ecd4a281b7 tempest-ProjectReaderTests-1751321275 None] Volume volume-5b76a537-3240-4b02-8979-a2652cb56ab7 (5b76a537-3240-4b02-8979-a2652cb56ab7): created successfully Jul 30 17:11:24 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a0f4138f-7c53-4dd7-abd7-84ecd4a281b7 tempest-ProjectReaderTests-1751321275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b147831a-a882-4d4c-a982-54b8d402bce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:24 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-a0f4138f-7c53-4dd7-abd7-84ecd4a281b7 tempest-ProjectReaderTests-1751321275 None] Flow 'volume_create_manager' (792c8ab5-07f1-4254-8da9-3b31ce75b075) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:11:24 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-a0f4138f-7c53-4dd7-abd7-84ecd4a281b7 tempest-ProjectReaderTests-1751321275 None] Created volume successfully. Jul 30 17:11:24 devstack sudo[108622]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:24 devstack sudo[108625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-953b1aaf-f3b2-47f8-8f21-6ba3608035aa Jul 30 17:11:24 devstack sudo[108625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:24 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2671b7c9-60b5-4f00-a512-a79efcf677e6 tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.341s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:24 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-2671b7c9-60b5-4f00-a512-a79efcf677e6 tempest-ProjectMemberTests-1556323482 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:11:24 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-2671b7c9-60b5-4f00-a512-a79efcf677e6 tempest-ProjectMemberTests-1556323482 None] Deleted volume successfully. Jul 30 17:11:24 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-2671b7c9-60b5-4f00-a512-a79efcf677e6 tempest-ProjectMemberTests-1556323482 None] Lock "cinder-4a9f3cf0-b839-4d7e-baa7-7e0b8dddc1b1-delete_volume" released by "delete_volume" :: held 1.482s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:25 devstack sudo[108625]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:25 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-3650d074-7196-46e4-9d26-122738fdceaa tempest-CinderUnicodeTest-333851401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-953b1aaf-f3b2-47f8-8f21-6ba3608035aa" returned: 0 in 0.421s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:25 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-3650d074-7196-46e4-9d26-122738fdceaa tempest-CinderUnicodeTest-333851401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-953b1aaf-f3b2-47f8-8f21-6ba3608035aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-953b1aaf-f3b2-47f8-8f21-6ba3608035aa.aed25e69-db04-4bd2-b72f-ce4b64faa43e 1G {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:25 devstack sudo[108632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-953b1aaf-f3b2-47f8-8f21-6ba3608035aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-953b1aaf-f3b2-47f8-8f21-6ba3608035aa.aed25e69-db04-4bd2-b72f-ce4b64faa43e 1G Jul 30 17:11:25 devstack sudo[108632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:25 devstack sudo[108632]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:25 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-3650d074-7196-46e4-9d26-122738fdceaa tempest-CinderUnicodeTest-333851401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-953b1aaf-f3b2-47f8-8f21-6ba3608035aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-953b1aaf-f3b2-47f8-8f21-6ba3608035aa.aed25e69-db04-4bd2-b72f-ce4b64faa43e 1G" returned: 0 in 0.440s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:25 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-3650d074-7196-46e4-9d26-122738fdceaa tempest-CinderUnicodeTest-333851401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-953b1aaf-f3b2-47f8-8f21-6ba3608035aa -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-953b1aaf-f3b2-47f8-8f21-6ba3608035aa.aed25e69-db04-4bd2-b72f-ce4b64faa43e {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:25 devstack sudo[108638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-953b1aaf-f3b2-47f8-8f21-6ba3608035aa -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-953b1aaf-f3b2-47f8-8f21-6ba3608035aa.aed25e69-db04-4bd2-b72f-ce4b64faa43e Jul 30 17:11:25 devstack sudo[108638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:25 devstack sudo[108638]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:25 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-3650d074-7196-46e4-9d26-122738fdceaa tempest-CinderUnicodeTest-333851401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-953b1aaf-f3b2-47f8-8f21-6ba3608035aa -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-953b1aaf-f3b2-47f8-8f21-6ba3608035aa.aed25e69-db04-4bd2-b72f-ce4b64faa43e" returned: 0 in 0.365s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:25 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-3650d074-7196-46e4-9d26-122738fdceaa tempest-CinderUnicodeTest-333851401 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-953b1aaf-f3b2-47f8-8f21-6ba3608035aa.aed25e69-db04-4bd2-b72f-ce4b64faa43e is being set with open permissions: ugo+rw Jul 30 17:11:25 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-3650d074-7196-46e4-9d26-122738fdceaa tempest-CinderUnicodeTest-333851401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-953b1aaf-f3b2-47f8-8f21-6ba3608035aa.aed25e69-db04-4bd2-b72f-ce4b64faa43e {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:26 devstack sudo[108643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-953b1aaf-f3b2-47f8-8f21-6ba3608035aa.aed25e69-db04-4bd2-b72f-ce4b64faa43e Jul 30 17:11:26 devstack sudo[108643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:26 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-928166a1-8170-4c2b-bed0-02a3fc7970c2 tempest-ProjectMemberTests-1556323482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:11:26 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-928166a1-8170-4c2b-bed0-02a3fc7970c2 tempest-ProjectMemberTests-1556323482 None] Flow 'volume_create_manager' (f3b43194-889e-4cc3-81a2-29ff604b35d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:11:26 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-928166a1-8170-4c2b-bed0-02a3fc7970c2 tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daf8c447-0e61-47e2-bb6b-cd20acae21fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:26 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-928166a1-8170-4c2b-bed0-02a3fc7970c2 tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daf8c447-0e61-47e2-bb6b-cd20acae21fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:11:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-244548315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9da0fd47-c1c1-48ac-b5e6-472d52718a33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72a0b0e3a199416698115290d71c6808',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:11:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:11:26Z,use_quota=True,user_id='8f2d7aa2b6ab4865b626b01a01acc0f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:26 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-928166a1-8170-4c2b-bed0-02a3fc7970c2 tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1ac09ae-6aac-47a9-91b2-4f9ea381c4f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:26 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-928166a1-8170-4c2b-bed0-02a3fc7970c2 tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1ac09ae-6aac-47a9-91b2-4f9ea381c4f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:26 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-928166a1-8170-4c2b-bed0-02a3fc7970c2 tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f8358c1-1dae-448c-990b-2d65d21c1f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:26 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-928166a1-8170-4c2b-bed0-02a3fc7970c2 tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f8358c1-1dae-448c-990b-2d65d21c1f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9da0fd47-c1c1-48ac-b5e6-472d52718a33', 'volume_name': 'volume-9da0fd47-c1c1-48ac-b5e6-472d52718a33', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:26 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-928166a1-8170-4c2b-bed0-02a3fc7970c2 tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9815e12f-e42c-4183-a80c-f5379cff4ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:26 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-928166a1-8170-4c2b-bed0-02a3fc7970c2 tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9815e12f-e42c-4183-a80c-f5379cff4ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:26 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-928166a1-8170-4c2b-bed0-02a3fc7970c2 tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8509a3f-ab12-4094-9fe5-f831178a4f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:26 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-928166a1-8170-4c2b-bed0-02a3fc7970c2 tempest-ProjectMemberTests-1556323482 None] Volume 9da0fd47-c1c1-48ac-b5e6-472d52718a33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9da0fd47-c1c1-48ac-b5e6-472d52718a33', 'volume_size': 1} Jul 30 17:11:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-928166a1-8170-4c2b-bed0-02a3fc7970c2 tempest-ProjectMemberTests-1556323482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:26 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-cd16c842-8de3-45b5-9d7c-d11bd6b2b569 tempest-ProjectReaderTests-1751321275 None] Acquiring lock "cinder-5b76a537-3240-4b02-8979-a2652cb56ab7-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:26 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-cd16c842-8de3-45b5-9d7c-d11bd6b2b569 tempest-ProjectReaderTests-1751321275 None] Lock "cinder-5b76a537-3240-4b02-8979-a2652cb56ab7-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:26 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-cd16c842-8de3-45b5-9d7c-d11bd6b2b569 tempest-ProjectReaderTests-1751321275 None] Acquiring lock "cinder-quobyte-5b76a537-3240-4b02-8979-a2652cb56ab7" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:26 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-cd16c842-8de3-45b5-9d7c-d11bd6b2b569 tempest-ProjectReaderTests-1751321275 None] Lock "cinder-quobyte-5b76a537-3240-4b02-8979-a2652cb56ab7" acquired by "delete_volume" :: waited 0.015s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:26 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b494cc-493b-47a6-abec-c62b02f2e17a]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:11:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-cd16c842-8de3-45b5-9d7c-d11bd6b2b569 tempest-ProjectReaderTests-1751321275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5b76a537-3240-4b02-8979-a2652cb56ab7 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:26 devstack sudo[108643]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-3650d074-7196-46e4-9d26-122738fdceaa tempest-CinderUnicodeTest-333851401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-953b1aaf-f3b2-47f8-8f21-6ba3608035aa.aed25e69-db04-4bd2-b72f-ce4b64faa43e" returned: 0 in 0.270s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-3650d074-7196-46e4-9d26-122738fdceaa tempest-CinderUnicodeTest-333851401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-953b1aaf-f3b2-47f8-8f21-6ba3608035aa.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:26 devstack sudo[108647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-953b1aaf-f3b2-47f8-8f21-6ba3608035aa.info Jul 30 17:11:26 devstack sudo[108647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:26 devstack sudo[108646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5b76a537-3240-4b02-8979-a2652cb56ab7 Jul 30 17:11:26 devstack sudo[108646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:26 devstack sudo[108647]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-3650d074-7196-46e4-9d26-122738fdceaa tempest-CinderUnicodeTest-333851401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-953b1aaf-f3b2-47f8-8f21-6ba3608035aa.info" returned: 0 in 0.261s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:26 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-3650d074-7196-46e4-9d26-122738fdceaa tempest-CinderUnicodeTest-333851401 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-953b1aaf-f3b2-47f8-8f21-6ba3608035aa.info is being set with open permissions: ugo+rw Jul 30 17:11:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-3650d074-7196-46e4-9d26-122738fdceaa tempest-CinderUnicodeTest-333851401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-953b1aaf-f3b2-47f8-8f21-6ba3608035aa.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:26 devstack sudo[108654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-953b1aaf-f3b2-47f8-8f21-6ba3608035aa.info Jul 30 17:11:26 devstack sudo[108654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:26 devstack sudo[108646]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-cd16c842-8de3-45b5-9d7c-d11bd6b2b569 tempest-ProjectReaderTests-1751321275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5b76a537-3240-4b02-8979-a2652cb56ab7" returned: 0 in 0.355s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-cd16c842-8de3-45b5-9d7c-d11bd6b2b569 tempest-ProjectReaderTests-1751321275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5b76a537-3240-4b02-8979-a2652cb56ab7 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:26 devstack sudo[108656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5b76a537-3240-4b02-8979-a2652cb56ab7 Jul 30 17:11:26 devstack sudo[108656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:26 devstack sudo[108654]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-3650d074-7196-46e4-9d26-122738fdceaa tempest-CinderUnicodeTest-333851401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-953b1aaf-f3b2-47f8-8f21-6ba3608035aa.info" returned: 0 in 0.246s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-3650d074-7196-46e4-9d26-122738fdceaa tempest-CinderUnicodeTest-333851401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.105s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-928166a1-8170-4c2b-bed0-02a3fc7970c2 tempest-ProjectMemberTests-1556323482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.685s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:26 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-928166a1-8170-4c2b-bed0-02a3fc7970c2 tempest-ProjectMemberTests-1556323482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:11:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-244548315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9da0fd47-c1c1-48ac-b5e6-472d52718a33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72a0b0e3a199416698115290d71c6808',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:11:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:11:26Z,use_quota=True,user_id='8f2d7aa2b6ab4865b626b01a01acc0f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:11:26 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-928166a1-8170-4c2b-bed0-02a3fc7970c2 tempest-ProjectMemberTests-1556323482 None] Creating volume 9da0fd47-c1c1-48ac-b5e6-472d52718a33 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:11:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-928166a1-8170-4c2b-bed0-02a3fc7970c2 tempest-ProjectMemberTests-1556323482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-928166a1-8170-4c2b-bed0-02a3fc7970c2 tempest-ProjectMemberTests-1556323482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:26 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-928166a1-8170-4c2b-bed0-02a3fc7970c2 tempest-ProjectMemberTests-1556323482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:11:26 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-928166a1-8170-4c2b-bed0-02a3fc7970c2 tempest-ProjectMemberTests-1556323482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:11:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-928166a1-8170-4c2b-bed0-02a3fc7970c2 tempest-ProjectMemberTests-1556323482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:26 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-928166a1-8170-4c2b-bed0-02a3fc7970c2 tempest-ProjectMemberTests-1556323482 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:11:26 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-928166a1-8170-4c2b-bed0-02a3fc7970c2 tempest-ProjectMemberTests-1556323482 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:11:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-928166a1-8170-4c2b-bed0-02a3fc7970c2 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9da0fd47-c1c1-48ac-b5e6-472d52718a33 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:26 devstack sudo[108656]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-cd16c842-8de3-45b5-9d7c-d11bd6b2b569 tempest-ProjectReaderTests-1751321275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5b76a537-3240-4b02-8979-a2652cb56ab7" returned: 0 in 0.264s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:26 devstack sudo[108660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9da0fd47-c1c1-48ac-b5e6-472d52718a33 1073741824 Jul 30 17:11:26 devstack sudo[108660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:26 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-cd16c842-8de3-45b5-9d7c-d11bd6b2b569 tempest-ProjectReaderTests-1751321275 None] Lock "cinder-quobyte-5b76a537-3240-4b02-8979-a2652cb56ab7" released by "delete_volume" :: held 0.665s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:26 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-3650d074-7196-46e4-9d26-122738fdceaa tempest-CinderUnicodeTest-333851401 None] Create snapshot completed successfully Jul 30 17:11:26 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-cd16c842-8de3-45b5-9d7c-d11bd6b2b569 tempest-ProjectReaderTests-1751321275 None] Created reservations ['8e5a9181-ef70-4c0f-855e-7998796a51ed', '005e54a6-c7de-4672-a676-d9f4465771fb', '4ee47a98-c850-40f6-b435-b0a1ea2f5078', 'f1a9d199-dd26-48f8-87f8-cd37be1b5358'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:11:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-cd16c842-8de3-45b5-9d7c-d11bd6b2b569 tempest-ProjectReaderTests-1751321275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-cd16c842-8de3-45b5-9d7c-d11bd6b2b569 tempest-ProjectReaderTests-1751321275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:26 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-cd16c842-8de3-45b5-9d7c-d11bd6b2b569 tempest-ProjectReaderTests-1751321275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:11:26 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-cd16c842-8de3-45b5-9d7c-d11bd6b2b569 tempest-ProjectReaderTests-1751321275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:11:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-cd16c842-8de3-45b5-9d7c-d11bd6b2b569 tempest-ProjectReaderTests-1751321275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:26 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-cd16c842-8de3-45b5-9d7c-d11bd6b2b569 tempest-ProjectReaderTests-1751321275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:27 devstack sudo[108662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:11:27 devstack sudo[108662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:27 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-07d9ef9b-68b8-47f9-abf4-2b1cf635fd1c tempest-CinderUnicodeTest-333851401 None] Acquiring lock "cinder-aed25e69-db04-4bd2-b72f-ce4b64faa43e-delete_snapshot" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:27 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-07d9ef9b-68b8-47f9-abf4-2b1cf635fd1c tempest-CinderUnicodeTest-333851401 None] Lock "cinder-aed25e69-db04-4bd2-b72f-ce4b64faa43e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:27 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-07d9ef9b-68b8-47f9-abf4-2b1cf635fd1c tempest-CinderUnicodeTest-333851401 None] Acquiring lock "cinder-quobyte-953b1aaf-f3b2-47f8-8f21-6ba3608035aa" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:27 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-07d9ef9b-68b8-47f9-abf4-2b1cf635fd1c tempest-CinderUnicodeTest-333851401 None] Lock "cinder-quobyte-953b1aaf-f3b2-47f8-8f21-6ba3608035aa" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:27 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-07d9ef9b-68b8-47f9-abf4-2b1cf635fd1c tempest-CinderUnicodeTest-333851401 None] Acquiring lock "cinder-quobyte-aed25e69-db04-4bd2-b72f-ce4b64faa43e" by "_delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:27 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-07d9ef9b-68b8-47f9-abf4-2b1cf635fd1c tempest-CinderUnicodeTest-333851401 None] Lock "cinder-quobyte-aed25e69-db04-4bd2-b72f-ce4b64faa43e" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:27 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-07d9ef9b-68b8-47f9-abf4-2b1cf635fd1c tempest-CinderUnicodeTest-333851401 None] Deleting offline snapshot aed25e69-db04-4bd2-b72f-ce4b64faa43e of volume 953b1aaf-f3b2-47f8-8f21-6ba3608035aa {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:11:27 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-07d9ef9b-68b8-47f9-abf4-2b1cf635fd1c tempest-CinderUnicodeTest-333851401 None] snapshot_file for this snap is: volume-953b1aaf-f3b2-47f8-8f21-6ba3608035aa.aed25e69-db04-4bd2-b72f-ce4b64faa43e {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:11:27 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c4ae97-61c1-4d99-a9f0-47ef286fd272]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:11:27 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-07d9ef9b-68b8-47f9-abf4-2b1cf635fd1c tempest-CinderUnicodeTest-333851401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-953b1aaf-f3b2-47f8-8f21-6ba3608035aa.aed25e69-db04-4bd2-b72f-ce4b64faa43e {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:27 devstack sudo[108662]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:27 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-cd16c842-8de3-45b5-9d7c-d11bd6b2b569 tempest-ProjectReaderTests-1751321275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.291s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:27 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-cd16c842-8de3-45b5-9d7c-d11bd6b2b569 tempest-ProjectReaderTests-1751321275 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:11:27 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-cd16c842-8de3-45b5-9d7c-d11bd6b2b569 tempest-ProjectReaderTests-1751321275 None] Deleted volume successfully. Jul 30 17:11:27 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-cd16c842-8de3-45b5-9d7c-d11bd6b2b569 tempest-ProjectReaderTests-1751321275 None] Lock "cinder-5b76a537-3240-4b02-8979-a2652cb56ab7-delete_volume" released by "delete_volume" :: held 1.167s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:27 devstack sudo[108667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-953b1aaf-f3b2-47f8-8f21-6ba3608035aa.aed25e69-db04-4bd2-b72f-ce4b64faa43e Jul 30 17:11:27 devstack sudo[108667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:27 devstack sudo[108660]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:27 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-928166a1-8170-4c2b-bed0-02a3fc7970c2 tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9da0fd47-c1c1-48ac-b5e6-472d52718a33 1073741824" returned: 0 in 0.553s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:27 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-928166a1-8170-4c2b-bed0-02a3fc7970c2 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9da0fd47-c1c1-48ac-b5e6-472d52718a33 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:27 devstack sudo[108671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9da0fd47-c1c1-48ac-b5e6-472d52718a33 Jul 30 17:11:27 devstack sudo[108671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:27 devstack sudo[108667]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:27 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-07d9ef9b-68b8-47f9-abf4-2b1cf635fd1c tempest-CinderUnicodeTest-333851401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-953b1aaf-f3b2-47f8-8f21-6ba3608035aa.aed25e69-db04-4bd2-b72f-ce4b64faa43e" returned: 0 in 0.462s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:27 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-07d9ef9b-68b8-47f9-abf4-2b1cf635fd1c tempest-CinderUnicodeTest-333851401 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-953b1aaf-f3b2-47f8-8f21-6ba3608035aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:11:27 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[57657581-184d-4160-9f07-05a6329fdf4f]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:11:27 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-07d9ef9b-68b8-47f9-abf4-2b1cf635fd1c tempest-CinderUnicodeTest-333851401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-953b1aaf-f3b2-47f8-8f21-6ba3608035aa {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:27 devstack sudo[108671]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:27 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-928166a1-8170-4c2b-bed0-02a3fc7970c2 tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9da0fd47-c1c1-48ac-b5e6-472d52718a33" returned: 0 in 0.287s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:27 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-928166a1-8170-4c2b-bed0-02a3fc7970c2 tempest-ProjectMemberTests-1556323482 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:11:27 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-928166a1-8170-4c2b-bed0-02a3fc7970c2 tempest-ProjectMemberTests-1556323482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:27 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-928166a1-8170-4c2b-bed0-02a3fc7970c2 tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8509a3f-ab12-4094-9fe5-f831178a4f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9da0fd47-c1c1-48ac-b5e6-472d52718a33', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:27 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-928166a1-8170-4c2b-bed0-02a3fc7970c2 tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d5d958a-1b99-4d4a-ac3f-787ee8e15c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:27 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-928166a1-8170-4c2b-bed0-02a3fc7970c2 tempest-ProjectMemberTests-1556323482 None] Volume volume-9da0fd47-c1c1-48ac-b5e6-472d52718a33 (9da0fd47-c1c1-48ac-b5e6-472d52718a33): created successfully Jul 30 17:11:27 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-928166a1-8170-4c2b-bed0-02a3fc7970c2 tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d5d958a-1b99-4d4a-ac3f-787ee8e15c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:27 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-928166a1-8170-4c2b-bed0-02a3fc7970c2 tempest-ProjectMemberTests-1556323482 None] Flow 'volume_create_manager' (f3b43194-889e-4cc3-81a2-29ff604b35d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:11:27 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-928166a1-8170-4c2b-bed0-02a3fc7970c2 tempest-ProjectMemberTests-1556323482 None] Created volume successfully. Jul 30 17:11:27 devstack sudo[108677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-953b1aaf-f3b2-47f8-8f21-6ba3608035aa Jul 30 17:11:27 devstack sudo[108677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:27 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-8824498c-bb77-497a-a8e8-05f107a48985 tempest-ProjectReaderTests-1751321275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:11:27 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8824498c-bb77-497a-a8e8-05f107a48985 tempest-ProjectReaderTests-1751321275 None] Flow 'volume_create_manager' (d20e5441-4950-4553-b314-f9699584003d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:11:27 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8824498c-bb77-497a-a8e8-05f107a48985 tempest-ProjectReaderTests-1751321275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b02d7d3-2007-4c0d-a338-6a3a248f36c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:27 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8824498c-bb77-497a-a8e8-05f107a48985 tempest-ProjectReaderTests-1751321275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b02d7d3-2007-4c0d-a338-6a3a248f36c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:11:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1696186268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa3eb389-8b2d-4347-92db-27fc326eb4e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c2e1dbeba134328b1df968d75d88cf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:11:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:11:28Z,use_quota=True,user_id='afd6865e007047c58ec4822a3b207b25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:27 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8824498c-bb77-497a-a8e8-05f107a48985 tempest-ProjectReaderTests-1751321275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fe9bbb2-0395-43fc-8105-80b0f5bac9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:27 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8824498c-bb77-497a-a8e8-05f107a48985 tempest-ProjectReaderTests-1751321275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fe9bbb2-0395-43fc-8105-80b0f5bac9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:27 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8824498c-bb77-497a-a8e8-05f107a48985 tempest-ProjectReaderTests-1751321275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1178720c-468e-4fb8-a827-2b7107c43ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:27 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8824498c-bb77-497a-a8e8-05f107a48985 tempest-ProjectReaderTests-1751321275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1178720c-468e-4fb8-a827-2b7107c43ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa3eb389-8b2d-4347-92db-27fc326eb4e0', 'volume_name': 'volume-aa3eb389-8b2d-4347-92db-27fc326eb4e0', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:27 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8824498c-bb77-497a-a8e8-05f107a48985 tempest-ProjectReaderTests-1751321275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d8435b5-9ce4-4987-9b33-0c6fc179459d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:27 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8824498c-bb77-497a-a8e8-05f107a48985 tempest-ProjectReaderTests-1751321275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d8435b5-9ce4-4987-9b33-0c6fc179459d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:27 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8824498c-bb77-497a-a8e8-05f107a48985 tempest-ProjectReaderTests-1751321275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a000dd22-28cb-4bf5-acb9-0d08055eda51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:27 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-8824498c-bb77-497a-a8e8-05f107a48985 tempest-ProjectReaderTests-1751321275 None] Volume aa3eb389-8b2d-4347-92db-27fc326eb4e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa3eb389-8b2d-4347-92db-27fc326eb4e0', 'volume_size': 1} Jul 30 17:11:27 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-8824498c-bb77-497a-a8e8-05f107a48985 tempest-ProjectReaderTests-1751321275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:27 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-8824498c-bb77-497a-a8e8-05f107a48985 tempest-ProjectReaderTests-1751321275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:27 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-8824498c-bb77-497a-a8e8-05f107a48985 tempest-ProjectReaderTests-1751321275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:11:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1696186268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa3eb389-8b2d-4347-92db-27fc326eb4e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c2e1dbeba134328b1df968d75d88cf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:11:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:11:28Z,use_quota=True,user_id='afd6865e007047c58ec4822a3b207b25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:11:27 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-8824498c-bb77-497a-a8e8-05f107a48985 tempest-ProjectReaderTests-1751321275 None] Creating volume aa3eb389-8b2d-4347-92db-27fc326eb4e0 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:11:27 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-8824498c-bb77-497a-a8e8-05f107a48985 tempest-ProjectReaderTests-1751321275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:27 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-8824498c-bb77-497a-a8e8-05f107a48985 tempest-ProjectReaderTests-1751321275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:27 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-8824498c-bb77-497a-a8e8-05f107a48985 tempest-ProjectReaderTests-1751321275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:11:27 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-8824498c-bb77-497a-a8e8-05f107a48985 tempest-ProjectReaderTests-1751321275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:11:27 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-8824498c-bb77-497a-a8e8-05f107a48985 tempest-ProjectReaderTests-1751321275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:27 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-8824498c-bb77-497a-a8e8-05f107a48985 tempest-ProjectReaderTests-1751321275 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:11:27 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-8824498c-bb77-497a-a8e8-05f107a48985 tempest-ProjectReaderTests-1751321275 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:11:27 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8824498c-bb77-497a-a8e8-05f107a48985 tempest-ProjectReaderTests-1751321275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-aa3eb389-8b2d-4347-92db-27fc326eb4e0 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:27 devstack sudo[108679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-aa3eb389-8b2d-4347-92db-27fc326eb4e0 1073741824 Jul 30 17:11:27 devstack sudo[108679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:28 devstack sudo[108677]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-07d9ef9b-68b8-47f9-abf4-2b1cf635fd1c tempest-CinderUnicodeTest-333851401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-953b1aaf-f3b2-47f8-8f21-6ba3608035aa" returned: 0 in 0.393s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-07d9ef9b-68b8-47f9-abf4-2b1cf635fd1c tempest-CinderUnicodeTest-333851401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-953b1aaf-f3b2-47f8-8f21-6ba3608035aa.aed25e69-db04-4bd2-b72f-ce4b64faa43e {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:28 devstack sudo[108684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-953b1aaf-f3b2-47f8-8f21-6ba3608035aa.aed25e69-db04-4bd2-b72f-ce4b64faa43e Jul 30 17:11:28 devstack sudo[108684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-cffb9e9f-9135-4ed2-bb25-7fac5c64596d tempest-ProjectMemberTests-1556323482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:28 devstack sudo[108679]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8824498c-bb77-497a-a8e8-05f107a48985 tempest-ProjectReaderTests-1751321275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-aa3eb389-8b2d-4347-92db-27fc326eb4e0 1073741824" returned: 0 in 0.512s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:28 devstack sudo[108684]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-07d9ef9b-68b8-47f9-abf4-2b1cf635fd1c tempest-CinderUnicodeTest-333851401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-953b1aaf-f3b2-47f8-8f21-6ba3608035aa.aed25e69-db04-4bd2-b72f-ce4b64faa43e" returned: 0 in 0.385s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-07d9ef9b-68b8-47f9-abf4-2b1cf635fd1c tempest-CinderUnicodeTest-333851401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-953b1aaf-f3b2-47f8-8f21-6ba3608035aa.aed25e69-db04-4bd2-b72f-ce4b64faa43e {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8824498c-bb77-497a-a8e8-05f107a48985 tempest-ProjectReaderTests-1751321275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-aa3eb389-8b2d-4347-92db-27fc326eb4e0 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:28 devstack sudo[108693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-953b1aaf-f3b2-47f8-8f21-6ba3608035aa.aed25e69-db04-4bd2-b72f-ce4b64faa43e Jul 30 17:11:28 devstack sudo[108693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:28 devstack sudo[108694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-aa3eb389-8b2d-4347-92db-27fc326eb4e0 Jul 30 17:11:28 devstack sudo[108694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:28 devstack sudo[108693]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:28 devstack sudo[108694]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8824498c-bb77-497a-a8e8-05f107a48985 tempest-ProjectReaderTests-1751321275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-aa3eb389-8b2d-4347-92db-27fc326eb4e0" returned: 0 in 0.261s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-07d9ef9b-68b8-47f9-abf4-2b1cf635fd1c tempest-CinderUnicodeTest-333851401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-953b1aaf-f3b2-47f8-8f21-6ba3608035aa.aed25e69-db04-4bd2-b72f-ce4b64faa43e" returned: 0 in 0.275s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:28 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-8824498c-bb77-497a-a8e8-05f107a48985 tempest-ProjectReaderTests-1751321275 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:11:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-8824498c-bb77-497a-a8e8-05f107a48985 tempest-ProjectReaderTests-1751321275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-cffb9e9f-9135-4ed2-bb25-7fac5c64596d tempest-ProjectMemberTests-1556323482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.454s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:28 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-cffb9e9f-9135-4ed2-bb25-7fac5c64596d tempest-ProjectMemberTests-1556323482 None] Creating offline snapshot 07b73f00-e718-4b6c-8613-1b942a94a876 of volume 9da0fd47-c1c1-48ac-b5e6-472d52718a33 {{(pid=88568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:11:28 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8824498c-bb77-497a-a8e8-05f107a48985 tempest-ProjectReaderTests-1751321275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a000dd22-28cb-4bf5-acb9-0d08055eda51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa3eb389-8b2d-4347-92db-27fc326eb4e0', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:28 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8824498c-bb77-497a-a8e8-05f107a48985 tempest-ProjectReaderTests-1751321275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8760a0da-dc4a-4941-b8de-6e4d7e542344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:28 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-07d9ef9b-68b8-47f9-abf4-2b1cf635fd1c tempest-CinderUnicodeTest-333851401 None] Lock "cinder-quobyte-aed25e69-db04-4bd2-b72f-ce4b64faa43e" released by "_delete_snapshot" :: held 1.670s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:28 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64810a1-531e-49b2-9c30-868035cfc1bd]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:11:28 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-cffb9e9f-9135-4ed2-bb25-7fac5c64596d tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9da0fd47-c1c1-48ac-b5e6-472d52718a33 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:28 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-07d9ef9b-68b8-47f9-abf4-2b1cf635fd1c tempest-CinderUnicodeTest-333851401 None] Lock "cinder-quobyte-953b1aaf-f3b2-47f8-8f21-6ba3608035aa" released by "delete_snapshot" :: held 1.714s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:28 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-8824498c-bb77-497a-a8e8-05f107a48985 tempest-ProjectReaderTests-1751321275 None] Volume volume-aa3eb389-8b2d-4347-92db-27fc326eb4e0 (aa3eb389-8b2d-4347-92db-27fc326eb4e0): created successfully Jul 30 17:11:28 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8824498c-bb77-497a-a8e8-05f107a48985 tempest-ProjectReaderTests-1751321275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8760a0da-dc4a-4941-b8de-6e4d7e542344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:28 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-8824498c-bb77-497a-a8e8-05f107a48985 tempest-ProjectReaderTests-1751321275 None] Flow 'volume_create_manager' (d20e5441-4950-4553-b314-f9699584003d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:11:28 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-8824498c-bb77-497a-a8e8-05f107a48985 tempest-ProjectReaderTests-1751321275 None] Created volume successfully. Jul 30 17:11:28 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-07d9ef9b-68b8-47f9-abf4-2b1cf635fd1c tempest-CinderUnicodeTest-333851401 None] Created reservations ['6efb63ec-4bbf-4b29-a161-6f86ac238146', '42511f66-b0f5-41b1-9fd0-9772578672e2', '994ba8bd-81f0-4042-8bd0-30076548f8df', '45bbfa77-ef10-4c90-b43b-6c5cf78f405e'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:11:28 devstack sudo[108699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9da0fd47-c1c1-48ac-b5e6-472d52718a33 Jul 30 17:11:28 devstack sudo[108699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:28 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-07d9ef9b-68b8-47f9-abf4-2b1cf635fd1c tempest-CinderUnicodeTest-333851401 None] Delete snapshot completed successfully. Jul 30 17:11:28 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-07d9ef9b-68b8-47f9-abf4-2b1cf635fd1c tempest-CinderUnicodeTest-333851401 None] Lock "cinder-aed25e69-db04-4bd2-b72f-ce4b64faa43e-delete_snapshot" released by "delete_snapshot" :: held 1.882s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:29 devstack sudo[108699]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-cffb9e9f-9135-4ed2-bb25-7fac5c64596d tempest-ProjectMemberTests-1556323482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9da0fd47-c1c1-48ac-b5e6-472d52718a33" returned: 0 in 0.393s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-cffb9e9f-9135-4ed2-bb25-7fac5c64596d tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9da0fd47-c1c1-48ac-b5e6-472d52718a33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9da0fd47-c1c1-48ac-b5e6-472d52718a33.07b73f00-e718-4b6c-8613-1b942a94a876 1G {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:29 devstack sudo[108704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9da0fd47-c1c1-48ac-b5e6-472d52718a33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9da0fd47-c1c1-48ac-b5e6-472d52718a33.07b73f00-e718-4b6c-8613-1b942a94a876 1G Jul 30 17:11:29 devstack sudo[108704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:29 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-a3767ce7-3097-48c3-8270-1e138558f75f tempest-CinderUnicodeTest-333851401 None] Acquiring lock "cinder-953b1aaf-f3b2-47f8-8f21-6ba3608035aa-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:29 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-a3767ce7-3097-48c3-8270-1e138558f75f tempest-CinderUnicodeTest-333851401 None] Lock "cinder-953b1aaf-f3b2-47f8-8f21-6ba3608035aa-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:29 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-a3767ce7-3097-48c3-8270-1e138558f75f tempest-CinderUnicodeTest-333851401 None] Acquiring lock "cinder-quobyte-953b1aaf-f3b2-47f8-8f21-6ba3608035aa" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:29 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-a3767ce7-3097-48c3-8270-1e138558f75f tempest-CinderUnicodeTest-333851401 None] Lock "cinder-quobyte-953b1aaf-f3b2-47f8-8f21-6ba3608035aa" acquired by "delete_volume" :: waited 0.014s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:29 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[5677a689-c9b9-4e6e-8adf-cb7e857c0453]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:11:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a3767ce7-3097-48c3-8270-1e138558f75f tempest-CinderUnicodeTest-333851401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-953b1aaf-f3b2-47f8-8f21-6ba3608035aa {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:29 devstack sudo[108706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-953b1aaf-f3b2-47f8-8f21-6ba3608035aa Jul 30 17:11:29 devstack sudo[108706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:29 devstack sudo[108704]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-cffb9e9f-9135-4ed2-bb25-7fac5c64596d tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9da0fd47-c1c1-48ac-b5e6-472d52718a33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9da0fd47-c1c1-48ac-b5e6-472d52718a33.07b73f00-e718-4b6c-8613-1b942a94a876 1G" returned: 0 in 0.424s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-cffb9e9f-9135-4ed2-bb25-7fac5c64596d tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9da0fd47-c1c1-48ac-b5e6-472d52718a33 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9da0fd47-c1c1-48ac-b5e6-472d52718a33.07b73f00-e718-4b6c-8613-1b942a94a876 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:29 devstack sudo[108712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9da0fd47-c1c1-48ac-b5e6-472d52718a33 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9da0fd47-c1c1-48ac-b5e6-472d52718a33.07b73f00-e718-4b6c-8613-1b942a94a876 Jul 30 17:11:29 devstack sudo[108712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:29 devstack sudo[108706]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a3767ce7-3097-48c3-8270-1e138558f75f tempest-CinderUnicodeTest-333851401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-953b1aaf-f3b2-47f8-8f21-6ba3608035aa" returned: 0 in 0.373s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a3767ce7-3097-48c3-8270-1e138558f75f tempest-CinderUnicodeTest-333851401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-953b1aaf-f3b2-47f8-8f21-6ba3608035aa {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:29 devstack sudo[108717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-953b1aaf-f3b2-47f8-8f21-6ba3608035aa Jul 30 17:11:29 devstack sudo[108717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:29 devstack sudo[108712]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:29 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-83a807f0-02c2-4f79-96d1-d22068ad1fc0 tempest-ProjectReaderTests-1751321275 None] Acquiring lock "cinder-aa3eb389-8b2d-4347-92db-27fc326eb4e0-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-cffb9e9f-9135-4ed2-bb25-7fac5c64596d tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9da0fd47-c1c1-48ac-b5e6-472d52718a33 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9da0fd47-c1c1-48ac-b5e6-472d52718a33.07b73f00-e718-4b6c-8613-1b942a94a876" returned: 0 in 0.321s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:29 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-cffb9e9f-9135-4ed2-bb25-7fac5c64596d tempest-ProjectMemberTests-1556323482 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9da0fd47-c1c1-48ac-b5e6-472d52718a33.07b73f00-e718-4b6c-8613-1b942a94a876 is being set with open permissions: ugo+rw Jul 30 17:11:29 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-cffb9e9f-9135-4ed2-bb25-7fac5c64596d tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9da0fd47-c1c1-48ac-b5e6-472d52718a33.07b73f00-e718-4b6c-8613-1b942a94a876 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:29 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-83a807f0-02c2-4f79-96d1-d22068ad1fc0 tempest-ProjectReaderTests-1751321275 None] Lock "cinder-aa3eb389-8b2d-4347-92db-27fc326eb4e0-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:29 devstack sudo[108722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9da0fd47-c1c1-48ac-b5e6-472d52718a33.07b73f00-e718-4b6c-8613-1b942a94a876 Jul 30 17:11:29 devstack sudo[108722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:30 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-83a807f0-02c2-4f79-96d1-d22068ad1fc0 tempest-ProjectReaderTests-1751321275 None] Acquiring lock "cinder-quobyte-aa3eb389-8b2d-4347-92db-27fc326eb4e0" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:30 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-83a807f0-02c2-4f79-96d1-d22068ad1fc0 tempest-ProjectReaderTests-1751321275 None] Lock "cinder-quobyte-aa3eb389-8b2d-4347-92db-27fc326eb4e0" acquired by "delete_volume" :: waited 0.023s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:30 devstack sudo[108717]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:30 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a3767ce7-3097-48c3-8270-1e138558f75f tempest-CinderUnicodeTest-333851401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-953b1aaf-f3b2-47f8-8f21-6ba3608035aa" returned: 0 in 0.298s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:30 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[a29cc862-cd23-487f-9e56-72d4257c30c7]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:11:30 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-83a807f0-02c2-4f79-96d1-d22068ad1fc0 tempest-ProjectReaderTests-1751321275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-aa3eb389-8b2d-4347-92db-27fc326eb4e0 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:30 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-a3767ce7-3097-48c3-8270-1e138558f75f tempest-CinderUnicodeTest-333851401 None] Lock "cinder-quobyte-953b1aaf-f3b2-47f8-8f21-6ba3608035aa" released by "delete_volume" :: held 0.745s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:30 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-a3767ce7-3097-48c3-8270-1e138558f75f tempest-CinderUnicodeTest-333851401 None] Created reservations ['f9a6682e-13dd-4397-b802-7b3f4c2b1823', '2da07a9f-7a23-43d9-8310-518790d6eeb4', '98ff21c1-e7be-4b16-a2d6-cc06b2c0e3de', '57c58b31-a7e8-4d1e-815c-4483bd4997b3'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:11:30 devstack sudo[108725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-aa3eb389-8b2d-4347-92db-27fc326eb4e0 Jul 30 17:11:30 devstack sudo[108725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:30 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a3767ce7-3097-48c3-8270-1e138558f75f tempest-CinderUnicodeTest-333851401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:30 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a3767ce7-3097-48c3-8270-1e138558f75f tempest-CinderUnicodeTest-333851401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:30 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-a3767ce7-3097-48c3-8270-1e138558f75f tempest-CinderUnicodeTest-333851401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:11:30 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-a3767ce7-3097-48c3-8270-1e138558f75f tempest-CinderUnicodeTest-333851401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:11:30 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-a3767ce7-3097-48c3-8270-1e138558f75f tempest-CinderUnicodeTest-333851401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:30 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a3767ce7-3097-48c3-8270-1e138558f75f tempest-CinderUnicodeTest-333851401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:30 devstack sudo[108728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:11:30 devstack sudo[108722]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:30 devstack sudo[108728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:30 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-cffb9e9f-9135-4ed2-bb25-7fac5c64596d tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9da0fd47-c1c1-48ac-b5e6-472d52718a33.07b73f00-e718-4b6c-8613-1b942a94a876" returned: 0 in 0.287s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:30 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-cffb9e9f-9135-4ed2-bb25-7fac5c64596d tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9da0fd47-c1c1-48ac-b5e6-472d52718a33.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:30 devstack sudo[108730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9da0fd47-c1c1-48ac-b5e6-472d52718a33.info Jul 30 17:11:30 devstack sudo[108730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:30 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-50a1ef70-08e4-465e-bf43-ccc273e62aaa tempest-CinderUnicodeTest-333851401 None] Acquiring lock "cinder-e773cb47-4f7a-4e18-b67d-0b1d44ffddc4-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:30 devstack sudo[108728]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:30 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-a3767ce7-3097-48c3-8270-1e138558f75f tempest-CinderUnicodeTest-333851401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.285s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:30 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-a3767ce7-3097-48c3-8270-1e138558f75f tempest-CinderUnicodeTest-333851401 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:11:30 devstack sudo[108725]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:30 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-a3767ce7-3097-48c3-8270-1e138558f75f tempest-CinderUnicodeTest-333851401 None] Deleted volume successfully. Jul 30 17:11:30 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-50a1ef70-08e4-465e-bf43-ccc273e62aaa tempest-CinderUnicodeTest-333851401 None] Lock "cinder-e773cb47-4f7a-4e18-b67d-0b1d44ffddc4-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:30 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-83a807f0-02c2-4f79-96d1-d22068ad1fc0 tempest-ProjectReaderTests-1751321275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-aa3eb389-8b2d-4347-92db-27fc326eb4e0" returned: 0 in 0.455s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:30 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-83a807f0-02c2-4f79-96d1-d22068ad1fc0 tempest-ProjectReaderTests-1751321275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-aa3eb389-8b2d-4347-92db-27fc326eb4e0 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:30 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-a3767ce7-3097-48c3-8270-1e138558f75f tempest-CinderUnicodeTest-333851401 None] Lock "cinder-953b1aaf-f3b2-47f8-8f21-6ba3608035aa-delete_volume" released by "delete_volume" :: held 1.269s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:30 devstack sudo[108737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-aa3eb389-8b2d-4347-92db-27fc326eb4e0 Jul 30 17:11:30 devstack sudo[108737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:30 devstack sudo[108730]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:30 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-cffb9e9f-9135-4ed2-bb25-7fac5c64596d tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9da0fd47-c1c1-48ac-b5e6-472d52718a33.info" returned: 0 in 0.319s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:30 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-cffb9e9f-9135-4ed2-bb25-7fac5c64596d tempest-ProjectMemberTests-1556323482 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9da0fd47-c1c1-48ac-b5e6-472d52718a33.info is being set with open permissions: ugo+rw Jul 30 17:11:30 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-cffb9e9f-9135-4ed2-bb25-7fac5c64596d tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9da0fd47-c1c1-48ac-b5e6-472d52718a33.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:30 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-50a1ef70-08e4-465e-bf43-ccc273e62aaa tempest-CinderUnicodeTest-333851401 None] Acquiring lock "cinder-quobyte-e773cb47-4f7a-4e18-b67d-0b1d44ffddc4" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:30 devstack sudo[108739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9da0fd47-c1c1-48ac-b5e6-472d52718a33.info Jul 30 17:11:30 devstack sudo[108739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:30 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-50a1ef70-08e4-465e-bf43-ccc273e62aaa tempest-CinderUnicodeTest-333851401 None] Lock "cinder-quobyte-e773cb47-4f7a-4e18-b67d-0b1d44ffddc4" acquired by "delete_volume" :: waited 0.021s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:30 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1b7158-40b0-4f68-8f62-1dc351bbedaf]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:11:30 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-50a1ef70-08e4-465e-bf43-ccc273e62aaa tempest-CinderUnicodeTest-333851401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e773cb47-4f7a-4e18-b67d-0b1d44ffddc4 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:30 devstack sudo[108741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e773cb47-4f7a-4e18-b67d-0b1d44ffddc4 Jul 30 17:11:30 devstack sudo[108741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:30 devstack sudo[108737]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:30 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-83a807f0-02c2-4f79-96d1-d22068ad1fc0 tempest-ProjectReaderTests-1751321275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-aa3eb389-8b2d-4347-92db-27fc326eb4e0" returned: 0 in 0.279s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:30 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-83a807f0-02c2-4f79-96d1-d22068ad1fc0 tempest-ProjectReaderTests-1751321275 None] Lock "cinder-quobyte-aa3eb389-8b2d-4347-92db-27fc326eb4e0" released by "delete_volume" :: held 0.784s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:30 devstack sudo[108739]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:30 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-cffb9e9f-9135-4ed2-bb25-7fac5c64596d tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9da0fd47-c1c1-48ac-b5e6-472d52718a33.info" returned: 0 in 0.278s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:30 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-cffb9e9f-9135-4ed2-bb25-7fac5c64596d tempest-ProjectMemberTests-1556323482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.140s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:30 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-83a807f0-02c2-4f79-96d1-d22068ad1fc0 tempest-ProjectReaderTests-1751321275 None] Created reservations ['243fad8f-21cf-4bd7-8b97-8879a0a4bdca', 'eafd82f9-2acc-4029-ac29-ce39483cf9d2', 'edca1e4b-0814-4527-8308-0f8aceaee3a3', 'b06cfbf4-c493-47d3-99af-015014d29054'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:11:30 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-cffb9e9f-9135-4ed2-bb25-7fac5c64596d tempest-ProjectMemberTests-1556323482 None] Create snapshot completed successfully Jul 30 17:11:31 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-83a807f0-02c2-4f79-96d1-d22068ad1fc0 tempest-ProjectReaderTests-1751321275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:31 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-83a807f0-02c2-4f79-96d1-d22068ad1fc0 tempest-ProjectReaderTests-1751321275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:31 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-83a807f0-02c2-4f79-96d1-d22068ad1fc0 tempest-ProjectReaderTests-1751321275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:11:31 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-83a807f0-02c2-4f79-96d1-d22068ad1fc0 tempest-ProjectReaderTests-1751321275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:11:31 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-83a807f0-02c2-4f79-96d1-d22068ad1fc0 tempest-ProjectReaderTests-1751321275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:31 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-83a807f0-02c2-4f79-96d1-d22068ad1fc0 tempest-ProjectReaderTests-1751321275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:31 devstack sudo[108749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:11:31 devstack sudo[108749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:31 devstack sudo[108741]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:31 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-50a1ef70-08e4-465e-bf43-ccc273e62aaa tempest-CinderUnicodeTest-333851401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e773cb47-4f7a-4e18-b67d-0b1d44ffddc4" returned: 0 in 0.423s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:31 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-50a1ef70-08e4-465e-bf43-ccc273e62aaa tempest-CinderUnicodeTest-333851401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e773cb47-4f7a-4e18-b67d-0b1d44ffddc4 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:31 devstack sudo[108751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e773cb47-4f7a-4e18-b67d-0b1d44ffddc4 Jul 30 17:11:31 devstack sudo[108751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:31 devstack sudo[108749]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:31 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-83a807f0-02c2-4f79-96d1-d22068ad1fc0 tempest-ProjectReaderTests-1751321275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.280s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:31 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-83a807f0-02c2-4f79-96d1-d22068ad1fc0 tempest-ProjectReaderTests-1751321275 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:11:31 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-83a807f0-02c2-4f79-96d1-d22068ad1fc0 tempest-ProjectReaderTests-1751321275 None] Deleted volume successfully. Jul 30 17:11:31 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-83a807f0-02c2-4f79-96d1-d22068ad1fc0 tempest-ProjectReaderTests-1751321275 None] Lock "cinder-aa3eb389-8b2d-4347-92db-27fc326eb4e0-delete_volume" released by "delete_volume" :: held 1.368s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:31 devstack sudo[108751]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:31 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-50a1ef70-08e4-465e-bf43-ccc273e62aaa tempest-CinderUnicodeTest-333851401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-e773cb47-4f7a-4e18-b67d-0b1d44ffddc4" returned: 0 in 0.278s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:31 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-50a1ef70-08e4-465e-bf43-ccc273e62aaa tempest-CinderUnicodeTest-333851401 None] Lock "cinder-quobyte-e773cb47-4f7a-4e18-b67d-0b1d44ffddc4" released by "delete_volume" :: held 0.746s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:31 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-50a1ef70-08e4-465e-bf43-ccc273e62aaa tempest-CinderUnicodeTest-333851401 None] Created reservations ['73c37696-aa4f-4310-9ea4-8a371f61995f', '0fbce034-2582-41b2-99d0-292b2d18afcd', 'abf881aa-5837-4d5d-9603-7a62536490a4', 'dbaf0108-a519-4801-a5ce-acfea676b066'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:11:31 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-be26af7c-30b4-49c4-ab6f-f39e8a515ddd tempest-ProjectMemberTests-1556323482 None] Acquiring lock "cinder-07b73f00-e718-4b6c-8613-1b942a94a876-delete_snapshot" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:31 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-be26af7c-30b4-49c4-ab6f-f39e8a515ddd tempest-ProjectMemberTests-1556323482 None] Lock "cinder-07b73f00-e718-4b6c-8613-1b942a94a876-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:31 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-be26af7c-30b4-49c4-ab6f-f39e8a515ddd tempest-ProjectMemberTests-1556323482 None] Acquiring lock "cinder-quobyte-9da0fd47-c1c1-48ac-b5e6-472d52718a33" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:31 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-50a1ef70-08e4-465e-bf43-ccc273e62aaa tempest-CinderUnicodeTest-333851401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:31 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-50a1ef70-08e4-465e-bf43-ccc273e62aaa tempest-CinderUnicodeTest-333851401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:31 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-50a1ef70-08e4-465e-bf43-ccc273e62aaa tempest-CinderUnicodeTest-333851401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:11:31 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-50a1ef70-08e4-465e-bf43-ccc273e62aaa tempest-CinderUnicodeTest-333851401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:11:31 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-50a1ef70-08e4-465e-bf43-ccc273e62aaa tempest-CinderUnicodeTest-333851401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:31 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-50a1ef70-08e4-465e-bf43-ccc273e62aaa tempest-CinderUnicodeTest-333851401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:31 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-be26af7c-30b4-49c4-ab6f-f39e8a515ddd tempest-ProjectMemberTests-1556323482 None] Lock "cinder-quobyte-9da0fd47-c1c1-48ac-b5e6-472d52718a33" acquired by "delete_snapshot" :: waited 0.043s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:31 devstack sudo[108755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:11:31 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-be26af7c-30b4-49c4-ab6f-f39e8a515ddd tempest-ProjectMemberTests-1556323482 None] Acquiring lock "cinder-quobyte-07b73f00-e718-4b6c-8613-1b942a94a876" by "_delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:31 devstack sudo[108755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:31 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-be26af7c-30b4-49c4-ab6f-f39e8a515ddd tempest-ProjectMemberTests-1556323482 None] Lock "cinder-quobyte-07b73f00-e718-4b6c-8613-1b942a94a876" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:31 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-be26af7c-30b4-49c4-ab6f-f39e8a515ddd tempest-ProjectMemberTests-1556323482 None] Deleting offline snapshot 07b73f00-e718-4b6c-8613-1b942a94a876 of volume 9da0fd47-c1c1-48ac-b5e6-472d52718a33 {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:11:31 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-be26af7c-30b4-49c4-ab6f-f39e8a515ddd tempest-ProjectMemberTests-1556323482 None] snapshot_file for this snap is: volume-9da0fd47-c1c1-48ac-b5e6-472d52718a33.07b73f00-e718-4b6c-8613-1b942a94a876 {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:11:31 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[622824d2-39c7-4482-b213-c17ac3853321]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:11:31 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-be26af7c-30b4-49c4-ab6f-f39e8a515ddd tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9da0fd47-c1c1-48ac-b5e6-472d52718a33.07b73f00-e718-4b6c-8613-1b942a94a876 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:31 devstack sudo[108757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9da0fd47-c1c1-48ac-b5e6-472d52718a33.07b73f00-e718-4b6c-8613-1b942a94a876 Jul 30 17:11:31 devstack sudo[108757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:31 devstack sudo[108755]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:31 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-50a1ef70-08e4-465e-bf43-ccc273e62aaa tempest-CinderUnicodeTest-333851401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.273s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:31 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-50a1ef70-08e4-465e-bf43-ccc273e62aaa tempest-CinderUnicodeTest-333851401 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:11:31 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-50a1ef70-08e4-465e-bf43-ccc273e62aaa tempest-CinderUnicodeTest-333851401 None] Deleted volume successfully. Jul 30 17:11:31 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-50a1ef70-08e4-465e-bf43-ccc273e62aaa tempest-CinderUnicodeTest-333851401 None] Lock "cinder-e773cb47-4f7a-4e18-b67d-0b1d44ffddc4-delete_volume" released by "delete_volume" :: held 1.330s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:32 devstack sudo[108757]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:32 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-be26af7c-30b4-49c4-ab6f-f39e8a515ddd tempest-ProjectMemberTests-1556323482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9da0fd47-c1c1-48ac-b5e6-472d52718a33.07b73f00-e718-4b6c-8613-1b942a94a876" returned: 0 in 0.427s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:32 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-be26af7c-30b4-49c4-ab6f-f39e8a515ddd tempest-ProjectMemberTests-1556323482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9da0fd47-c1c1-48ac-b5e6-472d52718a33(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:11:32 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60d627e-113f-492f-a1ce-9bb9f65f3524]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:11:32 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-be26af7c-30b4-49c4-ab6f-f39e8a515ddd tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9da0fd47-c1c1-48ac-b5e6-472d52718a33 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:32 devstack sudo[108763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9da0fd47-c1c1-48ac-b5e6-472d52718a33 Jul 30 17:11:32 devstack sudo[108763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:32 devstack sudo[108763]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:32 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-be26af7c-30b4-49c4-ab6f-f39e8a515ddd tempest-ProjectMemberTests-1556323482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9da0fd47-c1c1-48ac-b5e6-472d52718a33" returned: 0 in 0.398s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:32 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-be26af7c-30b4-49c4-ab6f-f39e8a515ddd tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9da0fd47-c1c1-48ac-b5e6-472d52718a33.07b73f00-e718-4b6c-8613-1b942a94a876 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:32 devstack sudo[108768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9da0fd47-c1c1-48ac-b5e6-472d52718a33.07b73f00-e718-4b6c-8613-1b942a94a876 Jul 30 17:11:32 devstack sudo[108768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:32 devstack sudo[108768]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:32 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-be26af7c-30b4-49c4-ab6f-f39e8a515ddd tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9da0fd47-c1c1-48ac-b5e6-472d52718a33.07b73f00-e718-4b6c-8613-1b942a94a876" returned: 0 in 0.468s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:32 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-be26af7c-30b4-49c4-ab6f-f39e8a515ddd tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9da0fd47-c1c1-48ac-b5e6-472d52718a33.07b73f00-e718-4b6c-8613-1b942a94a876 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:32 devstack sudo[108773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9da0fd47-c1c1-48ac-b5e6-472d52718a33.07b73f00-e718-4b6c-8613-1b942a94a876 Jul 30 17:11:32 devstack sudo[108773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:33 devstack sudo[108773]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:33 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-be26af7c-30b4-49c4-ab6f-f39e8a515ddd tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9da0fd47-c1c1-48ac-b5e6-472d52718a33.07b73f00-e718-4b6c-8613-1b942a94a876" returned: 0 in 0.283s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:33 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-be26af7c-30b4-49c4-ab6f-f39e8a515ddd tempest-ProjectMemberTests-1556323482 None] Lock "cinder-quobyte-07b73f00-e718-4b6c-8613-1b942a94a876" released by "_delete_snapshot" :: held 1.711s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:33 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-be26af7c-30b4-49c4-ab6f-f39e8a515ddd tempest-ProjectMemberTests-1556323482 None] Lock "cinder-quobyte-9da0fd47-c1c1-48ac-b5e6-472d52718a33" released by "delete_snapshot" :: held 1.741s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:33 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-be26af7c-30b4-49c4-ab6f-f39e8a515ddd tempest-ProjectMemberTests-1556323482 None] Created reservations ['49c1fb19-b74f-4aa6-b0ed-2e961fa02a03', '1852923f-87de-4440-85aa-885d22ec7798', 'd3c10c7f-6267-400c-bac5-3f6044365b2a', '8da53287-00dd-4cc2-9bbe-a48523810995'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:11:33 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-be26af7c-30b4-49c4-ab6f-f39e8a515ddd tempest-ProjectMemberTests-1556323482 None] Delete snapshot completed successfully. Jul 30 17:11:33 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-be26af7c-30b4-49c4-ab6f-f39e8a515ddd tempest-ProjectMemberTests-1556323482 None] Lock "cinder-07b73f00-e718-4b6c-8613-1b942a94a876-delete_snapshot" released by "delete_snapshot" :: held 1.920s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:33 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-77b25ecf-6cbd-4d83-a8cd-4b296f556725 tempest-ProjectMemberTests-1556323482 None] Acquiring lock "cinder-9da0fd47-c1c1-48ac-b5e6-472d52718a33-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:33 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-77b25ecf-6cbd-4d83-a8cd-4b296f556725 tempest-ProjectMemberTests-1556323482 None] Lock "cinder-9da0fd47-c1c1-48ac-b5e6-472d52718a33-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:33 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-77b25ecf-6cbd-4d83-a8cd-4b296f556725 tempest-ProjectMemberTests-1556323482 None] Acquiring lock "cinder-quobyte-9da0fd47-c1c1-48ac-b5e6-472d52718a33" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:33 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-77b25ecf-6cbd-4d83-a8cd-4b296f556725 tempest-ProjectMemberTests-1556323482 None] Lock "cinder-quobyte-9da0fd47-c1c1-48ac-b5e6-472d52718a33" acquired by "delete_volume" :: waited 0.015s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:33 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcfbf726-ff16-4061-8802-16463abac7f1]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:11:33 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-77b25ecf-6cbd-4d83-a8cd-4b296f556725 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9da0fd47-c1c1-48ac-b5e6-472d52718a33 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:33 devstack sudo[108776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9da0fd47-c1c1-48ac-b5e6-472d52718a33 Jul 30 17:11:33 devstack sudo[108776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:34 devstack sudo[108776]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:34 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-77b25ecf-6cbd-4d83-a8cd-4b296f556725 tempest-ProjectMemberTests-1556323482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9da0fd47-c1c1-48ac-b5e6-472d52718a33" returned: 0 in 0.375s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:34 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-77b25ecf-6cbd-4d83-a8cd-4b296f556725 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9da0fd47-c1c1-48ac-b5e6-472d52718a33 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:34 devstack sudo[108781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9da0fd47-c1c1-48ac-b5e6-472d52718a33 Jul 30 17:11:34 devstack sudo[108781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:34 devstack sudo[108781]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:34 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-77b25ecf-6cbd-4d83-a8cd-4b296f556725 tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9da0fd47-c1c1-48ac-b5e6-472d52718a33" returned: 0 in 0.248s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:34 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-77b25ecf-6cbd-4d83-a8cd-4b296f556725 tempest-ProjectMemberTests-1556323482 None] Lock "cinder-quobyte-9da0fd47-c1c1-48ac-b5e6-472d52718a33" released by "delete_volume" :: held 0.683s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:34 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-77b25ecf-6cbd-4d83-a8cd-4b296f556725 tempest-ProjectMemberTests-1556323482 None] Created reservations ['02edd007-86ce-470b-b1c2-7364e1c2c2ca', 'be0eabe5-dd03-4bb2-b293-f2198912d85d', '9c4f057b-2cb9-440a-bdef-c82810ef17e5', '924f436f-f9e9-4600-8f9e-575415030628'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:11:34 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-77b25ecf-6cbd-4d83-a8cd-4b296f556725 tempest-ProjectMemberTests-1556323482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:34 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-77b25ecf-6cbd-4d83-a8cd-4b296f556725 tempest-ProjectMemberTests-1556323482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:34 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-77b25ecf-6cbd-4d83-a8cd-4b296f556725 tempest-ProjectMemberTests-1556323482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:11:34 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-77b25ecf-6cbd-4d83-a8cd-4b296f556725 tempest-ProjectMemberTests-1556323482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:11:34 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-77b25ecf-6cbd-4d83-a8cd-4b296f556725 tempest-ProjectMemberTests-1556323482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:34 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-77b25ecf-6cbd-4d83-a8cd-4b296f556725 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:34 devstack sudo[108784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:11:34 devstack sudo[108784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:34 devstack sudo[108784]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:34 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-77b25ecf-6cbd-4d83-a8cd-4b296f556725 tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.258s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:34 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-77b25ecf-6cbd-4d83-a8cd-4b296f556725 tempest-ProjectMemberTests-1556323482 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:11:34 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-77b25ecf-6cbd-4d83-a8cd-4b296f556725 tempest-ProjectMemberTests-1556323482 None] Deleted volume successfully. Jul 30 17:11:34 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-77b25ecf-6cbd-4d83-a8cd-4b296f556725 tempest-ProjectMemberTests-1556323482 None] Lock "cinder-9da0fd47-c1c1-48ac-b5e6-472d52718a33-delete_volume" released by "delete_volume" :: held 1.156s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:35 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-65379888-8995-44a3-8477-1c03db548845 tempest-ProjectMemberTests-1556323482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:11:35 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-65379888-8995-44a3-8477-1c03db548845 tempest-ProjectMemberTests-1556323482 None] Flow 'volume_create_manager' (9af2e6d8-3372-4ded-a3f5-ae3e4e633086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:11:35 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-65379888-8995-44a3-8477-1c03db548845 tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (373d7c7a-cc79-4b38-bd15-c8603bb6dd0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:35 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-65379888-8995-44a3-8477-1c03db548845 tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (373d7c7a-cc79-4b38-bd15-c8603bb6dd0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:11:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1765501304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef0520ae-2087-4d54-b82c-b0d0df72a42f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72a0b0e3a199416698115290d71c6808',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:11:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:11:35Z,use_quota=True,user_id='8f2d7aa2b6ab4865b626b01a01acc0f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:35 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-65379888-8995-44a3-8477-1c03db548845 tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d92e18e-95d2-4838-956a-6d179bc56a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:35 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-65379888-8995-44a3-8477-1c03db548845 tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d92e18e-95d2-4838-956a-6d179bc56a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:35 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-65379888-8995-44a3-8477-1c03db548845 tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03fc2f54-3554-488e-92f0-5c5b9cd0462d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:35 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-65379888-8995-44a3-8477-1c03db548845 tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03fc2f54-3554-488e-92f0-5c5b9cd0462d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef0520ae-2087-4d54-b82c-b0d0df72a42f', 'volume_name': 'volume-ef0520ae-2087-4d54-b82c-b0d0df72a42f', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:35 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-65379888-8995-44a3-8477-1c03db548845 tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (125dff2f-38df-4a85-a0e0-8ce041d0b9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:35 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-65379888-8995-44a3-8477-1c03db548845 tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (125dff2f-38df-4a85-a0e0-8ce041d0b9f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:35 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-65379888-8995-44a3-8477-1c03db548845 tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2e6cb5f-c462-4424-809c-2b963cbd90e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:35 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-65379888-8995-44a3-8477-1c03db548845 tempest-ProjectMemberTests-1556323482 None] Volume ef0520ae-2087-4d54-b82c-b0d0df72a42f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef0520ae-2087-4d54-b82c-b0d0df72a42f', 'volume_size': 1} Jul 30 17:11:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-65379888-8995-44a3-8477-1c03db548845 tempest-ProjectMemberTests-1556323482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-65379888-8995-44a3-8477-1c03db548845 tempest-ProjectMemberTests-1556323482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:35 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-65379888-8995-44a3-8477-1c03db548845 tempest-ProjectMemberTests-1556323482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:11:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1765501304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef0520ae-2087-4d54-b82c-b0d0df72a42f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72a0b0e3a199416698115290d71c6808',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:11:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:11:35Z,use_quota=True,user_id='8f2d7aa2b6ab4865b626b01a01acc0f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:11:35 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-65379888-8995-44a3-8477-1c03db548845 tempest-ProjectMemberTests-1556323482 None] Creating volume ef0520ae-2087-4d54-b82c-b0d0df72a42f {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:11:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-65379888-8995-44a3-8477-1c03db548845 tempest-ProjectMemberTests-1556323482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-65379888-8995-44a3-8477-1c03db548845 tempest-ProjectMemberTests-1556323482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:35 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-65379888-8995-44a3-8477-1c03db548845 tempest-ProjectMemberTests-1556323482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:11:35 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-65379888-8995-44a3-8477-1c03db548845 tempest-ProjectMemberTests-1556323482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:11:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-65379888-8995-44a3-8477-1c03db548845 tempest-ProjectMemberTests-1556323482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:35 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-65379888-8995-44a3-8477-1c03db548845 tempest-ProjectMemberTests-1556323482 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:11:35 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-65379888-8995-44a3-8477-1c03db548845 tempest-ProjectMemberTests-1556323482 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:11:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-65379888-8995-44a3-8477-1c03db548845 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-ef0520ae-2087-4d54-b82c-b0d0df72a42f 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:35 devstack sudo[108788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-ef0520ae-2087-4d54-b82c-b0d0df72a42f 1073741824 Jul 30 17:11:35 devstack sudo[108788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:35 devstack sudo[108788]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-65379888-8995-44a3-8477-1c03db548845 tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-ef0520ae-2087-4d54-b82c-b0d0df72a42f 1073741824" returned: 0 in 0.440s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:35 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-65379888-8995-44a3-8477-1c03db548845 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-ef0520ae-2087-4d54-b82c-b0d0df72a42f {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:35 devstack sudo[108794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-ef0520ae-2087-4d54-b82c-b0d0df72a42f Jul 30 17:11:35 devstack sudo[108794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:36 devstack sudo[108794]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-65379888-8995-44a3-8477-1c03db548845 tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-ef0520ae-2087-4d54-b82c-b0d0df72a42f" returned: 0 in 0.253s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:36 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-65379888-8995-44a3-8477-1c03db548845 tempest-ProjectMemberTests-1556323482 None] <== create_volume: return (736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:11:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-65379888-8995-44a3-8477-1c03db548845 tempest-ProjectMemberTests-1556323482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:36 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-65379888-8995-44a3-8477-1c03db548845 tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2e6cb5f-c462-4424-809c-2b963cbd90e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef0520ae-2087-4d54-b82c-b0d0df72a42f', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:36 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-65379888-8995-44a3-8477-1c03db548845 tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09775514-2365-47b1-9d61-9bd1fdd48d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:36 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-65379888-8995-44a3-8477-1c03db548845 tempest-ProjectMemberTests-1556323482 None] Volume volume-ef0520ae-2087-4d54-b82c-b0d0df72a42f (ef0520ae-2087-4d54-b82c-b0d0df72a42f): created successfully Jul 30 17:11:36 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-65379888-8995-44a3-8477-1c03db548845 tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09775514-2365-47b1-9d61-9bd1fdd48d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:36 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-65379888-8995-44a3-8477-1c03db548845 tempest-ProjectMemberTests-1556323482 None] Flow 'volume_create_manager' (9af2e6d8-3372-4ded-a3f5-ae3e4e633086) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:11:36 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-65379888-8995-44a3-8477-1c03db548845 tempest-ProjectMemberTests-1556323482 None] Created volume successfully. Jul 30 17:11:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-f41057e2-1a08-4a28-827e-9caace932b75 tempest-ProjectMemberTests-1556323482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-f41057e2-1a08-4a28-827e-9caace932b75 tempest-ProjectMemberTests-1556323482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:36 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-f41057e2-1a08-4a28-827e-9caace932b75 tempest-ProjectMemberTests-1556323482 None] Creating offline snapshot a0c05175-210a-4d4e-8353-908b92a2d592 of volume ef0520ae-2087-4d54-b82c-b0d0df72a42f {{(pid=88568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:11:36 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f7905b3-220a-4ac6-a871-55bceb3d1118]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:11:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f41057e2-1a08-4a28-827e-9caace932b75 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-ef0520ae-2087-4d54-b82c-b0d0df72a42f {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:36 devstack sudo[108797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-ef0520ae-2087-4d54-b82c-b0d0df72a42f Jul 30 17:11:36 devstack sudo[108797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:36 devstack sudo[108797]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f41057e2-1a08-4a28-827e-9caace932b75 tempest-ProjectMemberTests-1556323482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-ef0520ae-2087-4d54-b82c-b0d0df72a42f" returned: 0 in 0.392s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:36 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f41057e2-1a08-4a28-827e-9caace932b75 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-ef0520ae-2087-4d54-b82c-b0d0df72a42f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-ef0520ae-2087-4d54-b82c-b0d0df72a42f.a0c05175-210a-4d4e-8353-908b92a2d592 1G {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:36 devstack sudo[108802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-ef0520ae-2087-4d54-b82c-b0d0df72a42f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-ef0520ae-2087-4d54-b82c-b0d0df72a42f.a0c05175-210a-4d4e-8353-908b92a2d592 1G Jul 30 17:11:36 devstack sudo[108802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:37 devstack sudo[108802]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:37 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f41057e2-1a08-4a28-827e-9caace932b75 tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-ef0520ae-2087-4d54-b82c-b0d0df72a42f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-ef0520ae-2087-4d54-b82c-b0d0df72a42f.a0c05175-210a-4d4e-8353-908b92a2d592 1G" returned: 0 in 0.451s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:37 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f41057e2-1a08-4a28-827e-9caace932b75 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef0520ae-2087-4d54-b82c-b0d0df72a42f -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-ef0520ae-2087-4d54-b82c-b0d0df72a42f.a0c05175-210a-4d4e-8353-908b92a2d592 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:37 devstack sudo[108808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef0520ae-2087-4d54-b82c-b0d0df72a42f -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-ef0520ae-2087-4d54-b82c-b0d0df72a42f.a0c05175-210a-4d4e-8353-908b92a2d592 Jul 30 17:11:37 devstack sudo[108808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:37 devstack sudo[108808]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:37 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f41057e2-1a08-4a28-827e-9caace932b75 tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef0520ae-2087-4d54-b82c-b0d0df72a42f -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-ef0520ae-2087-4d54-b82c-b0d0df72a42f.a0c05175-210a-4d4e-8353-908b92a2d592" returned: 0 in 0.319s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:37 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-f41057e2-1a08-4a28-827e-9caace932b75 tempest-ProjectMemberTests-1556323482 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-ef0520ae-2087-4d54-b82c-b0d0df72a42f.a0c05175-210a-4d4e-8353-908b92a2d592 is being set with open permissions: ugo+rw Jul 30 17:11:37 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f41057e2-1a08-4a28-827e-9caace932b75 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-ef0520ae-2087-4d54-b82c-b0d0df72a42f.a0c05175-210a-4d4e-8353-908b92a2d592 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:37 devstack sudo[108813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-ef0520ae-2087-4d54-b82c-b0d0df72a42f.a0c05175-210a-4d4e-8353-908b92a2d592 Jul 30 17:11:37 devstack sudo[108813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:37 devstack sudo[108813]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:37 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f41057e2-1a08-4a28-827e-9caace932b75 tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-ef0520ae-2087-4d54-b82c-b0d0df72a42f.a0c05175-210a-4d4e-8353-908b92a2d592" returned: 0 in 0.256s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:38 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f41057e2-1a08-4a28-827e-9caace932b75 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-ef0520ae-2087-4d54-b82c-b0d0df72a42f.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:38 devstack sudo[108816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-ef0520ae-2087-4d54-b82c-b0d0df72a42f.info Jul 30 17:11:38 devstack sudo[108816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:38 devstack sudo[108816]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:38 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f41057e2-1a08-4a28-827e-9caace932b75 tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-ef0520ae-2087-4d54-b82c-b0d0df72a42f.info" returned: 0 in 0.273s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:38 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-f41057e2-1a08-4a28-827e-9caace932b75 tempest-ProjectMemberTests-1556323482 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-ef0520ae-2087-4d54-b82c-b0d0df72a42f.info is being set with open permissions: ugo+rw Jul 30 17:11:38 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f41057e2-1a08-4a28-827e-9caace932b75 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-ef0520ae-2087-4d54-b82c-b0d0df72a42f.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:38 devstack sudo[108819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-ef0520ae-2087-4d54-b82c-b0d0df72a42f.info Jul 30 17:11:38 devstack sudo[108819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:38 devstack sudo[108819]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:38 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-f41057e2-1a08-4a28-827e-9caace932b75 tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-ef0520ae-2087-4d54-b82c-b0d0df72a42f.info" returned: 0 in 0.253s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:38 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-f41057e2-1a08-4a28-827e-9caace932b75 tempest-ProjectMemberTests-1556323482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.080s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:38 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-f41057e2-1a08-4a28-827e-9caace932b75 tempest-ProjectMemberTests-1556323482 None] Create snapshot completed successfully Jul 30 17:11:39 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfc08aac-1bff-4b43-bfa1-924274414e6c tempest-ProjectReaderTests-1506540965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:11:39 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-cfc08aac-1bff-4b43-bfa1-924274414e6c tempest-ProjectReaderTests-1506540965 None] Flow 'volume_create_manager' (494b5d21-21a4-4e63-bfb6-a0d0a0c3f3d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:11:39 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-cfc08aac-1bff-4b43-bfa1-924274414e6c tempest-ProjectReaderTests-1506540965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6ea5495-dbdd-4674-be4d-f986f143ff60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:39 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-cfc08aac-1bff-4b43-bfa1-924274414e6c tempest-ProjectReaderTests-1506540965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6ea5495-dbdd-4674-be4d-f986f143ff60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1763317920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50ef915a-0f34-45d2-969b-872d5da54716,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d6f792b22ba46ca94d09af3b2157e87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:11:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:11:40Z,use_quota=True,user_id='32ed3c4f75834041b2773f0e7b64d007',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:39 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-cfc08aac-1bff-4b43-bfa1-924274414e6c tempest-ProjectReaderTests-1506540965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bebe0f9-4913-4b39-8041-b346809b9eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:39 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-cfc08aac-1bff-4b43-bfa1-924274414e6c tempest-ProjectReaderTests-1506540965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bebe0f9-4913-4b39-8041-b346809b9eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:39 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-cfc08aac-1bff-4b43-bfa1-924274414e6c tempest-ProjectReaderTests-1506540965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a080420e-677d-4944-9595-d66cfb1ef7cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:39 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-cfc08aac-1bff-4b43-bfa1-924274414e6c tempest-ProjectReaderTests-1506540965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a080420e-677d-4944-9595-d66cfb1ef7cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50ef915a-0f34-45d2-969b-872d5da54716', 'volume_name': 'volume-50ef915a-0f34-45d2-969b-872d5da54716', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:39 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-cfc08aac-1bff-4b43-bfa1-924274414e6c tempest-ProjectReaderTests-1506540965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab4ec863-d952-4e02-9939-d4c93cbd9eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:39 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-cfc08aac-1bff-4b43-bfa1-924274414e6c tempest-ProjectReaderTests-1506540965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab4ec863-d952-4e02-9939-d4c93cbd9eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:39 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-cfc08aac-1bff-4b43-bfa1-924274414e6c tempest-ProjectReaderTests-1506540965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e096f9b1-4b96-4359-aa5e-b82481f98017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:39 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-cfc08aac-1bff-4b43-bfa1-924274414e6c tempest-ProjectReaderTests-1506540965 None] Volume 50ef915a-0f34-45d2-969b-872d5da54716: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50ef915a-0f34-45d2-969b-872d5da54716', 'volume_size': 1} Jul 30 17:11:39 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-cfc08aac-1bff-4b43-bfa1-924274414e6c tempest-ProjectReaderTests-1506540965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:39 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-cfc08aac-1bff-4b43-bfa1-924274414e6c tempest-ProjectReaderTests-1506540965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:39 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-cfc08aac-1bff-4b43-bfa1-924274414e6c tempest-ProjectReaderTests-1506540965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1763317920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50ef915a-0f34-45d2-969b-872d5da54716,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d6f792b22ba46ca94d09af3b2157e87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:11:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:11:40Z,use_quota=True,user_id='32ed3c4f75834041b2773f0e7b64d007',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:11:39 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-cfc08aac-1bff-4b43-bfa1-924274414e6c tempest-ProjectReaderTests-1506540965 None] Creating volume 50ef915a-0f34-45d2-969b-872d5da54716 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:11:39 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-cfc08aac-1bff-4b43-bfa1-924274414e6c tempest-ProjectReaderTests-1506540965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:39 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-cfc08aac-1bff-4b43-bfa1-924274414e6c tempest-ProjectReaderTests-1506540965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:39 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-cfc08aac-1bff-4b43-bfa1-924274414e6c tempest-ProjectReaderTests-1506540965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:11:39 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-cfc08aac-1bff-4b43-bfa1-924274414e6c tempest-ProjectReaderTests-1506540965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:11:39 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-cfc08aac-1bff-4b43-bfa1-924274414e6c tempest-ProjectReaderTests-1506540965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:39 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-cfc08aac-1bff-4b43-bfa1-924274414e6c tempest-ProjectReaderTests-1506540965 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:11:39 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-cfc08aac-1bff-4b43-bfa1-924274414e6c tempest-ProjectReaderTests-1506540965 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:11:39 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-cfc08aac-1bff-4b43-bfa1-924274414e6c tempest-ProjectReaderTests-1506540965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-50ef915a-0f34-45d2-969b-872d5da54716 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:39 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-bc123cf9-ef9b-4b3f-aeef-43af18326fb4 tempest-ProjectMemberTests-1556323482 None] Acquiring lock "cinder-a0c05175-210a-4d4e-8353-908b92a2d592-delete_snapshot" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:39 devstack sudo[108822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-50ef915a-0f34-45d2-969b-872d5da54716 1073741824 Jul 30 17:11:39 devstack sudo[108822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:39 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-bc123cf9-ef9b-4b3f-aeef-43af18326fb4 tempest-ProjectMemberTests-1556323482 None] Lock "cinder-a0c05175-210a-4d4e-8353-908b92a2d592-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:39 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-bc123cf9-ef9b-4b3f-aeef-43af18326fb4 tempest-ProjectMemberTests-1556323482 None] Acquiring lock "cinder-quobyte-ef0520ae-2087-4d54-b82c-b0d0df72a42f" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:39 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-bc123cf9-ef9b-4b3f-aeef-43af18326fb4 tempest-ProjectMemberTests-1556323482 None] Lock "cinder-quobyte-ef0520ae-2087-4d54-b82c-b0d0df72a42f" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:39 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-bc123cf9-ef9b-4b3f-aeef-43af18326fb4 tempest-ProjectMemberTests-1556323482 None] Acquiring lock "cinder-quobyte-a0c05175-210a-4d4e-8353-908b92a2d592" by "_delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:39 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-bc123cf9-ef9b-4b3f-aeef-43af18326fb4 tempest-ProjectMemberTests-1556323482 None] Lock "cinder-quobyte-a0c05175-210a-4d4e-8353-908b92a2d592" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:39 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-bc123cf9-ef9b-4b3f-aeef-43af18326fb4 tempest-ProjectMemberTests-1556323482 None] Deleting offline snapshot a0c05175-210a-4d4e-8353-908b92a2d592 of volume ef0520ae-2087-4d54-b82c-b0d0df72a42f {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:11:39 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-bc123cf9-ef9b-4b3f-aeef-43af18326fb4 tempest-ProjectMemberTests-1556323482 None] snapshot_file for this snap is: volume-ef0520ae-2087-4d54-b82c-b0d0df72a42f.a0c05175-210a-4d4e-8353-908b92a2d592 {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:11:39 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5afd04-a77d-4514-91ea-049dc19e92f6]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:11:39 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-bc123cf9-ef9b-4b3f-aeef-43af18326fb4 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-ef0520ae-2087-4d54-b82c-b0d0df72a42f.a0c05175-210a-4d4e-8353-908b92a2d592 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:39 devstack sudo[108824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-ef0520ae-2087-4d54-b82c-b0d0df72a42f.a0c05175-210a-4d4e-8353-908b92a2d592 Jul 30 17:11:39 devstack sudo[108824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:40 devstack sudo[108822]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:40 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-cfc08aac-1bff-4b43-bfa1-924274414e6c tempest-ProjectReaderTests-1506540965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-50ef915a-0f34-45d2-969b-872d5da54716 1073741824" returned: 0 in 0.448s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:40 devstack sudo[108824]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:40 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-bc123cf9-ef9b-4b3f-aeef-43af18326fb4 tempest-ProjectMemberTests-1556323482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-ef0520ae-2087-4d54-b82c-b0d0df72a42f.a0c05175-210a-4d4e-8353-908b92a2d592" returned: 0 in 0.370s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:40 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-bc123cf9-ef9b-4b3f-aeef-43af18326fb4 tempest-ProjectMemberTests-1556323482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef0520ae-2087-4d54-b82c-b0d0df72a42f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:11:40 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b98981-d4db-49d2-ade6-9de0fa193aa4]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:11:40 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-bc123cf9-ef9b-4b3f-aeef-43af18326fb4 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-ef0520ae-2087-4d54-b82c-b0d0df72a42f {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:40 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-cfc08aac-1bff-4b43-bfa1-924274414e6c tempest-ProjectReaderTests-1506540965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-50ef915a-0f34-45d2-969b-872d5da54716 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:40 devstack sudo[108833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-50ef915a-0f34-45d2-969b-872d5da54716 Jul 30 17:11:40 devstack sudo[108833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:40 devstack sudo[108832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-ef0520ae-2087-4d54-b82c-b0d0df72a42f Jul 30 17:11:40 devstack sudo[108832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:40 devstack sudo[108833]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:40 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-cfc08aac-1bff-4b43-bfa1-924274414e6c tempest-ProjectReaderTests-1506540965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-50ef915a-0f34-45d2-969b-872d5da54716" returned: 0 in 0.248s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:40 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-cfc08aac-1bff-4b43-bfa1-924274414e6c tempest-ProjectReaderTests-1506540965 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:11:40 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-cfc08aac-1bff-4b43-bfa1-924274414e6c tempest-ProjectReaderTests-1506540965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:40 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-cfc08aac-1bff-4b43-bfa1-924274414e6c tempest-ProjectReaderTests-1506540965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e096f9b1-4b96-4359-aa5e-b82481f98017) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50ef915a-0f34-45d2-969b-872d5da54716', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:40 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-cfc08aac-1bff-4b43-bfa1-924274414e6c tempest-ProjectReaderTests-1506540965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d5fe47c-39e3-40f3-b893-98fbd7c37999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:40 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-cfc08aac-1bff-4b43-bfa1-924274414e6c tempest-ProjectReaderTests-1506540965 None] Volume volume-50ef915a-0f34-45d2-969b-872d5da54716 (50ef915a-0f34-45d2-969b-872d5da54716): created successfully Jul 30 17:11:40 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-cfc08aac-1bff-4b43-bfa1-924274414e6c tempest-ProjectReaderTests-1506540965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d5fe47c-39e3-40f3-b893-98fbd7c37999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:40 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-cfc08aac-1bff-4b43-bfa1-924274414e6c tempest-ProjectReaderTests-1506540965 None] Flow 'volume_create_manager' (494b5d21-21a4-4e63-bfb6-a0d0a0c3f3d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:11:40 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-cfc08aac-1bff-4b43-bfa1-924274414e6c tempest-ProjectReaderTests-1506540965 None] Created volume successfully. Jul 30 17:11:40 devstack sudo[108832]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:40 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-bc123cf9-ef9b-4b3f-aeef-43af18326fb4 tempest-ProjectMemberTests-1556323482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-ef0520ae-2087-4d54-b82c-b0d0df72a42f" returned: 0 in 0.379s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:40 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-bc123cf9-ef9b-4b3f-aeef-43af18326fb4 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-ef0520ae-2087-4d54-b82c-b0d0df72a42f.a0c05175-210a-4d4e-8353-908b92a2d592 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:40 devstack sudo[108844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-ef0520ae-2087-4d54-b82c-b0d0df72a42f.a0c05175-210a-4d4e-8353-908b92a2d592 Jul 30 17:11:40 devstack sudo[108844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:40 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-73dc05d8-98ea-408d-8ed3-0555d44392f7 tempest-ProjectReaderTests-1506540965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:40 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-73dc05d8-98ea-408d-8ed3-0555d44392f7 tempest-ProjectReaderTests-1506540965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:40 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-73dc05d8-98ea-408d-8ed3-0555d44392f7 tempest-ProjectReaderTests-1506540965 None] Creating offline snapshot 7f9795e2-9b8f-4656-9afa-b03f779b4541 of volume 50ef915a-0f34-45d2-969b-872d5da54716 {{(pid=88568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:11:40 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[957a24b1-26bc-4417-ae64-3ff86f68d993]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:11:40 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-73dc05d8-98ea-408d-8ed3-0555d44392f7 tempest-ProjectReaderTests-1506540965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-50ef915a-0f34-45d2-969b-872d5da54716 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:40 devstack sudo[108844]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:40 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-bc123cf9-ef9b-4b3f-aeef-43af18326fb4 tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-ef0520ae-2087-4d54-b82c-b0d0df72a42f.a0c05175-210a-4d4e-8353-908b92a2d592" returned: 0 in 0.403s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:40 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-bc123cf9-ef9b-4b3f-aeef-43af18326fb4 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-ef0520ae-2087-4d54-b82c-b0d0df72a42f.a0c05175-210a-4d4e-8353-908b92a2d592 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:40 devstack sudo[108884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-ef0520ae-2087-4d54-b82c-b0d0df72a42f.a0c05175-210a-4d4e-8353-908b92a2d592 Jul 30 17:11:40 devstack sudo[108884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:41 devstack sudo[108883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-50ef915a-0f34-45d2-969b-872d5da54716 Jul 30 17:11:41 devstack sudo[108883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:41 devstack sudo[108884]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:41 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-bc123cf9-ef9b-4b3f-aeef-43af18326fb4 tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-ef0520ae-2087-4d54-b82c-b0d0df72a42f.a0c05175-210a-4d4e-8353-908b92a2d592" returned: 0 in 0.254s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:41 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-bc123cf9-ef9b-4b3f-aeef-43af18326fb4 tempest-ProjectMemberTests-1556323482 None] Lock "cinder-quobyte-a0c05175-210a-4d4e-8353-908b92a2d592" released by "_delete_snapshot" :: held 1.495s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:41 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-bc123cf9-ef9b-4b3f-aeef-43af18326fb4 tempest-ProjectMemberTests-1556323482 None] Lock "cinder-quobyte-ef0520ae-2087-4d54-b82c-b0d0df72a42f" released by "delete_snapshot" :: held 1.514s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:41 devstack sudo[108883]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:41 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-73dc05d8-98ea-408d-8ed3-0555d44392f7 tempest-ProjectReaderTests-1506540965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-50ef915a-0f34-45d2-969b-872d5da54716" returned: 0 in 0.392s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:41 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-73dc05d8-98ea-408d-8ed3-0555d44392f7 tempest-ProjectReaderTests-1506540965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-50ef915a-0f34-45d2-969b-872d5da54716,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-50ef915a-0f34-45d2-969b-872d5da54716.7f9795e2-9b8f-4656-9afa-b03f779b4541 1G {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:41 devstack sudo[108891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-50ef915a-0f34-45d2-969b-872d5da54716,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-50ef915a-0f34-45d2-969b-872d5da54716.7f9795e2-9b8f-4656-9afa-b03f779b4541 1G Jul 30 17:11:41 devstack sudo[108891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:41 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-bc123cf9-ef9b-4b3f-aeef-43af18326fb4 tempest-ProjectMemberTests-1556323482 None] Created reservations ['437ffc67-d9ea-4a38-8518-1dd5a70aea5d', 'd0dbcb2e-1df2-4a6d-b0a9-9267a6eb0248', 'dcd7e9cc-7fca-4406-8664-76e259087643', '8d122da7-5b31-4ffb-ba6b-2f8bf9b17290'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:11:41 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-bc123cf9-ef9b-4b3f-aeef-43af18326fb4 tempest-ProjectMemberTests-1556323482 None] Delete snapshot completed successfully. Jul 30 17:11:41 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-bc123cf9-ef9b-4b3f-aeef-43af18326fb4 tempest-ProjectMemberTests-1556323482 None] Lock "cinder-a0c05175-210a-4d4e-8353-908b92a2d592-delete_snapshot" released by "delete_snapshot" :: held 1.666s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:41 devstack sudo[108891]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:41 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-73dc05d8-98ea-408d-8ed3-0555d44392f7 tempest-ProjectReaderTests-1506540965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-50ef915a-0f34-45d2-969b-872d5da54716,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-50ef915a-0f34-45d2-969b-872d5da54716.7f9795e2-9b8f-4656-9afa-b03f779b4541 1G" returned: 0 in 0.389s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:41 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-73dc05d8-98ea-408d-8ed3-0555d44392f7 tempest-ProjectReaderTests-1506540965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50ef915a-0f34-45d2-969b-872d5da54716 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-50ef915a-0f34-45d2-969b-872d5da54716.7f9795e2-9b8f-4656-9afa-b03f779b4541 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:41 devstack sudo[108897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50ef915a-0f34-45d2-969b-872d5da54716 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-50ef915a-0f34-45d2-969b-872d5da54716.7f9795e2-9b8f-4656-9afa-b03f779b4541 Jul 30 17:11:41 devstack sudo[108897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:41 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-29f04c61-3d47-4468-b546-dfbeee253b80 tempest-ProjectMemberTests-1556323482 None] Acquiring lock "cinder-ef0520ae-2087-4d54-b82c-b0d0df72a42f-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:41 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-29f04c61-3d47-4468-b546-dfbeee253b80 tempest-ProjectMemberTests-1556323482 None] Lock "cinder-ef0520ae-2087-4d54-b82c-b0d0df72a42f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:41 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-29f04c61-3d47-4468-b546-dfbeee253b80 tempest-ProjectMemberTests-1556323482 None] Acquiring lock "cinder-quobyte-ef0520ae-2087-4d54-b82c-b0d0df72a42f" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:41 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-29f04c61-3d47-4468-b546-dfbeee253b80 tempest-ProjectMemberTests-1556323482 None] Lock "cinder-quobyte-ef0520ae-2087-4d54-b82c-b0d0df72a42f" acquired by "delete_volume" :: waited 0.016s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:41 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[5333e930-cadc-4db7-b477-ba8f9caab83a]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:11:41 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-29f04c61-3d47-4468-b546-dfbeee253b80 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-ef0520ae-2087-4d54-b82c-b0d0df72a42f {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:41 devstack sudo[108897]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:41 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-73dc05d8-98ea-408d-8ed3-0555d44392f7 tempest-ProjectReaderTests-1506540965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50ef915a-0f34-45d2-969b-872d5da54716 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-50ef915a-0f34-45d2-969b-872d5da54716.7f9795e2-9b8f-4656-9afa-b03f779b4541" returned: 0 in 0.308s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:41 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-73dc05d8-98ea-408d-8ed3-0555d44392f7 tempest-ProjectReaderTests-1506540965 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-50ef915a-0f34-45d2-969b-872d5da54716.7f9795e2-9b8f-4656-9afa-b03f779b4541 is being set with open permissions: ugo+rw Jul 30 17:11:41 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-73dc05d8-98ea-408d-8ed3-0555d44392f7 tempest-ProjectReaderTests-1506540965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-50ef915a-0f34-45d2-969b-872d5da54716.7f9795e2-9b8f-4656-9afa-b03f779b4541 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:42 devstack sudo[108903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-50ef915a-0f34-45d2-969b-872d5da54716.7f9795e2-9b8f-4656-9afa-b03f779b4541 Jul 30 17:11:42 devstack sudo[108903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:42 devstack sudo[108902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-ef0520ae-2087-4d54-b82c-b0d0df72a42f Jul 30 17:11:42 devstack sudo[108902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:42 devstack sudo[108903]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:42 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-73dc05d8-98ea-408d-8ed3-0555d44392f7 tempest-ProjectReaderTests-1506540965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-50ef915a-0f34-45d2-969b-872d5da54716.7f9795e2-9b8f-4656-9afa-b03f779b4541" returned: 0 in 0.243s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:42 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-73dc05d8-98ea-408d-8ed3-0555d44392f7 tempest-ProjectReaderTests-1506540965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-50ef915a-0f34-45d2-969b-872d5da54716.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:42 devstack sudo[108909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-50ef915a-0f34-45d2-969b-872d5da54716.info Jul 30 17:11:42 devstack sudo[108909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:42 devstack sudo[108902]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:42 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-29f04c61-3d47-4468-b546-dfbeee253b80 tempest-ProjectMemberTests-1556323482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-ef0520ae-2087-4d54-b82c-b0d0df72a42f" returned: 0 in 0.365s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:42 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-29f04c61-3d47-4468-b546-dfbeee253b80 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-ef0520ae-2087-4d54-b82c-b0d0df72a42f {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:42 devstack sudo[108912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-ef0520ae-2087-4d54-b82c-b0d0df72a42f Jul 30 17:11:42 devstack sudo[108912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:42 devstack sudo[108909]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:42 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-73dc05d8-98ea-408d-8ed3-0555d44392f7 tempest-ProjectReaderTests-1506540965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-50ef915a-0f34-45d2-969b-872d5da54716.info" returned: 0 in 0.257s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:42 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-73dc05d8-98ea-408d-8ed3-0555d44392f7 tempest-ProjectReaderTests-1506540965 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-50ef915a-0f34-45d2-969b-872d5da54716.info is being set with open permissions: ugo+rw Jul 30 17:11:42 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-73dc05d8-98ea-408d-8ed3-0555d44392f7 tempest-ProjectReaderTests-1506540965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-50ef915a-0f34-45d2-969b-872d5da54716.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:42 devstack sudo[108915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-50ef915a-0f34-45d2-969b-872d5da54716.info Jul 30 17:11:42 devstack sudo[108915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:42 devstack sudo[108912]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:42 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-29f04c61-3d47-4468-b546-dfbeee253b80 tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-ef0520ae-2087-4d54-b82c-b0d0df72a42f" returned: 0 in 0.252s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:42 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-29f04c61-3d47-4468-b546-dfbeee253b80 tempest-ProjectMemberTests-1556323482 None] Lock "cinder-quobyte-ef0520ae-2087-4d54-b82c-b0d0df72a42f" released by "delete_volume" :: held 0.683s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:42 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-29f04c61-3d47-4468-b546-dfbeee253b80 tempest-ProjectMemberTests-1556323482 None] Created reservations ['cb88e319-d9a5-49ad-b879-23df537f5fcf', 'de9c0e55-6496-40fe-ac35-f4f974d1698e', '2e7f82a6-a1fe-4f8d-8960-da1a223ae6d2', 'f8163552-40ca-4417-9f63-8d7f861def80'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:11:42 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-29f04c61-3d47-4468-b546-dfbeee253b80 tempest-ProjectMemberTests-1556323482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:42 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-29f04c61-3d47-4468-b546-dfbeee253b80 tempest-ProjectMemberTests-1556323482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:42 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-29f04c61-3d47-4468-b546-dfbeee253b80 tempest-ProjectMemberTests-1556323482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:11:42 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-29f04c61-3d47-4468-b546-dfbeee253b80 tempest-ProjectMemberTests-1556323482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:11:42 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-29f04c61-3d47-4468-b546-dfbeee253b80 tempest-ProjectMemberTests-1556323482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:42 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-29f04c61-3d47-4468-b546-dfbeee253b80 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:42 devstack sudo[108918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:11:42 devstack sudo[108918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:42 devstack sudo[108915]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:42 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-73dc05d8-98ea-408d-8ed3-0555d44392f7 tempest-ProjectReaderTests-1506540965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-50ef915a-0f34-45d2-969b-872d5da54716.info" returned: 0 in 0.269s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:42 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-73dc05d8-98ea-408d-8ed3-0555d44392f7 tempest-ProjectReaderTests-1506540965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.939s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:42 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-73dc05d8-98ea-408d-8ed3-0555d44392f7 tempest-ProjectReaderTests-1506540965 None] Create snapshot completed successfully Jul 30 17:11:43 devstack sudo[108918]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:43 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-29f04c61-3d47-4468-b546-dfbeee253b80 tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.296s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:43 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-29f04c61-3d47-4468-b546-dfbeee253b80 tempest-ProjectMemberTests-1556323482 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:11:43 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-29f04c61-3d47-4468-b546-dfbeee253b80 tempest-ProjectMemberTests-1556323482 None] Deleted volume successfully. Jul 30 17:11:43 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-29f04c61-3d47-4468-b546-dfbeee253b80 tempest-ProjectMemberTests-1556323482 None] Lock "cinder-ef0520ae-2087-4d54-b82c-b0d0df72a42f-delete_volume" released by "delete_volume" :: held 1.204s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:43 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-c3545b7f-fcff-406a-96d8-081f16477ad2 tempest-ProjectReaderTests-1506540965 None] Acquiring lock "cinder-7f9795e2-9b8f-4656-9afa-b03f779b4541-delete_snapshot" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:43 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-c3545b7f-fcff-406a-96d8-081f16477ad2 tempest-ProjectReaderTests-1506540965 None] Lock "cinder-7f9795e2-9b8f-4656-9afa-b03f779b4541-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:43 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-c3545b7f-fcff-406a-96d8-081f16477ad2 tempest-ProjectReaderTests-1506540965 None] Acquiring lock "cinder-quobyte-50ef915a-0f34-45d2-969b-872d5da54716" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:43 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-c3545b7f-fcff-406a-96d8-081f16477ad2 tempest-ProjectReaderTests-1506540965 None] Lock "cinder-quobyte-50ef915a-0f34-45d2-969b-872d5da54716" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:43 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-c3545b7f-fcff-406a-96d8-081f16477ad2 tempest-ProjectReaderTests-1506540965 None] Acquiring lock "cinder-quobyte-7f9795e2-9b8f-4656-9afa-b03f779b4541" by "_delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:43 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-c3545b7f-fcff-406a-96d8-081f16477ad2 tempest-ProjectReaderTests-1506540965 None] Lock "cinder-quobyte-7f9795e2-9b8f-4656-9afa-b03f779b4541" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:43 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-c3545b7f-fcff-406a-96d8-081f16477ad2 tempest-ProjectReaderTests-1506540965 None] Deleting offline snapshot 7f9795e2-9b8f-4656-9afa-b03f779b4541 of volume 50ef915a-0f34-45d2-969b-872d5da54716 {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:11:43 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-c3545b7f-fcff-406a-96d8-081f16477ad2 tempest-ProjectReaderTests-1506540965 None] snapshot_file for this snap is: volume-50ef915a-0f34-45d2-969b-872d5da54716.7f9795e2-9b8f-4656-9afa-b03f779b4541 {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:11:43 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac2bc3e-fdcd-493b-afe4-515dfa8d2263]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:11:43 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-c3545b7f-fcff-406a-96d8-081f16477ad2 tempest-ProjectReaderTests-1506540965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-50ef915a-0f34-45d2-969b-872d5da54716.7f9795e2-9b8f-4656-9afa-b03f779b4541 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:43 devstack sudo[108922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-50ef915a-0f34-45d2-969b-872d5da54716.7f9795e2-9b8f-4656-9afa-b03f779b4541 Jul 30 17:11:43 devstack sudo[108922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:43 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-65dc5cbc-a55b-4118-8440-e398e95322d6 tempest-ProjectMemberTests-1556323482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:11:43 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-65dc5cbc-a55b-4118-8440-e398e95322d6 tempest-ProjectMemberTests-1556323482 None] Flow 'volume_create_manager' (482d8013-064d-415b-983f-a32f7d28abca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:11:43 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-65dc5cbc-a55b-4118-8440-e398e95322d6 tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a4d9fc2-4f70-4011-98b6-61aaa22e34b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:43 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-65dc5cbc-a55b-4118-8440-e398e95322d6 tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a4d9fc2-4f70-4011-98b6-61aaa22e34b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:11:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-494347069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc9ae7fe-fd00-454b-a421-d3fae79725d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72a0b0e3a199416698115290d71c6808',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:11:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:11:43Z,use_quota=True,user_id='8f2d7aa2b6ab4865b626b01a01acc0f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:43 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-65dc5cbc-a55b-4118-8440-e398e95322d6 tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1b42491-3896-44a5-ba5a-1282067caee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:43 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-65dc5cbc-a55b-4118-8440-e398e95322d6 tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1b42491-3896-44a5-ba5a-1282067caee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:43 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-65dc5cbc-a55b-4118-8440-e398e95322d6 tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a60d344-ffbf-43d0-ac0c-85316f632589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:43 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-65dc5cbc-a55b-4118-8440-e398e95322d6 tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a60d344-ffbf-43d0-ac0c-85316f632589) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc9ae7fe-fd00-454b-a421-d3fae79725d3', 'volume_name': 'volume-fc9ae7fe-fd00-454b-a421-d3fae79725d3', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:43 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-65dc5cbc-a55b-4118-8440-e398e95322d6 tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d56b1f3-08b1-4097-a862-5d395c6bac00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:43 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-65dc5cbc-a55b-4118-8440-e398e95322d6 tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d56b1f3-08b1-4097-a862-5d395c6bac00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:43 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-65dc5cbc-a55b-4118-8440-e398e95322d6 tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ade40d68-7c6f-4fff-bb7f-ad80f7c92a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:43 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-65dc5cbc-a55b-4118-8440-e398e95322d6 tempest-ProjectMemberTests-1556323482 None] Volume fc9ae7fe-fd00-454b-a421-d3fae79725d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc9ae7fe-fd00-454b-a421-d3fae79725d3', 'volume_size': 1} Jul 30 17:11:43 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-65dc5cbc-a55b-4118-8440-e398e95322d6 tempest-ProjectMemberTests-1556323482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:43 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-65dc5cbc-a55b-4118-8440-e398e95322d6 tempest-ProjectMemberTests-1556323482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:43 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-65dc5cbc-a55b-4118-8440-e398e95322d6 tempest-ProjectMemberTests-1556323482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:11:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-494347069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc9ae7fe-fd00-454b-a421-d3fae79725d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72a0b0e3a199416698115290d71c6808',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:11:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:11:43Z,use_quota=True,user_id='8f2d7aa2b6ab4865b626b01a01acc0f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:11:43 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-65dc5cbc-a55b-4118-8440-e398e95322d6 tempest-ProjectMemberTests-1556323482 None] Creating volume fc9ae7fe-fd00-454b-a421-d3fae79725d3 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:11:43 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-65dc5cbc-a55b-4118-8440-e398e95322d6 tempest-ProjectMemberTests-1556323482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:43 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-65dc5cbc-a55b-4118-8440-e398e95322d6 tempest-ProjectMemberTests-1556323482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:43 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-65dc5cbc-a55b-4118-8440-e398e95322d6 tempest-ProjectMemberTests-1556323482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:11:43 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-65dc5cbc-a55b-4118-8440-e398e95322d6 tempest-ProjectMemberTests-1556323482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:11:43 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-65dc5cbc-a55b-4118-8440-e398e95322d6 tempest-ProjectMemberTests-1556323482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:43 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-65dc5cbc-a55b-4118-8440-e398e95322d6 tempest-ProjectMemberTests-1556323482 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:11:43 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-65dc5cbc-a55b-4118-8440-e398e95322d6 tempest-ProjectMemberTests-1556323482 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:11:43 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-65dc5cbc-a55b-4118-8440-e398e95322d6 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fc9ae7fe-fd00-454b-a421-d3fae79725d3 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:43 devstack sudo[108927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fc9ae7fe-fd00-454b-a421-d3fae79725d3 1073741824 Jul 30 17:11:43 devstack sudo[108927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:43 devstack sudo[108922]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:43 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-c3545b7f-fcff-406a-96d8-081f16477ad2 tempest-ProjectReaderTests-1506540965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-50ef915a-0f34-45d2-969b-872d5da54716.7f9795e2-9b8f-4656-9afa-b03f779b4541" returned: 0 in 0.382s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:43 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-c3545b7f-fcff-406a-96d8-081f16477ad2 tempest-ProjectReaderTests-1506540965 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-50ef915a-0f34-45d2-969b-872d5da54716(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:11:43 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc546d1c-687c-4407-b280-e65925a9a659]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:11:43 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-c3545b7f-fcff-406a-96d8-081f16477ad2 tempest-ProjectReaderTests-1506540965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-50ef915a-0f34-45d2-969b-872d5da54716 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:43 devstack sudo[108929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-50ef915a-0f34-45d2-969b-872d5da54716 Jul 30 17:11:43 devstack sudo[108929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:44 devstack sudo[108927]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:44 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-65dc5cbc-a55b-4118-8440-e398e95322d6 tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fc9ae7fe-fd00-454b-a421-d3fae79725d3 1073741824" returned: 0 in 0.441s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:44 devstack sudo[108929]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:44 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-c3545b7f-fcff-406a-96d8-081f16477ad2 tempest-ProjectReaderTests-1506540965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-50ef915a-0f34-45d2-969b-872d5da54716" returned: 0 in 0.374s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:44 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-c3545b7f-fcff-406a-96d8-081f16477ad2 tempest-ProjectReaderTests-1506540965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-50ef915a-0f34-45d2-969b-872d5da54716.7f9795e2-9b8f-4656-9afa-b03f779b4541 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:44 devstack sudo[108938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-50ef915a-0f34-45d2-969b-872d5da54716.7f9795e2-9b8f-4656-9afa-b03f779b4541 Jul 30 17:11:44 devstack sudo[108938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:44 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-65dc5cbc-a55b-4118-8440-e398e95322d6 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fc9ae7fe-fd00-454b-a421-d3fae79725d3 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:44 devstack sudo[108940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fc9ae7fe-fd00-454b-a421-d3fae79725d3 Jul 30 17:11:44 devstack sudo[108940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:44 devstack sudo[108940]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:44 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-65dc5cbc-a55b-4118-8440-e398e95322d6 tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fc9ae7fe-fd00-454b-a421-d3fae79725d3" returned: 0 in 0.257s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:44 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-65dc5cbc-a55b-4118-8440-e398e95322d6 tempest-ProjectMemberTests-1556323482 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:11:44 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-65dc5cbc-a55b-4118-8440-e398e95322d6 tempest-ProjectMemberTests-1556323482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:44 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-65dc5cbc-a55b-4118-8440-e398e95322d6 tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ade40d68-7c6f-4fff-bb7f-ad80f7c92a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc9ae7fe-fd00-454b-a421-d3fae79725d3', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:44 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-65dc5cbc-a55b-4118-8440-e398e95322d6 tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cc853ba-9ff3-4340-90c8-86ef3451f2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:44 devstack sudo[108938]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:44 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-65dc5cbc-a55b-4118-8440-e398e95322d6 tempest-ProjectMemberTests-1556323482 None] Volume volume-fc9ae7fe-fd00-454b-a421-d3fae79725d3 (fc9ae7fe-fd00-454b-a421-d3fae79725d3): created successfully Jul 30 17:11:44 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-65dc5cbc-a55b-4118-8440-e398e95322d6 tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cc853ba-9ff3-4340-90c8-86ef3451f2fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:44 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-65dc5cbc-a55b-4118-8440-e398e95322d6 tempest-ProjectMemberTests-1556323482 None] Flow 'volume_create_manager' (482d8013-064d-415b-983f-a32f7d28abca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:11:44 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-c3545b7f-fcff-406a-96d8-081f16477ad2 tempest-ProjectReaderTests-1506540965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-50ef915a-0f34-45d2-969b-872d5da54716.7f9795e2-9b8f-4656-9afa-b03f779b4541" returned: 0 in 0.346s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:44 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-c3545b7f-fcff-406a-96d8-081f16477ad2 tempest-ProjectReaderTests-1506540965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-50ef915a-0f34-45d2-969b-872d5da54716.7f9795e2-9b8f-4656-9afa-b03f779b4541 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:44 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-65dc5cbc-a55b-4118-8440-e398e95322d6 tempest-ProjectMemberTests-1556323482 None] Created volume successfully. Jul 30 17:11:44 devstack sudo[108946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-50ef915a-0f34-45d2-969b-872d5da54716.7f9795e2-9b8f-4656-9afa-b03f779b4541 Jul 30 17:11:44 devstack sudo[108946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:44 devstack sudo[108946]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:44 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-1a79321f-eb43-44ae-9f51-ab01e938c123 tempest-ProjectMemberTests-1556323482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:44 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-1a79321f-eb43-44ae-9f51-ab01e938c123 tempest-ProjectMemberTests-1556323482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:44 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-c3545b7f-fcff-406a-96d8-081f16477ad2 tempest-ProjectReaderTests-1506540965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-50ef915a-0f34-45d2-969b-872d5da54716.7f9795e2-9b8f-4656-9afa-b03f779b4541" returned: 0 in 0.273s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:44 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-1a79321f-eb43-44ae-9f51-ab01e938c123 tempest-ProjectMemberTests-1556323482 None] Creating offline snapshot 01121896-735d-472c-a482-e6051da96505 of volume fc9ae7fe-fd00-454b-a421-d3fae79725d3 {{(pid=88568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:11:44 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-c3545b7f-fcff-406a-96d8-081f16477ad2 tempest-ProjectReaderTests-1506540965 None] Lock "cinder-quobyte-7f9795e2-9b8f-4656-9afa-b03f779b4541" released by "_delete_snapshot" :: held 1.484s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:44 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-c3545b7f-fcff-406a-96d8-081f16477ad2 tempest-ProjectReaderTests-1506540965 None] Lock "cinder-quobyte-50ef915a-0f34-45d2-969b-872d5da54716" released by "delete_snapshot" :: held 1.509s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:44 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a2226c-712d-4403-9514-801be98d895f]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:11:44 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-1a79321f-eb43-44ae-9f51-ab01e938c123 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fc9ae7fe-fd00-454b-a421-d3fae79725d3 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:44 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-c3545b7f-fcff-406a-96d8-081f16477ad2 tempest-ProjectReaderTests-1506540965 None] Created reservations ['ff8a5bd1-08b2-44e5-8b6d-53691aee3ac0', '7d65915a-eae5-474f-ac36-ebb39c456a20', 'c9eca3b2-c5dd-4ba2-a15e-a7d3a0e1fe28', '4399d8a9-f0d5-4735-9ba3-70047f56dac3'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:11:44 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-c3545b7f-fcff-406a-96d8-081f16477ad2 tempest-ProjectReaderTests-1506540965 None] Delete snapshot completed successfully. Jul 30 17:11:44 devstack sudo[108949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fc9ae7fe-fd00-454b-a421-d3fae79725d3 Jul 30 17:11:44 devstack sudo[108949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:44 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-c3545b7f-fcff-406a-96d8-081f16477ad2 tempest-ProjectReaderTests-1506540965 None] Lock "cinder-7f9795e2-9b8f-4656-9afa-b03f779b4541-delete_snapshot" released by "delete_snapshot" :: held 1.649s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:45 devstack sudo[108949]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:45 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-1a79321f-eb43-44ae-9f51-ab01e938c123 tempest-ProjectMemberTests-1556323482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fc9ae7fe-fd00-454b-a421-d3fae79725d3" returned: 0 in 0.356s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:45 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-1a79321f-eb43-44ae-9f51-ab01e938c123 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fc9ae7fe-fd00-454b-a421-d3fae79725d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fc9ae7fe-fd00-454b-a421-d3fae79725d3.01121896-735d-472c-a482-e6051da96505 1G {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:45 devstack sudo[108955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fc9ae7fe-fd00-454b-a421-d3fae79725d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fc9ae7fe-fd00-454b-a421-d3fae79725d3.01121896-735d-472c-a482-e6051da96505 1G Jul 30 17:11:45 devstack sudo[108955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:45 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-8af069a6-27ac-4d70-98df-4b888fc12463 tempest-ProjectReaderTests-1506540965 None] Acquiring lock "cinder-50ef915a-0f34-45d2-969b-872d5da54716-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:45 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-8af069a6-27ac-4d70-98df-4b888fc12463 tempest-ProjectReaderTests-1506540965 None] Lock "cinder-50ef915a-0f34-45d2-969b-872d5da54716-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:45 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-8af069a6-27ac-4d70-98df-4b888fc12463 tempest-ProjectReaderTests-1506540965 None] Acquiring lock "cinder-quobyte-50ef915a-0f34-45d2-969b-872d5da54716" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:45 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-8af069a6-27ac-4d70-98df-4b888fc12463 tempest-ProjectReaderTests-1506540965 None] Lock "cinder-quobyte-50ef915a-0f34-45d2-969b-872d5da54716" acquired by "delete_volume" :: waited 0.015s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:45 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f8c24f-4e72-4a3e-900a-073c41089df0]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:11:45 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8af069a6-27ac-4d70-98df-4b888fc12463 tempest-ProjectReaderTests-1506540965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-50ef915a-0f34-45d2-969b-872d5da54716 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:45 devstack sudo[108955]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:45 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-1a79321f-eb43-44ae-9f51-ab01e938c123 tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fc9ae7fe-fd00-454b-a421-d3fae79725d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fc9ae7fe-fd00-454b-a421-d3fae79725d3.01121896-735d-472c-a482-e6051da96505 1G" returned: 0 in 0.437s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:45 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-1a79321f-eb43-44ae-9f51-ab01e938c123 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc9ae7fe-fd00-454b-a421-d3fae79725d3 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fc9ae7fe-fd00-454b-a421-d3fae79725d3.01121896-735d-472c-a482-e6051da96505 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:45 devstack sudo[108962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc9ae7fe-fd00-454b-a421-d3fae79725d3 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fc9ae7fe-fd00-454b-a421-d3fae79725d3.01121896-735d-472c-a482-e6051da96505 Jul 30 17:11:45 devstack sudo[108962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:45 devstack sudo[108961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-50ef915a-0f34-45d2-969b-872d5da54716 Jul 30 17:11:45 devstack sudo[108961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:45 devstack sudo[108962]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:45 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-1a79321f-eb43-44ae-9f51-ab01e938c123 tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc9ae7fe-fd00-454b-a421-d3fae79725d3 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fc9ae7fe-fd00-454b-a421-d3fae79725d3.01121896-735d-472c-a482-e6051da96505" returned: 0 in 0.295s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:45 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-1a79321f-eb43-44ae-9f51-ab01e938c123 tempest-ProjectMemberTests-1556323482 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fc9ae7fe-fd00-454b-a421-d3fae79725d3.01121896-735d-472c-a482-e6051da96505 is being set with open permissions: ugo+rw Jul 30 17:11:45 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-1a79321f-eb43-44ae-9f51-ab01e938c123 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fc9ae7fe-fd00-454b-a421-d3fae79725d3.01121896-735d-472c-a482-e6051da96505 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:45 devstack sudo[108961]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:45 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8af069a6-27ac-4d70-98df-4b888fc12463 tempest-ProjectReaderTests-1506540965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-50ef915a-0f34-45d2-969b-872d5da54716" returned: 0 in 0.372s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:45 devstack sudo[108971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fc9ae7fe-fd00-454b-a421-d3fae79725d3.01121896-735d-472c-a482-e6051da96505 Jul 30 17:11:45 devstack sudo[108971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:45 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8af069a6-27ac-4d70-98df-4b888fc12463 tempest-ProjectReaderTests-1506540965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-50ef915a-0f34-45d2-969b-872d5da54716 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:45 devstack sudo[108973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-50ef915a-0f34-45d2-969b-872d5da54716 Jul 30 17:11:45 devstack sudo[108973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:46 devstack sudo[108971]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:46 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-1a79321f-eb43-44ae-9f51-ab01e938c123 tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fc9ae7fe-fd00-454b-a421-d3fae79725d3.01121896-735d-472c-a482-e6051da96505" returned: 0 in 0.244s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:46 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-1a79321f-eb43-44ae-9f51-ab01e938c123 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fc9ae7fe-fd00-454b-a421-d3fae79725d3.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:46 devstack sudo[108973]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:46 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8af069a6-27ac-4d70-98df-4b888fc12463 tempest-ProjectReaderTests-1506540965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-50ef915a-0f34-45d2-969b-872d5da54716" returned: 0 in 0.254s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:46 devstack sudo[108977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fc9ae7fe-fd00-454b-a421-d3fae79725d3.info Jul 30 17:11:46 devstack sudo[108977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:46 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-8af069a6-27ac-4d70-98df-4b888fc12463 tempest-ProjectReaderTests-1506540965 None] Lock "cinder-quobyte-50ef915a-0f34-45d2-969b-872d5da54716" released by "delete_volume" :: held 0.688s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:46 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-8af069a6-27ac-4d70-98df-4b888fc12463 tempest-ProjectReaderTests-1506540965 None] Created reservations ['50a80ab1-5200-467d-9786-95f1034a7d9a', '8f8506ff-80ad-4c5f-a825-e2cd42fc80e4', 'f4a0175f-1bbd-4439-917b-f0cc5015d776', 'fc169fc6-f92f-4832-bafd-1d224de6c2a7'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:11:46 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-8af069a6-27ac-4d70-98df-4b888fc12463 tempest-ProjectReaderTests-1506540965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:46 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-8af069a6-27ac-4d70-98df-4b888fc12463 tempest-ProjectReaderTests-1506540965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:46 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-8af069a6-27ac-4d70-98df-4b888fc12463 tempest-ProjectReaderTests-1506540965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:11:46 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-8af069a6-27ac-4d70-98df-4b888fc12463 tempest-ProjectReaderTests-1506540965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:11:46 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-8af069a6-27ac-4d70-98df-4b888fc12463 tempest-ProjectReaderTests-1506540965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:46 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8af069a6-27ac-4d70-98df-4b888fc12463 tempest-ProjectReaderTests-1506540965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:46 devstack sudo[108979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:11:46 devstack sudo[108979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:46 devstack sudo[108977]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:46 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-1a79321f-eb43-44ae-9f51-ab01e938c123 tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fc9ae7fe-fd00-454b-a421-d3fae79725d3.info" returned: 0 in 0.267s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:46 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-1a79321f-eb43-44ae-9f51-ab01e938c123 tempest-ProjectMemberTests-1556323482 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fc9ae7fe-fd00-454b-a421-d3fae79725d3.info is being set with open permissions: ugo+rw Jul 30 17:11:46 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-1a79321f-eb43-44ae-9f51-ab01e938c123 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fc9ae7fe-fd00-454b-a421-d3fae79725d3.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:46 devstack sudo[108982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fc9ae7fe-fd00-454b-a421-d3fae79725d3.info Jul 30 17:11:46 devstack sudo[108982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:46 devstack sudo[108979]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:46 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8af069a6-27ac-4d70-98df-4b888fc12463 tempest-ProjectReaderTests-1506540965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.256s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:46 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-8af069a6-27ac-4d70-98df-4b888fc12463 tempest-ProjectReaderTests-1506540965 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:11:46 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-8af069a6-27ac-4d70-98df-4b888fc12463 tempest-ProjectReaderTests-1506540965 None] Deleted volume successfully. Jul 30 17:11:46 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-8af069a6-27ac-4d70-98df-4b888fc12463 tempest-ProjectReaderTests-1506540965 None] Lock "cinder-50ef915a-0f34-45d2-969b-872d5da54716-delete_volume" released by "delete_volume" :: held 1.173s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:46 devstack sudo[108982]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:46 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-1a79321f-eb43-44ae-9f51-ab01e938c123 tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fc9ae7fe-fd00-454b-a421-d3fae79725d3.info" returned: 0 in 0.262s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:46 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-1a79321f-eb43-44ae-9f51-ab01e938c123 tempest-ProjectMemberTests-1556323482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.961s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:46 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-1a79321f-eb43-44ae-9f51-ab01e938c123 tempest-ProjectMemberTests-1556323482 None] Create snapshot completed successfully Jul 30 17:11:46 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-31cd5afd-1db3-4da3-b088-831124807671 tempest-ProjectMemberTests-1556323482 None] Acquiring lock "cinder-01121896-735d-472c-a482-e6051da96505-delete_snapshot" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:46 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-31cd5afd-1db3-4da3-b088-831124807671 tempest-ProjectMemberTests-1556323482 None] Lock "cinder-01121896-735d-472c-a482-e6051da96505-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:46 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-31cd5afd-1db3-4da3-b088-831124807671 tempest-ProjectMemberTests-1556323482 None] Acquiring lock "cinder-quobyte-fc9ae7fe-fd00-454b-a421-d3fae79725d3" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:46 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-31cd5afd-1db3-4da3-b088-831124807671 tempest-ProjectMemberTests-1556323482 None] Lock "cinder-quobyte-fc9ae7fe-fd00-454b-a421-d3fae79725d3" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:46 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-31cd5afd-1db3-4da3-b088-831124807671 tempest-ProjectMemberTests-1556323482 None] Acquiring lock "cinder-quobyte-01121896-735d-472c-a482-e6051da96505" by "_delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:46 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-31cd5afd-1db3-4da3-b088-831124807671 tempest-ProjectMemberTests-1556323482 None] Lock "cinder-quobyte-01121896-735d-472c-a482-e6051da96505" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:46 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-31cd5afd-1db3-4da3-b088-831124807671 tempest-ProjectMemberTests-1556323482 None] Deleting offline snapshot 01121896-735d-472c-a482-e6051da96505 of volume fc9ae7fe-fd00-454b-a421-d3fae79725d3 {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:11:46 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-31cd5afd-1db3-4da3-b088-831124807671 tempest-ProjectMemberTests-1556323482 None] snapshot_file for this snap is: volume-fc9ae7fe-fd00-454b-a421-d3fae79725d3.01121896-735d-472c-a482-e6051da96505 {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:11:46 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b10d86-7404-47bb-8980-ca9ab37582f3]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:11:46 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-31cd5afd-1db3-4da3-b088-831124807671 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fc9ae7fe-fd00-454b-a421-d3fae79725d3.01121896-735d-472c-a482-e6051da96505 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:47 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a223a7a-2fea-4258-b93d-f63a1d8ba7da tempest-ProjectReaderTests-1506540965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:11:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1a223a7a-2fea-4258-b93d-f63a1d8ba7da tempest-ProjectReaderTests-1506540965 None] Flow 'volume_create_manager' (384527d3-c773-42d8-afeb-b5c3572a886a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:11:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1a223a7a-2fea-4258-b93d-f63a1d8ba7da tempest-ProjectReaderTests-1506540965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6878b27a-2732-4763-9f2b-c0039818612d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1a223a7a-2fea-4258-b93d-f63a1d8ba7da tempest-ProjectReaderTests-1506540965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6878b27a-2732-4763-9f2b-c0039818612d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:11:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1771583990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d1bef6c-0826-4b5b-8679-49a5b8ae8812,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d6f792b22ba46ca94d09af3b2157e87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:11:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:11:47Z,use_quota=True,user_id='32ed3c4f75834041b2773f0e7b64d007',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1a223a7a-2fea-4258-b93d-f63a1d8ba7da tempest-ProjectReaderTests-1506540965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82a9ab40-db8e-468c-95e1-50f0147d4539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1a223a7a-2fea-4258-b93d-f63a1d8ba7da tempest-ProjectReaderTests-1506540965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82a9ab40-db8e-468c-95e1-50f0147d4539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:47 devstack sudo[108986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fc9ae7fe-fd00-454b-a421-d3fae79725d3.01121896-735d-472c-a482-e6051da96505 Jul 30 17:11:47 devstack sudo[108986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1a223a7a-2fea-4258-b93d-f63a1d8ba7da tempest-ProjectReaderTests-1506540965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47d3792b-115f-4c2e-a50d-1ae3e4621525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1a223a7a-2fea-4258-b93d-f63a1d8ba7da tempest-ProjectReaderTests-1506540965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47d3792b-115f-4c2e-a50d-1ae3e4621525) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d1bef6c-0826-4b5b-8679-49a5b8ae8812', 'volume_name': 'volume-5d1bef6c-0826-4b5b-8679-49a5b8ae8812', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1a223a7a-2fea-4258-b93d-f63a1d8ba7da tempest-ProjectReaderTests-1506540965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3ed4285-dd39-4fd8-b879-f5ab53669f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1a223a7a-2fea-4258-b93d-f63a1d8ba7da tempest-ProjectReaderTests-1506540965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3ed4285-dd39-4fd8-b879-f5ab53669f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1a223a7a-2fea-4258-b93d-f63a1d8ba7da tempest-ProjectReaderTests-1506540965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cdbd539-508a-4df0-b50d-ed133a18f7d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:47 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-1a223a7a-2fea-4258-b93d-f63a1d8ba7da tempest-ProjectReaderTests-1506540965 None] Volume 5d1bef6c-0826-4b5b-8679-49a5b8ae8812: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d1bef6c-0826-4b5b-8679-49a5b8ae8812', 'volume_size': 1} Jul 30 17:11:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-1a223a7a-2fea-4258-b93d-f63a1d8ba7da tempest-ProjectReaderTests-1506540965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-1a223a7a-2fea-4258-b93d-f63a1d8ba7da tempest-ProjectReaderTests-1506540965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:47 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-1a223a7a-2fea-4258-b93d-f63a1d8ba7da tempest-ProjectReaderTests-1506540965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:11:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1771583990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d1bef6c-0826-4b5b-8679-49a5b8ae8812,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d6f792b22ba46ca94d09af3b2157e87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:11:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:11:47Z,use_quota=True,user_id='32ed3c4f75834041b2773f0e7b64d007',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:11:47 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-1a223a7a-2fea-4258-b93d-f63a1d8ba7da tempest-ProjectReaderTests-1506540965 None] Creating volume 5d1bef6c-0826-4b5b-8679-49a5b8ae8812 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:11:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-1a223a7a-2fea-4258-b93d-f63a1d8ba7da tempest-ProjectReaderTests-1506540965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-1a223a7a-2fea-4258-b93d-f63a1d8ba7da tempest-ProjectReaderTests-1506540965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:47 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-1a223a7a-2fea-4258-b93d-f63a1d8ba7da tempest-ProjectReaderTests-1506540965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:11:47 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-1a223a7a-2fea-4258-b93d-f63a1d8ba7da tempest-ProjectReaderTests-1506540965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:11:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-1a223a7a-2fea-4258-b93d-f63a1d8ba7da tempest-ProjectReaderTests-1506540965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:47 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-1a223a7a-2fea-4258-b93d-f63a1d8ba7da tempest-ProjectReaderTests-1506540965 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:11:47 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-1a223a7a-2fea-4258-b93d-f63a1d8ba7da tempest-ProjectReaderTests-1506540965 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:11:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-1a223a7a-2fea-4258-b93d-f63a1d8ba7da tempest-ProjectReaderTests-1506540965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5d1bef6c-0826-4b5b-8679-49a5b8ae8812 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:47 devstack sudo[108990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5d1bef6c-0826-4b5b-8679-49a5b8ae8812 1073741824 Jul 30 17:11:47 devstack sudo[108990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:47 devstack sudo[108986]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-31cd5afd-1db3-4da3-b088-831124807671 tempest-ProjectMemberTests-1556323482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fc9ae7fe-fd00-454b-a421-d3fae79725d3.01121896-735d-472c-a482-e6051da96505" returned: 0 in 0.382s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:47 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-31cd5afd-1db3-4da3-b088-831124807671 tempest-ProjectMemberTests-1556323482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc9ae7fe-fd00-454b-a421-d3fae79725d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:11:47 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[29bb37d6-f6b7-439c-bf1a-b1159af92114]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:11:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-31cd5afd-1db3-4da3-b088-831124807671 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fc9ae7fe-fd00-454b-a421-d3fae79725d3 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:47 devstack sudo[108998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fc9ae7fe-fd00-454b-a421-d3fae79725d3 Jul 30 17:11:47 devstack sudo[108998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:47 devstack sudo[108990]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-1a223a7a-2fea-4258-b93d-f63a1d8ba7da tempest-ProjectReaderTests-1506540965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5d1bef6c-0826-4b5b-8679-49a5b8ae8812 1073741824" returned: 0 in 0.456s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-1a223a7a-2fea-4258-b93d-f63a1d8ba7da tempest-ProjectReaderTests-1506540965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5d1bef6c-0826-4b5b-8679-49a5b8ae8812 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:47 devstack sudo[109001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5d1bef6c-0826-4b5b-8679-49a5b8ae8812 Jul 30 17:11:47 devstack sudo[109001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:47 devstack sudo[108998]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-31cd5afd-1db3-4da3-b088-831124807671 tempest-ProjectMemberTests-1556323482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fc9ae7fe-fd00-454b-a421-d3fae79725d3" returned: 0 in 0.372s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-31cd5afd-1db3-4da3-b088-831124807671 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fc9ae7fe-fd00-454b-a421-d3fae79725d3.01121896-735d-472c-a482-e6051da96505 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:47 devstack sudo[109006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fc9ae7fe-fd00-454b-a421-d3fae79725d3.01121896-735d-472c-a482-e6051da96505 Jul 30 17:11:47 devstack sudo[109006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:47 devstack sudo[109001]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-1a223a7a-2fea-4258-b93d-f63a1d8ba7da tempest-ProjectReaderTests-1506540965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5d1bef6c-0826-4b5b-8679-49a5b8ae8812" returned: 0 in 0.274s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:47 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-1a223a7a-2fea-4258-b93d-f63a1d8ba7da tempest-ProjectReaderTests-1506540965 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:11:47 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-1a223a7a-2fea-4258-b93d-f63a1d8ba7da tempest-ProjectReaderTests-1506540965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1a223a7a-2fea-4258-b93d-f63a1d8ba7da tempest-ProjectReaderTests-1506540965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cdbd539-508a-4df0-b50d-ed133a18f7d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d1bef6c-0826-4b5b-8679-49a5b8ae8812', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1a223a7a-2fea-4258-b93d-f63a1d8ba7da tempest-ProjectReaderTests-1506540965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4918175d-0339-4437-9723-ae0a1ea3e847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:47 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-1a223a7a-2fea-4258-b93d-f63a1d8ba7da tempest-ProjectReaderTests-1506540965 None] Volume volume-5d1bef6c-0826-4b5b-8679-49a5b8ae8812 (5d1bef6c-0826-4b5b-8679-49a5b8ae8812): created successfully Jul 30 17:11:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1a223a7a-2fea-4258-b93d-f63a1d8ba7da tempest-ProjectReaderTests-1506540965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4918175d-0339-4437-9723-ae0a1ea3e847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:47 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1a223a7a-2fea-4258-b93d-f63a1d8ba7da tempest-ProjectReaderTests-1506540965 None] Flow 'volume_create_manager' (384527d3-c773-42d8-afeb-b5c3572a886a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:11:47 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-1a223a7a-2fea-4258-b93d-f63a1d8ba7da tempest-ProjectReaderTests-1506540965 None] Created volume successfully. Jul 30 17:11:48 devstack sudo[109006]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:48 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-31cd5afd-1db3-4da3-b088-831124807671 tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fc9ae7fe-fd00-454b-a421-d3fae79725d3.01121896-735d-472c-a482-e6051da96505" returned: 0 in 0.327s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:48 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-31cd5afd-1db3-4da3-b088-831124807671 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fc9ae7fe-fd00-454b-a421-d3fae79725d3.01121896-735d-472c-a482-e6051da96505 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:48 devstack sudo[109012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fc9ae7fe-fd00-454b-a421-d3fae79725d3.01121896-735d-472c-a482-e6051da96505 Jul 30 17:11:48 devstack sudo[109012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:48 devstack sudo[109012]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:48 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-31cd5afd-1db3-4da3-b088-831124807671 tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fc9ae7fe-fd00-454b-a421-d3fae79725d3.01121896-735d-472c-a482-e6051da96505" returned: 0 in 0.239s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:48 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-31cd5afd-1db3-4da3-b088-831124807671 tempest-ProjectMemberTests-1556323482 None] Lock "cinder-quobyte-01121896-735d-472c-a482-e6051da96505" released by "_delete_snapshot" :: held 1.419s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:48 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-31cd5afd-1db3-4da3-b088-831124807671 tempest-ProjectMemberTests-1556323482 None] Lock "cinder-quobyte-fc9ae7fe-fd00-454b-a421-d3fae79725d3" released by "delete_snapshot" :: held 1.442s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:48 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-31cd5afd-1db3-4da3-b088-831124807671 tempest-ProjectMemberTests-1556323482 None] Created reservations ['0b1d75e4-4f30-4fd0-848b-7edbc7593d91', '19784203-21ca-4ce8-ae08-a79ad27d159e', '45369989-3a61-423f-a087-5bca48cda193', 'e62f3304-7ee5-4248-9f02-580689d69c1d'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:11:48 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-31cd5afd-1db3-4da3-b088-831124807671 tempest-ProjectMemberTests-1556323482 None] Delete snapshot completed successfully. Jul 30 17:11:48 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-31cd5afd-1db3-4da3-b088-831124807671 tempest-ProjectMemberTests-1556323482 None] Lock "cinder-01121896-735d-472c-a482-e6051da96505-delete_snapshot" released by "delete_snapshot" :: held 1.575s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:49 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-79f565e7-49f4-4876-8eae-9d118e227ae2 tempest-ProjectMemberTests-1556323482 None] Acquiring lock "cinder-fc9ae7fe-fd00-454b-a421-d3fae79725d3-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:49 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-79f565e7-49f4-4876-8eae-9d118e227ae2 tempest-ProjectMemberTests-1556323482 None] Lock "cinder-fc9ae7fe-fd00-454b-a421-d3fae79725d3-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:49 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-79f565e7-49f4-4876-8eae-9d118e227ae2 tempest-ProjectMemberTests-1556323482 None] Acquiring lock "cinder-quobyte-fc9ae7fe-fd00-454b-a421-d3fae79725d3" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:49 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-79f565e7-49f4-4876-8eae-9d118e227ae2 tempest-ProjectMemberTests-1556323482 None] Lock "cinder-quobyte-fc9ae7fe-fd00-454b-a421-d3fae79725d3" acquired by "delete_volume" :: waited 0.015s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:49 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b1fd36-185d-4434-ba26-3f53ad4433d3]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:11:49 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-79f565e7-49f4-4876-8eae-9d118e227ae2 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fc9ae7fe-fd00-454b-a421-d3fae79725d3 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:49 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-52c2a9f5-b2ab-4e14-8cc3-13c642a1f379 tempest-ProjectReaderTests-1506540965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:49 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-52c2a9f5-b2ab-4e14-8cc3-13c642a1f379 tempest-ProjectReaderTests-1506540965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:49 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-52c2a9f5-b2ab-4e14-8cc3-13c642a1f379 tempest-ProjectReaderTests-1506540965 None] Creating offline snapshot 5b2d7418-bc4c-4180-aaac-49924c2ef76c of volume 5d1bef6c-0826-4b5b-8679-49a5b8ae8812 {{(pid=88568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:11:49 devstack sudo[109021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fc9ae7fe-fd00-454b-a421-d3fae79725d3 Jul 30 17:11:49 devstack sudo[109021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:49 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[1231ea6e-b5b2-40f3-b1f8-14b42c763a03]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:11:49 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-52c2a9f5-b2ab-4e14-8cc3-13c642a1f379 tempest-ProjectReaderTests-1506540965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5d1bef6c-0826-4b5b-8679-49a5b8ae8812 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:49 devstack sudo[109023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5d1bef6c-0826-4b5b-8679-49a5b8ae8812 Jul 30 17:11:49 devstack sudo[109023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:49 devstack sudo[109021]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:49 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-79f565e7-49f4-4876-8eae-9d118e227ae2 tempest-ProjectMemberTests-1556323482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fc9ae7fe-fd00-454b-a421-d3fae79725d3" returned: 0 in 0.376s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:49 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-79f565e7-49f4-4876-8eae-9d118e227ae2 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fc9ae7fe-fd00-454b-a421-d3fae79725d3 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:49 devstack sudo[109028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fc9ae7fe-fd00-454b-a421-d3fae79725d3 Jul 30 17:11:49 devstack sudo[109028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:49 devstack sudo[109023]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:49 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-52c2a9f5-b2ab-4e14-8cc3-13c642a1f379 tempest-ProjectReaderTests-1506540965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5d1bef6c-0826-4b5b-8679-49a5b8ae8812" returned: 0 in 0.365s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:49 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-52c2a9f5-b2ab-4e14-8cc3-13c642a1f379 tempest-ProjectReaderTests-1506540965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5d1bef6c-0826-4b5b-8679-49a5b8ae8812,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5d1bef6c-0826-4b5b-8679-49a5b8ae8812.5b2d7418-bc4c-4180-aaac-49924c2ef76c 1G {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:49 devstack sudo[109033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5d1bef6c-0826-4b5b-8679-49a5b8ae8812,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5d1bef6c-0826-4b5b-8679-49a5b8ae8812.5b2d7418-bc4c-4180-aaac-49924c2ef76c 1G Jul 30 17:11:49 devstack sudo[109033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:49 devstack sudo[109028]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:49 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-79f565e7-49f4-4876-8eae-9d118e227ae2 tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-fc9ae7fe-fd00-454b-a421-d3fae79725d3" returned: 0 in 0.254s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:49 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-79f565e7-49f4-4876-8eae-9d118e227ae2 tempest-ProjectMemberTests-1556323482 None] Lock "cinder-quobyte-fc9ae7fe-fd00-454b-a421-d3fae79725d3" released by "delete_volume" :: held 0.704s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:49 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-79f565e7-49f4-4876-8eae-9d118e227ae2 tempest-ProjectMemberTests-1556323482 None] Created reservations ['bb184cd6-30d9-4ea0-85ea-b5936108df31', '8717c1f4-7201-4527-bc20-b3da1fb44ea1', '59b382cc-ea8e-4ecc-af4f-1eb724e937de', 'e105a484-220c-45b3-9245-a8c9867c0aa9'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:11:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-79f565e7-49f4-4876-8eae-9d118e227ae2 tempest-ProjectMemberTests-1556323482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-79f565e7-49f4-4876-8eae-9d118e227ae2 tempest-ProjectMemberTests-1556323482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:50 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-79f565e7-49f4-4876-8eae-9d118e227ae2 tempest-ProjectMemberTests-1556323482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:11:50 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-79f565e7-49f4-4876-8eae-9d118e227ae2 tempest-ProjectMemberTests-1556323482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:11:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-79f565e7-49f4-4876-8eae-9d118e227ae2 tempest-ProjectMemberTests-1556323482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-79f565e7-49f4-4876-8eae-9d118e227ae2 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:50 devstack sudo[109040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:11:50 devstack sudo[109040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:50 devstack sudo[109033]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-52c2a9f5-b2ab-4e14-8cc3-13c642a1f379 tempest-ProjectReaderTests-1506540965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5d1bef6c-0826-4b5b-8679-49a5b8ae8812,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5d1bef6c-0826-4b5b-8679-49a5b8ae8812.5b2d7418-bc4c-4180-aaac-49924c2ef76c 1G" returned: 0 in 0.439s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-52c2a9f5-b2ab-4e14-8cc3-13c642a1f379 tempest-ProjectReaderTests-1506540965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d1bef6c-0826-4b5b-8679-49a5b8ae8812 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5d1bef6c-0826-4b5b-8679-49a5b8ae8812.5b2d7418-bc4c-4180-aaac-49924c2ef76c {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:50 devstack sudo[109042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d1bef6c-0826-4b5b-8679-49a5b8ae8812 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5d1bef6c-0826-4b5b-8679-49a5b8ae8812.5b2d7418-bc4c-4180-aaac-49924c2ef76c Jul 30 17:11:50 devstack sudo[109042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:50 devstack sudo[109040]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-79f565e7-49f4-4876-8eae-9d118e227ae2 tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.290s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:50 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-79f565e7-49f4-4876-8eae-9d118e227ae2 tempest-ProjectMemberTests-1556323482 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:11:50 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-79f565e7-49f4-4876-8eae-9d118e227ae2 tempest-ProjectMemberTests-1556323482 None] Deleted volume successfully. Jul 30 17:11:50 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-79f565e7-49f4-4876-8eae-9d118e227ae2 tempest-ProjectMemberTests-1556323482 None] Lock "cinder-fc9ae7fe-fd00-454b-a421-d3fae79725d3-delete_volume" released by "delete_volume" :: held 1.286s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:50 devstack sudo[109042]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-52c2a9f5-b2ab-4e14-8cc3-13c642a1f379 tempest-ProjectReaderTests-1506540965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d1bef6c-0826-4b5b-8679-49a5b8ae8812 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5d1bef6c-0826-4b5b-8679-49a5b8ae8812.5b2d7418-bc4c-4180-aaac-49924c2ef76c" returned: 0 in 0.345s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:50 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-52c2a9f5-b2ab-4e14-8cc3-13c642a1f379 tempest-ProjectReaderTests-1506540965 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5d1bef6c-0826-4b5b-8679-49a5b8ae8812.5b2d7418-bc4c-4180-aaac-49924c2ef76c is being set with open permissions: ugo+rw Jul 30 17:11:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-52c2a9f5-b2ab-4e14-8cc3-13c642a1f379 tempest-ProjectReaderTests-1506540965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5d1bef6c-0826-4b5b-8679-49a5b8ae8812.5b2d7418-bc4c-4180-aaac-49924c2ef76c {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:50 devstack sudo[109048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5d1bef6c-0826-4b5b-8679-49a5b8ae8812.5b2d7418-bc4c-4180-aaac-49924c2ef76c Jul 30 17:11:50 devstack sudo[109048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:50 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-9781dbc8-83a8-49da-a1db-e128ec3dbfbf tempest-ProjectMemberTests-1556323482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:11:50 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9781dbc8-83a8-49da-a1db-e128ec3dbfbf tempest-ProjectMemberTests-1556323482 None] Flow 'volume_create_manager' (5816b7cb-b910-488a-a405-5e59b0b92d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:11:50 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9781dbc8-83a8-49da-a1db-e128ec3dbfbf tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b22e1ed-548e-4d3c-9a22-95a5860662f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:50 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9781dbc8-83a8-49da-a1db-e128ec3dbfbf tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b22e1ed-548e-4d3c-9a22-95a5860662f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:11:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2048885292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bec780b-0991-4611-8c8a-1735393bc9d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72a0b0e3a199416698115290d71c6808',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:11:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:11:51Z,use_quota=True,user_id='8f2d7aa2b6ab4865b626b01a01acc0f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:50 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9781dbc8-83a8-49da-a1db-e128ec3dbfbf tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12d5dcd5-6537-49f2-8a71-cf68883c0d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:50 devstack sudo[109048]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:50 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9781dbc8-83a8-49da-a1db-e128ec3dbfbf tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12d5dcd5-6537-49f2-8a71-cf68883c0d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:50 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9781dbc8-83a8-49da-a1db-e128ec3dbfbf tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82f9292e-fc0a-4135-9d74-54c64c6ad44d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:50 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9781dbc8-83a8-49da-a1db-e128ec3dbfbf tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82f9292e-fc0a-4135-9d74-54c64c6ad44d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bec780b-0991-4611-8c8a-1735393bc9d6', 'volume_name': 'volume-9bec780b-0991-4611-8c8a-1735393bc9d6', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:50 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9781dbc8-83a8-49da-a1db-e128ec3dbfbf tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (757ccc39-ccc8-45d9-a52f-12978c5924d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:50 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9781dbc8-83a8-49da-a1db-e128ec3dbfbf tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (757ccc39-ccc8-45d9-a52f-12978c5924d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:50 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9781dbc8-83a8-49da-a1db-e128ec3dbfbf tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d517d102-4c2e-46df-a009-0b305d2bb026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:50 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-9781dbc8-83a8-49da-a1db-e128ec3dbfbf tempest-ProjectMemberTests-1556323482 None] Volume 9bec780b-0991-4611-8c8a-1735393bc9d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bec780b-0991-4611-8c8a-1735393bc9d6', 'volume_size': 1} Jul 30 17:11:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-9781dbc8-83a8-49da-a1db-e128ec3dbfbf tempest-ProjectMemberTests-1556323482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-52c2a9f5-b2ab-4e14-8cc3-13c642a1f379 tempest-ProjectReaderTests-1506540965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5d1bef6c-0826-4b5b-8679-49a5b8ae8812.5b2d7418-bc4c-4180-aaac-49924c2ef76c" returned: 0 in 0.291s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:50 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-52c2a9f5-b2ab-4e14-8cc3-13c642a1f379 tempest-ProjectReaderTests-1506540965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5d1bef6c-0826-4b5b-8679-49a5b8ae8812.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:50 devstack sudo[109051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5d1bef6c-0826-4b5b-8679-49a5b8ae8812.info Jul 30 17:11:50 devstack sudo[109051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:51 devstack sudo[109051]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-52c2a9f5-b2ab-4e14-8cc3-13c642a1f379 tempest-ProjectReaderTests-1506540965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5d1bef6c-0826-4b5b-8679-49a5b8ae8812.info" returned: 0 in 0.257s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:51 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-52c2a9f5-b2ab-4e14-8cc3-13c642a1f379 tempest-ProjectReaderTests-1506540965 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5d1bef6c-0826-4b5b-8679-49a5b8ae8812.info is being set with open permissions: ugo+rw Jul 30 17:11:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-52c2a9f5-b2ab-4e14-8cc3-13c642a1f379 tempest-ProjectReaderTests-1506540965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5d1bef6c-0826-4b5b-8679-49a5b8ae8812.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:51 devstack sudo[109054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5d1bef6c-0826-4b5b-8679-49a5b8ae8812.info Jul 30 17:11:51 devstack sudo[109054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:51 devstack sudo[109054]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-52c2a9f5-b2ab-4e14-8cc3-13c642a1f379 tempest-ProjectReaderTests-1506540965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5d1bef6c-0826-4b5b-8679-49a5b8ae8812.info" returned: 0 in 0.246s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-52c2a9f5-b2ab-4e14-8cc3-13c642a1f379 tempest-ProjectReaderTests-1506540965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.019s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-9781dbc8-83a8-49da-a1db-e128ec3dbfbf tempest-ProjectMemberTests-1556323482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.546s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:51 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-9781dbc8-83a8-49da-a1db-e128ec3dbfbf tempest-ProjectMemberTests-1556323482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:11:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2048885292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bec780b-0991-4611-8c8a-1735393bc9d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72a0b0e3a199416698115290d71c6808',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:11:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:11:51Z,use_quota=True,user_id='8f2d7aa2b6ab4865b626b01a01acc0f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:11:51 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-9781dbc8-83a8-49da-a1db-e128ec3dbfbf tempest-ProjectMemberTests-1556323482 None] Creating volume 9bec780b-0991-4611-8c8a-1735393bc9d6 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:11:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-9781dbc8-83a8-49da-a1db-e128ec3dbfbf tempest-ProjectMemberTests-1556323482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-9781dbc8-83a8-49da-a1db-e128ec3dbfbf tempest-ProjectMemberTests-1556323482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:51 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-9781dbc8-83a8-49da-a1db-e128ec3dbfbf tempest-ProjectMemberTests-1556323482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:11:51 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-9781dbc8-83a8-49da-a1db-e128ec3dbfbf tempest-ProjectMemberTests-1556323482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:11:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-9781dbc8-83a8-49da-a1db-e128ec3dbfbf tempest-ProjectMemberTests-1556323482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:51 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-9781dbc8-83a8-49da-a1db-e128ec3dbfbf tempest-ProjectMemberTests-1556323482 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:11:51 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-9781dbc8-83a8-49da-a1db-e128ec3dbfbf tempest-ProjectMemberTests-1556323482 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:11:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9781dbc8-83a8-49da-a1db-e128ec3dbfbf tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9bec780b-0991-4611-8c8a-1735393bc9d6 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:51 devstack sudo[109057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9bec780b-0991-4611-8c8a-1735393bc9d6 1073741824 Jul 30 17:11:51 devstack sudo[109057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:51 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-52c2a9f5-b2ab-4e14-8cc3-13c642a1f379 tempest-ProjectReaderTests-1506540965 None] Create snapshot completed successfully Jul 30 17:11:51 devstack sudo[109057]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9781dbc8-83a8-49da-a1db-e128ec3dbfbf tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9bec780b-0991-4611-8c8a-1735393bc9d6 1073741824" returned: 0 in 0.390s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9781dbc8-83a8-49da-a1db-e128ec3dbfbf tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9bec780b-0991-4611-8c8a-1735393bc9d6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:51 devstack sudo[109063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9bec780b-0991-4611-8c8a-1735393bc9d6 Jul 30 17:11:51 devstack sudo[109063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:51 devstack sudo[109063]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9781dbc8-83a8-49da-a1db-e128ec3dbfbf tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9bec780b-0991-4611-8c8a-1735393bc9d6" returned: 0 in 0.243s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:51 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-9781dbc8-83a8-49da-a1db-e128ec3dbfbf tempest-ProjectMemberTests-1556323482 None] <== create_volume: return (670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:11:51 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-9781dbc8-83a8-49da-a1db-e128ec3dbfbf tempest-ProjectMemberTests-1556323482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.673s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:52 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9781dbc8-83a8-49da-a1db-e128ec3dbfbf tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d517d102-4c2e-46df-a009-0b305d2bb026) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bec780b-0991-4611-8c8a-1735393bc9d6', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:52 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9781dbc8-83a8-49da-a1db-e128ec3dbfbf tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af6a3f0b-4cb8-4afc-9a6e-07a102e0bb9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:52 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-9781dbc8-83a8-49da-a1db-e128ec3dbfbf tempest-ProjectMemberTests-1556323482 None] Volume volume-9bec780b-0991-4611-8c8a-1735393bc9d6 (9bec780b-0991-4611-8c8a-1735393bc9d6): created successfully Jul 30 17:11:52 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9781dbc8-83a8-49da-a1db-e128ec3dbfbf tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af6a3f0b-4cb8-4afc-9a6e-07a102e0bb9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:52 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-9781dbc8-83a8-49da-a1db-e128ec3dbfbf tempest-ProjectMemberTests-1556323482 None] Flow 'volume_create_manager' (5816b7cb-b910-488a-a405-5e59b0b92d71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:11:52 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-9781dbc8-83a8-49da-a1db-e128ec3dbfbf tempest-ProjectMemberTests-1556323482 None] Created volume successfully. Jul 30 17:11:52 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-fa6dc607-b4f8-478f-aa8c-c580246cdc5c tempest-ProjectReaderTests-1506540965 None] Acquiring lock "cinder-5b2d7418-bc4c-4180-aaac-49924c2ef76c-delete_snapshot" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:52 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-fa6dc607-b4f8-478f-aa8c-c580246cdc5c tempest-ProjectReaderTests-1506540965 None] Lock "cinder-5b2d7418-bc4c-4180-aaac-49924c2ef76c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:52 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-fa6dc607-b4f8-478f-aa8c-c580246cdc5c tempest-ProjectReaderTests-1506540965 None] Acquiring lock "cinder-quobyte-5d1bef6c-0826-4b5b-8679-49a5b8ae8812" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:52 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-fa6dc607-b4f8-478f-aa8c-c580246cdc5c tempest-ProjectReaderTests-1506540965 None] Lock "cinder-quobyte-5d1bef6c-0826-4b5b-8679-49a5b8ae8812" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:52 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-fa6dc607-b4f8-478f-aa8c-c580246cdc5c tempest-ProjectReaderTests-1506540965 None] Acquiring lock "cinder-quobyte-5b2d7418-bc4c-4180-aaac-49924c2ef76c" by "_delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:52 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-fa6dc607-b4f8-478f-aa8c-c580246cdc5c tempest-ProjectReaderTests-1506540965 None] Lock "cinder-quobyte-5b2d7418-bc4c-4180-aaac-49924c2ef76c" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:52 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-fa6dc607-b4f8-478f-aa8c-c580246cdc5c tempest-ProjectReaderTests-1506540965 None] Deleting offline snapshot 5b2d7418-bc4c-4180-aaac-49924c2ef76c of volume 5d1bef6c-0826-4b5b-8679-49a5b8ae8812 {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:11:52 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-fa6dc607-b4f8-478f-aa8c-c580246cdc5c tempest-ProjectReaderTests-1506540965 None] snapshot_file for this snap is: volume-5d1bef6c-0826-4b5b-8679-49a5b8ae8812.5b2d7418-bc4c-4180-aaac-49924c2ef76c {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:11:52 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[1892b5de-63f3-42bd-be36-f8dbb0e3a304]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:11:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fa6dc607-b4f8-478f-aa8c-c580246cdc5c tempest-ProjectReaderTests-1506540965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5d1bef6c-0826-4b5b-8679-49a5b8ae8812.5b2d7418-bc4c-4180-aaac-49924c2ef76c {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:52 devstack cinder-volume[88568]: DEBUG oslo_service.periodic_task [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 17:11:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:52 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:11:52 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:11:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:52 devstack sudo[109067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:11:52 devstack sudo[109067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:52 devstack sudo[109066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5d1bef6c-0826-4b5b-8679-49a5b8ae8812.5b2d7418-bc4c-4180-aaac-49924c2ef76c Jul 30 17:11:52 devstack sudo[109066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:52 devstack sudo[109067]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.274s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:52 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:11:52 devstack cinder-volume[88568]: DEBUG oslo_service.periodic_task [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Running periodic task VolumeManager._thread_info {{(pid=88568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 17:11:52 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] thread count: 28 {{(pid=88568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 17:11:52 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] thread info: [<_MainThread(MainThread, started 127406866608256)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 17:11:52 devstack sudo[109066]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fa6dc607-b4f8-478f-aa8c-c580246cdc5c tempest-ProjectReaderTests-1506540965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5d1bef6c-0826-4b5b-8679-49a5b8ae8812.5b2d7418-bc4c-4180-aaac-49924c2ef76c" returned: 0 in 0.376s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:52 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-fa6dc607-b4f8-478f-aa8c-c580246cdc5c tempest-ProjectReaderTests-1506540965 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d1bef6c-0826-4b5b-8679-49a5b8ae8812(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:11:52 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef0b9979-fa60-49e7-835a-b765e9449c43]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:11:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fa6dc607-b4f8-478f-aa8c-c580246cdc5c tempest-ProjectReaderTests-1506540965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5d1bef6c-0826-4b5b-8679-49a5b8ae8812 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-871fad81-b3a6-498b-bfc2-89de2aad541d tempest-ProjectMemberTests-1556323482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-871fad81-b3a6-498b-bfc2-89de2aad541d tempest-ProjectMemberTests-1556323482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:52 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-871fad81-b3a6-498b-bfc2-89de2aad541d tempest-ProjectMemberTests-1556323482 None] Creating offline snapshot 7a02207f-5352-404e-8e9a-b4327777c3b2 of volume 9bec780b-0991-4611-8c8a-1735393bc9d6 {{(pid=88568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:11:53 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a932000-fc9c-4678-87e4-32236ef3e591]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:11:53 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-871fad81-b3a6-498b-bfc2-89de2aad541d tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9bec780b-0991-4611-8c8a-1735393bc9d6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:53 devstack sudo[109074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5d1bef6c-0826-4b5b-8679-49a5b8ae8812 Jul 30 17:11:53 devstack sudo[109074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:53 devstack sudo[109075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9bec780b-0991-4611-8c8a-1735393bc9d6 Jul 30 17:11:53 devstack sudo[109075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:53 devstack sudo[109074]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:53 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fa6dc607-b4f8-478f-aa8c-c580246cdc5c tempest-ProjectReaderTests-1506540965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5d1bef6c-0826-4b5b-8679-49a5b8ae8812" returned: 0 in 0.358s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:53 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fa6dc607-b4f8-478f-aa8c-c580246cdc5c tempest-ProjectReaderTests-1506540965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5d1bef6c-0826-4b5b-8679-49a5b8ae8812.5b2d7418-bc4c-4180-aaac-49924c2ef76c {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:53 devstack sudo[109083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5d1bef6c-0826-4b5b-8679-49a5b8ae8812.5b2d7418-bc4c-4180-aaac-49924c2ef76c Jul 30 17:11:53 devstack sudo[109083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:53 devstack sudo[109075]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:53 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-871fad81-b3a6-498b-bfc2-89de2aad541d tempest-ProjectMemberTests-1556323482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9bec780b-0991-4611-8c8a-1735393bc9d6" returned: 0 in 0.374s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:53 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-871fad81-b3a6-498b-bfc2-89de2aad541d tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9bec780b-0991-4611-8c8a-1735393bc9d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9bec780b-0991-4611-8c8a-1735393bc9d6.7a02207f-5352-404e-8e9a-b4327777c3b2 1G {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:53 devstack sudo[109086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9bec780b-0991-4611-8c8a-1735393bc9d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9bec780b-0991-4611-8c8a-1735393bc9d6.7a02207f-5352-404e-8e9a-b4327777c3b2 1G Jul 30 17:11:53 devstack sudo[109086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:53 devstack sudo[109083]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:53 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fa6dc607-b4f8-478f-aa8c-c580246cdc5c tempest-ProjectReaderTests-1506540965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5d1bef6c-0826-4b5b-8679-49a5b8ae8812.5b2d7418-bc4c-4180-aaac-49924c2ef76c" returned: 0 in 0.340s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:53 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fa6dc607-b4f8-478f-aa8c-c580246cdc5c tempest-ProjectReaderTests-1506540965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5d1bef6c-0826-4b5b-8679-49a5b8ae8812.5b2d7418-bc4c-4180-aaac-49924c2ef76c {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:53 devstack sudo[109094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5d1bef6c-0826-4b5b-8679-49a5b8ae8812.5b2d7418-bc4c-4180-aaac-49924c2ef76c Jul 30 17:11:53 devstack sudo[109094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:53 devstack sudo[109086]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:53 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-871fad81-b3a6-498b-bfc2-89de2aad541d tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9bec780b-0991-4611-8c8a-1735393bc9d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9bec780b-0991-4611-8c8a-1735393bc9d6.7a02207f-5352-404e-8e9a-b4327777c3b2 1G" returned: 0 in 0.416s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:53 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-871fad81-b3a6-498b-bfc2-89de2aad541d tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bec780b-0991-4611-8c8a-1735393bc9d6 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9bec780b-0991-4611-8c8a-1735393bc9d6.7a02207f-5352-404e-8e9a-b4327777c3b2 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:53 devstack sudo[109096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bec780b-0991-4611-8c8a-1735393bc9d6 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9bec780b-0991-4611-8c8a-1735393bc9d6.7a02207f-5352-404e-8e9a-b4327777c3b2 Jul 30 17:11:53 devstack sudo[109096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:53 devstack sudo[109094]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:53 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fa6dc607-b4f8-478f-aa8c-c580246cdc5c tempest-ProjectReaderTests-1506540965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5d1bef6c-0826-4b5b-8679-49a5b8ae8812.5b2d7418-bc4c-4180-aaac-49924c2ef76c" returned: 0 in 0.250s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:53 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-fa6dc607-b4f8-478f-aa8c-c580246cdc5c tempest-ProjectReaderTests-1506540965 None] Lock "cinder-quobyte-5b2d7418-bc4c-4180-aaac-49924c2ef76c" released by "_delete_snapshot" :: held 1.431s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:53 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-fa6dc607-b4f8-478f-aa8c-c580246cdc5c tempest-ProjectReaderTests-1506540965 None] Lock "cinder-quobyte-5d1bef6c-0826-4b5b-8679-49a5b8ae8812" released by "delete_snapshot" :: held 1.458s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:54 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-fa6dc607-b4f8-478f-aa8c-c580246cdc5c tempest-ProjectReaderTests-1506540965 None] Created reservations ['1cbeb170-d509-499a-9df8-6592ef1c85ad', '9ec92b2d-a8cf-497d-a232-75a0b5afb61b', '8498f842-4c07-48a1-8e30-50dfc552d5b2', '9e0871f1-c550-4195-83ee-ab94671cd5be'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:11:54 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-fa6dc607-b4f8-478f-aa8c-c580246cdc5c tempest-ProjectReaderTests-1506540965 None] Delete snapshot completed successfully. Jul 30 17:11:54 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-fa6dc607-b4f8-478f-aa8c-c580246cdc5c tempest-ProjectReaderTests-1506540965 None] Lock "cinder-5b2d7418-bc4c-4180-aaac-49924c2ef76c-delete_snapshot" released by "delete_snapshot" :: held 1.587s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:54 devstack sudo[109096]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-871fad81-b3a6-498b-bfc2-89de2aad541d tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bec780b-0991-4611-8c8a-1735393bc9d6 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9bec780b-0991-4611-8c8a-1735393bc9d6.7a02207f-5352-404e-8e9a-b4327777c3b2" returned: 0 in 0.316s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:54 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-871fad81-b3a6-498b-bfc2-89de2aad541d tempest-ProjectMemberTests-1556323482 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9bec780b-0991-4611-8c8a-1735393bc9d6.7a02207f-5352-404e-8e9a-b4327777c3b2 is being set with open permissions: ugo+rw Jul 30 17:11:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-871fad81-b3a6-498b-bfc2-89de2aad541d tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9bec780b-0991-4611-8c8a-1735393bc9d6.7a02207f-5352-404e-8e9a-b4327777c3b2 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:54 devstack sudo[109102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9bec780b-0991-4611-8c8a-1735393bc9d6.7a02207f-5352-404e-8e9a-b4327777c3b2 Jul 30 17:11:54 devstack sudo[109102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:54 devstack sudo[109102]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-871fad81-b3a6-498b-bfc2-89de2aad541d tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9bec780b-0991-4611-8c8a-1735393bc9d6.7a02207f-5352-404e-8e9a-b4327777c3b2" returned: 0 in 0.233s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-871fad81-b3a6-498b-bfc2-89de2aad541d tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9bec780b-0991-4611-8c8a-1735393bc9d6.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:54 devstack sudo[109105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9bec780b-0991-4611-8c8a-1735393bc9d6.info Jul 30 17:11:54 devstack sudo[109105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:54 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-af0885bf-3b9d-42a0-a099-b7d34c87b187 tempest-ProjectReaderTests-1506540965 None] Acquiring lock "cinder-5d1bef6c-0826-4b5b-8679-49a5b8ae8812-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:54 devstack sudo[109105]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:54 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-af0885bf-3b9d-42a0-a099-b7d34c87b187 tempest-ProjectReaderTests-1506540965 None] Lock "cinder-5d1bef6c-0826-4b5b-8679-49a5b8ae8812-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-871fad81-b3a6-498b-bfc2-89de2aad541d tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9bec780b-0991-4611-8c8a-1735393bc9d6.info" returned: 0 in 0.265s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:54 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-871fad81-b3a6-498b-bfc2-89de2aad541d tempest-ProjectMemberTests-1556323482 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9bec780b-0991-4611-8c8a-1735393bc9d6.info is being set with open permissions: ugo+rw Jul 30 17:11:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-871fad81-b3a6-498b-bfc2-89de2aad541d tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9bec780b-0991-4611-8c8a-1735393bc9d6.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:54 devstack sudo[109108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9bec780b-0991-4611-8c8a-1735393bc9d6.info Jul 30 17:11:54 devstack sudo[109108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:54 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-af0885bf-3b9d-42a0-a099-b7d34c87b187 tempest-ProjectReaderTests-1506540965 None] Acquiring lock "cinder-quobyte-5d1bef6c-0826-4b5b-8679-49a5b8ae8812" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:54 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-af0885bf-3b9d-42a0-a099-b7d34c87b187 tempest-ProjectReaderTests-1506540965 None] Lock "cinder-quobyte-5d1bef6c-0826-4b5b-8679-49a5b8ae8812" acquired by "delete_volume" :: waited 0.016s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:54 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a4710c-525a-4780-85a6-955d08c73a13]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:11:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-af0885bf-3b9d-42a0-a099-b7d34c87b187 tempest-ProjectReaderTests-1506540965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5d1bef6c-0826-4b5b-8679-49a5b8ae8812 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:54 devstack sudo[109110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5d1bef6c-0826-4b5b-8679-49a5b8ae8812 Jul 30 17:11:54 devstack sudo[109110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:54 devstack sudo[109108]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-871fad81-b3a6-498b-bfc2-89de2aad541d tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9bec780b-0991-4611-8c8a-1735393bc9d6.info" returned: 0 in 0.258s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-871fad81-b3a6-498b-bfc2-89de2aad541d tempest-ProjectMemberTests-1556323482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.941s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:54 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-871fad81-b3a6-498b-bfc2-89de2aad541d tempest-ProjectMemberTests-1556323482 None] Create snapshot completed successfully Jul 30 17:11:55 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-5ea94d13-8218-4c6c-b0d7-756158d3e4e8 tempest-ProjectMemberTests-1556323482 None] Acquiring lock "cinder-7a02207f-5352-404e-8e9a-b4327777c3b2-delete_snapshot" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:55 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-5ea94d13-8218-4c6c-b0d7-756158d3e4e8 tempest-ProjectMemberTests-1556323482 None] Lock "cinder-7a02207f-5352-404e-8e9a-b4327777c3b2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:55 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-5ea94d13-8218-4c6c-b0d7-756158d3e4e8 tempest-ProjectMemberTests-1556323482 None] Acquiring lock "cinder-quobyte-9bec780b-0991-4611-8c8a-1735393bc9d6" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:55 devstack sudo[109110]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:55 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-5ea94d13-8218-4c6c-b0d7-756158d3e4e8 tempest-ProjectMemberTests-1556323482 None] Lock "cinder-quobyte-9bec780b-0991-4611-8c8a-1735393bc9d6" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:55 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-5ea94d13-8218-4c6c-b0d7-756158d3e4e8 tempest-ProjectMemberTests-1556323482 None] Acquiring lock "cinder-quobyte-7a02207f-5352-404e-8e9a-b4327777c3b2" by "_delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-af0885bf-3b9d-42a0-a099-b7d34c87b187 tempest-ProjectReaderTests-1506540965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5d1bef6c-0826-4b5b-8679-49a5b8ae8812" returned: 0 in 0.400s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-af0885bf-3b9d-42a0-a099-b7d34c87b187 tempest-ProjectReaderTests-1506540965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5d1bef6c-0826-4b5b-8679-49a5b8ae8812 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:55 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-5ea94d13-8218-4c6c-b0d7-756158d3e4e8 tempest-ProjectMemberTests-1556323482 None] Lock "cinder-quobyte-7a02207f-5352-404e-8e9a-b4327777c3b2" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:55 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-5ea94d13-8218-4c6c-b0d7-756158d3e4e8 tempest-ProjectMemberTests-1556323482 None] Deleting offline snapshot 7a02207f-5352-404e-8e9a-b4327777c3b2 of volume 9bec780b-0991-4611-8c8a-1735393bc9d6 {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:11:55 devstack sudo[109117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5d1bef6c-0826-4b5b-8679-49a5b8ae8812 Jul 30 17:11:55 devstack sudo[109117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:55 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-5ea94d13-8218-4c6c-b0d7-756158d3e4e8 tempest-ProjectMemberTests-1556323482 None] snapshot_file for this snap is: volume-9bec780b-0991-4611-8c8a-1735393bc9d6.7a02207f-5352-404e-8e9a-b4327777c3b2 {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:11:55 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[422d793e-5b55-4f22-b960-4f1100830320]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:11:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-5ea94d13-8218-4c6c-b0d7-756158d3e4e8 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9bec780b-0991-4611-8c8a-1735393bc9d6.7a02207f-5352-404e-8e9a-b4327777c3b2 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:55 devstack sudo[109119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9bec780b-0991-4611-8c8a-1735393bc9d6.7a02207f-5352-404e-8e9a-b4327777c3b2 Jul 30 17:11:55 devstack sudo[109119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:55 devstack sudo[109117]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-af0885bf-3b9d-42a0-a099-b7d34c87b187 tempest-ProjectReaderTests-1506540965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-5d1bef6c-0826-4b5b-8679-49a5b8ae8812" returned: 0 in 0.259s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:55 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-af0885bf-3b9d-42a0-a099-b7d34c87b187 tempest-ProjectReaderTests-1506540965 None] Lock "cinder-quobyte-5d1bef6c-0826-4b5b-8679-49a5b8ae8812" released by "delete_volume" :: held 0.719s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:55 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-af0885bf-3b9d-42a0-a099-b7d34c87b187 tempest-ProjectReaderTests-1506540965 None] Created reservations ['d79f7ed8-0a39-4779-a0d2-a3e9619dc15a', '53492660-8039-4433-9f56-2838d505f70b', '0e695ce8-7f41-46d8-b4c1-2c8231afa633', 'cd8260f1-73e4-4c3e-b098-89499992591e'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:11:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-af0885bf-3b9d-42a0-a099-b7d34c87b187 tempest-ProjectReaderTests-1506540965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-af0885bf-3b9d-42a0-a099-b7d34c87b187 tempest-ProjectReaderTests-1506540965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:55 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-af0885bf-3b9d-42a0-a099-b7d34c87b187 tempest-ProjectReaderTests-1506540965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:11:55 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-af0885bf-3b9d-42a0-a099-b7d34c87b187 tempest-ProjectReaderTests-1506540965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:11:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-af0885bf-3b9d-42a0-a099-b7d34c87b187 tempest-ProjectReaderTests-1506540965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-af0885bf-3b9d-42a0-a099-b7d34c87b187 tempest-ProjectReaderTests-1506540965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:55 devstack sudo[109125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:11:55 devstack sudo[109125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:55 devstack sudo[109119]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-5ea94d13-8218-4c6c-b0d7-756158d3e4e8 tempest-ProjectMemberTests-1556323482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9bec780b-0991-4611-8c8a-1735393bc9d6.7a02207f-5352-404e-8e9a-b4327777c3b2" returned: 0 in 0.377s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:55 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-5ea94d13-8218-4c6c-b0d7-756158d3e4e8 tempest-ProjectMemberTests-1556323482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9bec780b-0991-4611-8c8a-1735393bc9d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:11:55 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[03161c7c-69c3-4ac7-806c-fad3a6737805]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:11:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-5ea94d13-8218-4c6c-b0d7-756158d3e4e8 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9bec780b-0991-4611-8c8a-1735393bc9d6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:55 devstack sudo[109127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9bec780b-0991-4611-8c8a-1735393bc9d6 Jul 30 17:11:55 devstack sudo[109127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:55 devstack sudo[109125]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-af0885bf-3b9d-42a0-a099-b7d34c87b187 tempest-ProjectReaderTests-1506540965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.264s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:55 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-af0885bf-3b9d-42a0-a099-b7d34c87b187 tempest-ProjectReaderTests-1506540965 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:11:55 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-af0885bf-3b9d-42a0-a099-b7d34c87b187 tempest-ProjectReaderTests-1506540965 None] Deleted volume successfully. Jul 30 17:11:55 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-af0885bf-3b9d-42a0-a099-b7d34c87b187 tempest-ProjectReaderTests-1506540965 None] Lock "cinder-5d1bef6c-0826-4b5b-8679-49a5b8ae8812-delete_volume" released by "delete_volume" :: held 1.220s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:55 devstack sudo[109127]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-5ea94d13-8218-4c6c-b0d7-756158d3e4e8 tempest-ProjectMemberTests-1556323482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9bec780b-0991-4611-8c8a-1735393bc9d6" returned: 0 in 0.386s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-5ea94d13-8218-4c6c-b0d7-756158d3e4e8 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9bec780b-0991-4611-8c8a-1735393bc9d6.7a02207f-5352-404e-8e9a-b4327777c3b2 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:56 devstack sudo[109133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9bec780b-0991-4611-8c8a-1735393bc9d6.7a02207f-5352-404e-8e9a-b4327777c3b2 Jul 30 17:11:56 devstack sudo[109133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:56 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7f7d040-cd23-46e3-923a-1f357779ee32 tempest-ProjectReaderTests-1506540965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:11:56 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b7f7d040-cd23-46e3-923a-1f357779ee32 tempest-ProjectReaderTests-1506540965 None] Flow 'volume_create_manager' (982cecbb-1641-4c24-9898-ff8ac8ee3773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:11:56 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b7f7d040-cd23-46e3-923a-1f357779ee32 tempest-ProjectReaderTests-1506540965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b70ed98d-2826-4423-b438-8640bec0916a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:56 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b7f7d040-cd23-46e3-923a-1f357779ee32 tempest-ProjectReaderTests-1506540965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b70ed98d-2826-4423-b438-8640bec0916a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:11:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1785027071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fd4cade-49fb-4d81-89fa-f23f6837de16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d6f792b22ba46ca94d09af3b2157e87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:11:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:11:56Z,use_quota=True,user_id='32ed3c4f75834041b2773f0e7b64d007',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:56 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b7f7d040-cd23-46e3-923a-1f357779ee32 tempest-ProjectReaderTests-1506540965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bf96ca4-a61c-4eb6-8cd9-1594cd7ed2d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:56 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b7f7d040-cd23-46e3-923a-1f357779ee32 tempest-ProjectReaderTests-1506540965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bf96ca4-a61c-4eb6-8cd9-1594cd7ed2d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:56 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b7f7d040-cd23-46e3-923a-1f357779ee32 tempest-ProjectReaderTests-1506540965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b64f3e7-5e3b-4dce-b9e2-ab58afc903ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:56 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b7f7d040-cd23-46e3-923a-1f357779ee32 tempest-ProjectReaderTests-1506540965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b64f3e7-5e3b-4dce-b9e2-ab58afc903ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fd4cade-49fb-4d81-89fa-f23f6837de16', 'volume_name': 'volume-2fd4cade-49fb-4d81-89fa-f23f6837de16', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:56 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b7f7d040-cd23-46e3-923a-1f357779ee32 tempest-ProjectReaderTests-1506540965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e183d069-1ddb-4f0f-bf1f-98254c4e29fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:56 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b7f7d040-cd23-46e3-923a-1f357779ee32 tempest-ProjectReaderTests-1506540965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e183d069-1ddb-4f0f-bf1f-98254c4e29fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:56 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b7f7d040-cd23-46e3-923a-1f357779ee32 tempest-ProjectReaderTests-1506540965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43b5f479-62c0-43fc-b705-57a41fde1185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:56 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-b7f7d040-cd23-46e3-923a-1f357779ee32 tempest-ProjectReaderTests-1506540965 None] Volume 2fd4cade-49fb-4d81-89fa-f23f6837de16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fd4cade-49fb-4d81-89fa-f23f6837de16', 'volume_size': 1} Jul 30 17:11:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-b7f7d040-cd23-46e3-923a-1f357779ee32 tempest-ProjectReaderTests-1506540965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-b7f7d040-cd23-46e3-923a-1f357779ee32 tempest-ProjectReaderTests-1506540965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:56 devstack sudo[109133]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:56 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-b7f7d040-cd23-46e3-923a-1f357779ee32 tempest-ProjectReaderTests-1506540965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:11:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1785027071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fd4cade-49fb-4d81-89fa-f23f6837de16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d6f792b22ba46ca94d09af3b2157e87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:11:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:11:56Z,use_quota=True,user_id='32ed3c4f75834041b2773f0e7b64d007',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:11:56 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-b7f7d040-cd23-46e3-923a-1f357779ee32 tempest-ProjectReaderTests-1506540965 None] Creating volume 2fd4cade-49fb-4d81-89fa-f23f6837de16 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:11:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-b7f7d040-cd23-46e3-923a-1f357779ee32 tempest-ProjectReaderTests-1506540965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-b7f7d040-cd23-46e3-923a-1f357779ee32 tempest-ProjectReaderTests-1506540965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:56 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-b7f7d040-cd23-46e3-923a-1f357779ee32 tempest-ProjectReaderTests-1506540965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:11:56 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-b7f7d040-cd23-46e3-923a-1f357779ee32 tempest-ProjectReaderTests-1506540965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:11:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-b7f7d040-cd23-46e3-923a-1f357779ee32 tempest-ProjectReaderTests-1506540965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:56 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-b7f7d040-cd23-46e3-923a-1f357779ee32 tempest-ProjectReaderTests-1506540965 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:11:56 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-b7f7d040-cd23-46e3-923a-1f357779ee32 tempest-ProjectReaderTests-1506540965 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:11:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-b7f7d040-cd23-46e3-923a-1f357779ee32 tempest-ProjectReaderTests-1506540965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2fd4cade-49fb-4d81-89fa-f23f6837de16 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-5ea94d13-8218-4c6c-b0d7-756158d3e4e8 tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9bec780b-0991-4611-8c8a-1735393bc9d6.7a02207f-5352-404e-8e9a-b4327777c3b2" returned: 0 in 0.360s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-5ea94d13-8218-4c6c-b0d7-756158d3e4e8 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9bec780b-0991-4611-8c8a-1735393bc9d6.7a02207f-5352-404e-8e9a-b4327777c3b2 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:56 devstack sudo[109138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2fd4cade-49fb-4d81-89fa-f23f6837de16 1073741824 Jul 30 17:11:56 devstack sudo[109138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:56 devstack sudo[109139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9bec780b-0991-4611-8c8a-1735393bc9d6.7a02207f-5352-404e-8e9a-b4327777c3b2 Jul 30 17:11:56 devstack sudo[109139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:56 devstack sudo[109139]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-5ea94d13-8218-4c6c-b0d7-756158d3e4e8 tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9bec780b-0991-4611-8c8a-1735393bc9d6.7a02207f-5352-404e-8e9a-b4327777c3b2" returned: 0 in 0.254s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:56 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-5ea94d13-8218-4c6c-b0d7-756158d3e4e8 tempest-ProjectMemberTests-1556323482 None] Lock "cinder-quobyte-7a02207f-5352-404e-8e9a-b4327777c3b2" released by "_delete_snapshot" :: held 1.476s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:56 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-5ea94d13-8218-4c6c-b0d7-756158d3e4e8 tempest-ProjectMemberTests-1556323482 None] Lock "cinder-quobyte-9bec780b-0991-4611-8c8a-1735393bc9d6" released by "delete_snapshot" :: held 1.509s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:56 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-5ea94d13-8218-4c6c-b0d7-756158d3e4e8 tempest-ProjectMemberTests-1556323482 None] Created reservations ['01149876-505a-4d1b-bd46-4497421d00d9', 'b42d6299-7a32-4110-9396-0f837748f3ba', '1b1771aa-584a-463a-8af3-3c61f8f8d5b0', '7ed65da6-5697-4b40-befb-5eba1b2f6046'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:11:56 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-5ea94d13-8218-4c6c-b0d7-756158d3e4e8 tempest-ProjectMemberTests-1556323482 None] Delete snapshot completed successfully. Jul 30 17:11:56 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-5ea94d13-8218-4c6c-b0d7-756158d3e4e8 tempest-ProjectMemberTests-1556323482 None] Lock "cinder-7a02207f-5352-404e-8e9a-b4327777c3b2-delete_snapshot" released by "delete_snapshot" :: held 1.656s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:56 devstack sudo[109138]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-b7f7d040-cd23-46e3-923a-1f357779ee32 tempest-ProjectReaderTests-1506540965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2fd4cade-49fb-4d81-89fa-f23f6837de16 1073741824" returned: 0 in 0.454s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-b7f7d040-cd23-46e3-923a-1f357779ee32 tempest-ProjectReaderTests-1506540965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2fd4cade-49fb-4d81-89fa-f23f6837de16 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:56 devstack sudo[109147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2fd4cade-49fb-4d81-89fa-f23f6837de16 Jul 30 17:11:56 devstack sudo[109147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:57 devstack sudo[109147]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-b7f7d040-cd23-46e3-923a-1f357779ee32 tempest-ProjectReaderTests-1506540965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2fd4cade-49fb-4d81-89fa-f23f6837de16" returned: 0 in 0.248s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:57 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-b7f7d040-cd23-46e3-923a-1f357779ee32 tempest-ProjectReaderTests-1506540965 None] <== create_volume: return (740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:11:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-b7f7d040-cd23-46e3-923a-1f357779ee32 tempest-ProjectReaderTests-1506540965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:57 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b7f7d040-cd23-46e3-923a-1f357779ee32 tempest-ProjectReaderTests-1506540965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43b5f479-62c0-43fc-b705-57a41fde1185) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fd4cade-49fb-4d81-89fa-f23f6837de16', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:57 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b7f7d040-cd23-46e3-923a-1f357779ee32 tempest-ProjectReaderTests-1506540965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d89235e-5be3-445f-8cc9-9dbc4e6f11e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:57 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-b7f7d040-cd23-46e3-923a-1f357779ee32 tempest-ProjectReaderTests-1506540965 None] Volume volume-2fd4cade-49fb-4d81-89fa-f23f6837de16 (2fd4cade-49fb-4d81-89fa-f23f6837de16): created successfully Jul 30 17:11:57 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b7f7d040-cd23-46e3-923a-1f357779ee32 tempest-ProjectReaderTests-1506540965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d89235e-5be3-445f-8cc9-9dbc4e6f11e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:57 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-b7f7d040-cd23-46e3-923a-1f357779ee32 tempest-ProjectReaderTests-1506540965 None] Flow 'volume_create_manager' (982cecbb-1641-4c24-9898-ff8ac8ee3773) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:11:57 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-b7f7d040-cd23-46e3-923a-1f357779ee32 tempest-ProjectReaderTests-1506540965 None] Created volume successfully. Jul 30 17:11:57 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-97986405-241f-4816-a091-d27195a5c14e tempest-ProjectMemberTests-1556323482 None] Acquiring lock "cinder-9bec780b-0991-4611-8c8a-1735393bc9d6-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:57 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-97986405-241f-4816-a091-d27195a5c14e tempest-ProjectMemberTests-1556323482 None] Lock "cinder-9bec780b-0991-4611-8c8a-1735393bc9d6-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:57 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-97986405-241f-4816-a091-d27195a5c14e tempest-ProjectMemberTests-1556323482 None] Acquiring lock "cinder-quobyte-9bec780b-0991-4611-8c8a-1735393bc9d6" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:57 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-97986405-241f-4816-a091-d27195a5c14e tempest-ProjectMemberTests-1556323482 None] Lock "cinder-quobyte-9bec780b-0991-4611-8c8a-1735393bc9d6" acquired by "delete_volume" :: waited 0.026s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:57 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed171ccc-1712-4104-890b-0b35acb785f8]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:11:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-97986405-241f-4816-a091-d27195a5c14e tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9bec780b-0991-4611-8c8a-1735393bc9d6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-9b7876c4-0615-468f-bedd-a29cd56c2aec tempest-ProjectReaderTests-1506540965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-9b7876c4-0615-468f-bedd-a29cd56c2aec tempest-ProjectReaderTests-1506540965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:57 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-9b7876c4-0615-468f-bedd-a29cd56c2aec tempest-ProjectReaderTests-1506540965 None] Creating offline snapshot 70df5b73-cdeb-4781-b3cf-22a30ff6a5b3 of volume 2fd4cade-49fb-4d81-89fa-f23f6837de16 {{(pid=88568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:11:57 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[0061dc40-b31f-4deb-899c-3734edb3aed2]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:11:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9b7876c4-0615-468f-bedd-a29cd56c2aec tempest-ProjectReaderTests-1506540965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2fd4cade-49fb-4d81-89fa-f23f6837de16 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:57 devstack sudo[109150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9bec780b-0991-4611-8c8a-1735393bc9d6 Jul 30 17:11:57 devstack sudo[109150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:57 devstack sudo[109151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2fd4cade-49fb-4d81-89fa-f23f6837de16 Jul 30 17:11:57 devstack sudo[109151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:57 devstack sudo[109150]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-97986405-241f-4816-a091-d27195a5c14e tempest-ProjectMemberTests-1556323482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9bec780b-0991-4611-8c8a-1735393bc9d6" returned: 0 in 0.365s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-97986405-241f-4816-a091-d27195a5c14e tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9bec780b-0991-4611-8c8a-1735393bc9d6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:57 devstack sudo[109159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9bec780b-0991-4611-8c8a-1735393bc9d6 Jul 30 17:11:57 devstack sudo[109159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:57 devstack sudo[109151]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9b7876c4-0615-468f-bedd-a29cd56c2aec tempest-ProjectReaderTests-1506540965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2fd4cade-49fb-4d81-89fa-f23f6837de16" returned: 0 in 0.368s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9b7876c4-0615-468f-bedd-a29cd56c2aec tempest-ProjectReaderTests-1506540965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2fd4cade-49fb-4d81-89fa-f23f6837de16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2fd4cade-49fb-4d81-89fa-f23f6837de16.70df5b73-cdeb-4781-b3cf-22a30ff6a5b3 1G {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:57 devstack sudo[109162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2fd4cade-49fb-4d81-89fa-f23f6837de16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2fd4cade-49fb-4d81-89fa-f23f6837de16.70df5b73-cdeb-4781-b3cf-22a30ff6a5b3 1G Jul 30 17:11:57 devstack sudo[109162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:58 devstack sudo[109159]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-97986405-241f-4816-a091-d27195a5c14e tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-9bec780b-0991-4611-8c8a-1735393bc9d6" returned: 0 in 0.261s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:58 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-97986405-241f-4816-a091-d27195a5c14e tempest-ProjectMemberTests-1556323482 None] Lock "cinder-quobyte-9bec780b-0991-4611-8c8a-1735393bc9d6" released by "delete_volume" :: held 0.707s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:58 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-97986405-241f-4816-a091-d27195a5c14e tempest-ProjectMemberTests-1556323482 None] Created reservations ['260572e0-61b4-4e55-8d0b-904e1e1da663', '81a32ba5-8b48-4de5-96a9-f4ee88ac76d1', '675783e8-0b62-4ae4-9ada-70dbb0df37ff', 'bc6e7c5e-5468-49a7-a3b5-2fa00422cd7a'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:11:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-97986405-241f-4816-a091-d27195a5c14e tempest-ProjectMemberTests-1556323482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-97986405-241f-4816-a091-d27195a5c14e tempest-ProjectMemberTests-1556323482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:58 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-97986405-241f-4816-a091-d27195a5c14e tempest-ProjectMemberTests-1556323482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:11:58 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-97986405-241f-4816-a091-d27195a5c14e tempest-ProjectMemberTests-1556323482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:11:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-97986405-241f-4816-a091-d27195a5c14e tempest-ProjectMemberTests-1556323482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-97986405-241f-4816-a091-d27195a5c14e tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:58 devstack sudo[109168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:11:58 devstack sudo[109168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:58 devstack sudo[109162]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9b7876c4-0615-468f-bedd-a29cd56c2aec tempest-ProjectReaderTests-1506540965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2fd4cade-49fb-4d81-89fa-f23f6837de16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2fd4cade-49fb-4d81-89fa-f23f6837de16.70df5b73-cdeb-4781-b3cf-22a30ff6a5b3 1G" returned: 0 in 0.424s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9b7876c4-0615-468f-bedd-a29cd56c2aec tempest-ProjectReaderTests-1506540965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fd4cade-49fb-4d81-89fa-f23f6837de16 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2fd4cade-49fb-4d81-89fa-f23f6837de16.70df5b73-cdeb-4781-b3cf-22a30ff6a5b3 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:58 devstack sudo[109171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fd4cade-49fb-4d81-89fa-f23f6837de16 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2fd4cade-49fb-4d81-89fa-f23f6837de16.70df5b73-cdeb-4781-b3cf-22a30ff6a5b3 Jul 30 17:11:58 devstack sudo[109171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:58 devstack sudo[109168]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-97986405-241f-4816-a091-d27195a5c14e tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.266s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:58 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-97986405-241f-4816-a091-d27195a5c14e tempest-ProjectMemberTests-1556323482 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:11:58 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-97986405-241f-4816-a091-d27195a5c14e tempest-ProjectMemberTests-1556323482 None] Deleted volume successfully. Jul 30 17:11:58 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-97986405-241f-4816-a091-d27195a5c14e tempest-ProjectMemberTests-1556323482 None] Lock "cinder-9bec780b-0991-4611-8c8a-1735393bc9d6-delete_volume" released by "delete_volume" :: held 1.189s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:58 devstack sudo[109171]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9b7876c4-0615-468f-bedd-a29cd56c2aec tempest-ProjectReaderTests-1506540965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fd4cade-49fb-4d81-89fa-f23f6837de16 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2fd4cade-49fb-4d81-89fa-f23f6837de16.70df5b73-cdeb-4781-b3cf-22a30ff6a5b3" returned: 0 in 0.319s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:58 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-9b7876c4-0615-468f-bedd-a29cd56c2aec tempest-ProjectReaderTests-1506540965 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2fd4cade-49fb-4d81-89fa-f23f6837de16.70df5b73-cdeb-4781-b3cf-22a30ff6a5b3 is being set with open permissions: ugo+rw Jul 30 17:11:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9b7876c4-0615-468f-bedd-a29cd56c2aec tempest-ProjectReaderTests-1506540965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2fd4cade-49fb-4d81-89fa-f23f6837de16.70df5b73-cdeb-4781-b3cf-22a30ff6a5b3 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:58 devstack sudo[109177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2fd4cade-49fb-4d81-89fa-f23f6837de16.70df5b73-cdeb-4781-b3cf-22a30ff6a5b3 Jul 30 17:11:58 devstack sudo[109177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:58 devstack sudo[109177]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9b7876c4-0615-468f-bedd-a29cd56c2aec tempest-ProjectReaderTests-1506540965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2fd4cade-49fb-4d81-89fa-f23f6837de16.70df5b73-cdeb-4781-b3cf-22a30ff6a5b3" returned: 0 in 0.275s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9b7876c4-0615-468f-bedd-a29cd56c2aec tempest-ProjectReaderTests-1506540965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2fd4cade-49fb-4d81-89fa-f23f6837de16.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:58 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b156c3c-f47e-4b80-9fad-a25cb8f200e5 tempest-ProjectMemberTests-1556323482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:11:58 devstack sudo[109180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2fd4cade-49fb-4d81-89fa-f23f6837de16.info Jul 30 17:11:58 devstack sudo[109180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:58 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1b156c3c-f47e-4b80-9fad-a25cb8f200e5 tempest-ProjectMemberTests-1556323482 None] Flow 'volume_create_manager' (509f6391-de16-4e36-b80c-9f775ebfb25c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:11:58 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1b156c3c-f47e-4b80-9fad-a25cb8f200e5 tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a1e25ed-0cdf-45d0-a876-01cb54331bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:58 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1b156c3c-f47e-4b80-9fad-a25cb8f200e5 tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a1e25ed-0cdf-45d0-a876-01cb54331bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:11:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1147799189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5c3b5c6-4970-4f9b-a59b-8bd34c8da279,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72a0b0e3a199416698115290d71c6808',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:11:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:11:59Z,use_quota=True,user_id='8f2d7aa2b6ab4865b626b01a01acc0f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:58 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1b156c3c-f47e-4b80-9fad-a25cb8f200e5 tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f43d8221-7219-4a32-935d-9edf56438520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:58 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1b156c3c-f47e-4b80-9fad-a25cb8f200e5 tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f43d8221-7219-4a32-935d-9edf56438520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:58 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1b156c3c-f47e-4b80-9fad-a25cb8f200e5 tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ca6279a-3df0-45ff-8505-6e4aab39a31c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:58 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1b156c3c-f47e-4b80-9fad-a25cb8f200e5 tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ca6279a-3df0-45ff-8505-6e4aab39a31c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5c3b5c6-4970-4f9b-a59b-8bd34c8da279', 'volume_name': 'volume-b5c3b5c6-4970-4f9b-a59b-8bd34c8da279', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:59 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1b156c3c-f47e-4b80-9fad-a25cb8f200e5 tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d47d2fed-48c9-44b2-a5fa-133b2059de41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:59 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1b156c3c-f47e-4b80-9fad-a25cb8f200e5 tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d47d2fed-48c9-44b2-a5fa-133b2059de41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:59 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1b156c3c-f47e-4b80-9fad-a25cb8f200e5 tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21360776-df72-4aca-8970-8421c32697cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:59 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-1b156c3c-f47e-4b80-9fad-a25cb8f200e5 tempest-ProjectMemberTests-1556323482 None] Volume b5c3b5c6-4970-4f9b-a59b-8bd34c8da279: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5c3b5c6-4970-4f9b-a59b-8bd34c8da279', 'volume_size': 1} Jul 30 17:11:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-1b156c3c-f47e-4b80-9fad-a25cb8f200e5 tempest-ProjectMemberTests-1556323482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:59 devstack sudo[109180]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9b7876c4-0615-468f-bedd-a29cd56c2aec tempest-ProjectReaderTests-1506540965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2fd4cade-49fb-4d81-89fa-f23f6837de16.info" returned: 0 in 0.248s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:59 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-9b7876c4-0615-468f-bedd-a29cd56c2aec tempest-ProjectReaderTests-1506540965 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2fd4cade-49fb-4d81-89fa-f23f6837de16.info is being set with open permissions: ugo+rw Jul 30 17:11:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9b7876c4-0615-468f-bedd-a29cd56c2aec tempest-ProjectReaderTests-1506540965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2fd4cade-49fb-4d81-89fa-f23f6837de16.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:59 devstack sudo[109183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2fd4cade-49fb-4d81-89fa-f23f6837de16.info Jul 30 17:11:59 devstack sudo[109183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:59 devstack sudo[109183]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-9b7876c4-0615-468f-bedd-a29cd56c2aec tempest-ProjectReaderTests-1506540965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2fd4cade-49fb-4d81-89fa-f23f6837de16.info" returned: 0 in 0.240s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-9b7876c4-0615-468f-bedd-a29cd56c2aec tempest-ProjectReaderTests-1506540965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.959s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-1b156c3c-f47e-4b80-9fad-a25cb8f200e5 tempest-ProjectMemberTests-1556323482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.388s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:59 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-1b156c3c-f47e-4b80-9fad-a25cb8f200e5 tempest-ProjectMemberTests-1556323482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:11:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1147799189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5c3b5c6-4970-4f9b-a59b-8bd34c8da279,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72a0b0e3a199416698115290d71c6808',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:11:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:11:59Z,use_quota=True,user_id='8f2d7aa2b6ab4865b626b01a01acc0f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:11:59 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-1b156c3c-f47e-4b80-9fad-a25cb8f200e5 tempest-ProjectMemberTests-1556323482 None] Creating volume b5c3b5c6-4970-4f9b-a59b-8bd34c8da279 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:11:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-1b156c3c-f47e-4b80-9fad-a25cb8f200e5 tempest-ProjectMemberTests-1556323482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-1b156c3c-f47e-4b80-9fad-a25cb8f200e5 tempest-ProjectMemberTests-1556323482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:59 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-1b156c3c-f47e-4b80-9fad-a25cb8f200e5 tempest-ProjectMemberTests-1556323482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:11:59 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-1b156c3c-f47e-4b80-9fad-a25cb8f200e5 tempest-ProjectMemberTests-1556323482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:11:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-1b156c3c-f47e-4b80-9fad-a25cb8f200e5 tempest-ProjectMemberTests-1556323482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:59 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-1b156c3c-f47e-4b80-9fad-a25cb8f200e5 tempest-ProjectMemberTests-1556323482 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:11:59 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-1b156c3c-f47e-4b80-9fad-a25cb8f200e5 tempest-ProjectMemberTests-1556323482 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:11:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-1b156c3c-f47e-4b80-9fad-a25cb8f200e5 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b5c3b5c6-4970-4f9b-a59b-8bd34c8da279 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:59 devstack sudo[109186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b5c3b5c6-4970-4f9b-a59b-8bd34c8da279 1073741824 Jul 30 17:11:59 devstack sudo[109186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:59 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-9b7876c4-0615-468f-bedd-a29cd56c2aec tempest-ProjectReaderTests-1506540965 None] Create snapshot completed successfully Jul 30 17:11:59 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-61a32e22-ac60-43da-a34f-a302734362f6 tempest-ProjectReaderTests-1506540965 None] Acquiring lock "cinder-70df5b73-cdeb-4781-b3cf-22a30ff6a5b3-delete_snapshot" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:59 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-61a32e22-ac60-43da-a34f-a302734362f6 tempest-ProjectReaderTests-1506540965 None] Lock "cinder-70df5b73-cdeb-4781-b3cf-22a30ff6a5b3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:59 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-61a32e22-ac60-43da-a34f-a302734362f6 tempest-ProjectReaderTests-1506540965 None] Acquiring lock "cinder-quobyte-2fd4cade-49fb-4d81-89fa-f23f6837de16" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:59 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-61a32e22-ac60-43da-a34f-a302734362f6 tempest-ProjectReaderTests-1506540965 None] Lock "cinder-quobyte-2fd4cade-49fb-4d81-89fa-f23f6837de16" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:59 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-61a32e22-ac60-43da-a34f-a302734362f6 tempest-ProjectReaderTests-1506540965 None] Acquiring lock "cinder-quobyte-70df5b73-cdeb-4781-b3cf-22a30ff6a5b3" by "_delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:59 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-61a32e22-ac60-43da-a34f-a302734362f6 tempest-ProjectReaderTests-1506540965 None] Lock "cinder-quobyte-70df5b73-cdeb-4781-b3cf-22a30ff6a5b3" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:59 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-61a32e22-ac60-43da-a34f-a302734362f6 tempest-ProjectReaderTests-1506540965 None] Deleting offline snapshot 70df5b73-cdeb-4781-b3cf-22a30ff6a5b3 of volume 2fd4cade-49fb-4d81-89fa-f23f6837de16 {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:11:59 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-61a32e22-ac60-43da-a34f-a302734362f6 tempest-ProjectReaderTests-1506540965 None] snapshot_file for this snap is: volume-2fd4cade-49fb-4d81-89fa-f23f6837de16.70df5b73-cdeb-4781-b3cf-22a30ff6a5b3 {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:11:59 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c17c8a-6873-4f62-9222-278495b146fa]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:11:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-61a32e22-ac60-43da-a34f-a302734362f6 tempest-ProjectReaderTests-1506540965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2fd4cade-49fb-4d81-89fa-f23f6837de16.70df5b73-cdeb-4781-b3cf-22a30ff6a5b3 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:59 devstack sudo[109191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2fd4cade-49fb-4d81-89fa-f23f6837de16.70df5b73-cdeb-4781-b3cf-22a30ff6a5b3 Jul 30 17:11:59 devstack sudo[109191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:59 devstack sudo[109186]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-1b156c3c-f47e-4b80-9fad-a25cb8f200e5 tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b5c3b5c6-4970-4f9b-a59b-8bd34c8da279 1073741824" returned: 0 in 0.458s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-1b156c3c-f47e-4b80-9fad-a25cb8f200e5 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b5c3b5c6-4970-4f9b-a59b-8bd34c8da279 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:59 devstack sudo[109193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b5c3b5c6-4970-4f9b-a59b-8bd34c8da279 Jul 30 17:11:59 devstack sudo[109193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:00 devstack sudo[109191]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:00 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-61a32e22-ac60-43da-a34f-a302734362f6 tempest-ProjectReaderTests-1506540965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2fd4cade-49fb-4d81-89fa-f23f6837de16.70df5b73-cdeb-4781-b3cf-22a30ff6a5b3" returned: 0 in 0.374s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:00 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-61a32e22-ac60-43da-a34f-a302734362f6 tempest-ProjectReaderTests-1506540965 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2fd4cade-49fb-4d81-89fa-f23f6837de16(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:12:00 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[57addcdf-9e51-48c8-853c-b5b44b13d7d3]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:12:00 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-61a32e22-ac60-43da-a34f-a302734362f6 tempest-ProjectReaderTests-1506540965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2fd4cade-49fb-4d81-89fa-f23f6837de16 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:00 devstack sudo[109193]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:00 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-1b156c3c-f47e-4b80-9fad-a25cb8f200e5 tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b5c3b5c6-4970-4f9b-a59b-8bd34c8da279" returned: 0 in 0.272s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:00 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-1b156c3c-f47e-4b80-9fad-a25cb8f200e5 tempest-ProjectMemberTests-1556323482 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:12:00 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-1b156c3c-f47e-4b80-9fad-a25cb8f200e5 tempest-ProjectMemberTests-1556323482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:12:00 devstack sudo[109198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2fd4cade-49fb-4d81-89fa-f23f6837de16 Jul 30 17:12:00 devstack sudo[109198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:00 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1b156c3c-f47e-4b80-9fad-a25cb8f200e5 tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21360776-df72-4aca-8970-8421c32697cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5c3b5c6-4970-4f9b-a59b-8bd34c8da279', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:12:00 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1b156c3c-f47e-4b80-9fad-a25cb8f200e5 tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (514e188f-dc4d-43e9-a4c3-5ea5831891ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:12:00 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-1b156c3c-f47e-4b80-9fad-a25cb8f200e5 tempest-ProjectMemberTests-1556323482 None] Volume volume-b5c3b5c6-4970-4f9b-a59b-8bd34c8da279 (b5c3b5c6-4970-4f9b-a59b-8bd34c8da279): created successfully Jul 30 17:12:00 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1b156c3c-f47e-4b80-9fad-a25cb8f200e5 tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (514e188f-dc4d-43e9-a4c3-5ea5831891ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:12:00 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-1b156c3c-f47e-4b80-9fad-a25cb8f200e5 tempest-ProjectMemberTests-1556323482 None] Flow 'volume_create_manager' (509f6391-de16-4e36-b80c-9f775ebfb25c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:12:00 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-1b156c3c-f47e-4b80-9fad-a25cb8f200e5 tempest-ProjectMemberTests-1556323482 None] Created volume successfully. Jul 30 17:12:00 devstack sudo[109198]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:00 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-61a32e22-ac60-43da-a34f-a302734362f6 tempest-ProjectReaderTests-1506540965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2fd4cade-49fb-4d81-89fa-f23f6837de16" returned: 0 in 0.365s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:00 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-61a32e22-ac60-43da-a34f-a302734362f6 tempest-ProjectReaderTests-1506540965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2fd4cade-49fb-4d81-89fa-f23f6837de16.70df5b73-cdeb-4781-b3cf-22a30ff6a5b3 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:00 devstack sudo[109204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2fd4cade-49fb-4d81-89fa-f23f6837de16.70df5b73-cdeb-4781-b3cf-22a30ff6a5b3 Jul 30 17:12:00 devstack sudo[109204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:00 devstack sudo[109204]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:00 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-61a32e22-ac60-43da-a34f-a302734362f6 tempest-ProjectReaderTests-1506540965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2fd4cade-49fb-4d81-89fa-f23f6837de16.70df5b73-cdeb-4781-b3cf-22a30ff6a5b3" returned: 0 in 0.307s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:00 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-61a32e22-ac60-43da-a34f-a302734362f6 tempest-ProjectReaderTests-1506540965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2fd4cade-49fb-4d81-89fa-f23f6837de16.70df5b73-cdeb-4781-b3cf-22a30ff6a5b3 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:00 devstack sudo[109209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2fd4cade-49fb-4d81-89fa-f23f6837de16.70df5b73-cdeb-4781-b3cf-22a30ff6a5b3 Jul 30 17:12:00 devstack sudo[109209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:00 devstack sudo[109209]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:00 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-61a32e22-ac60-43da-a34f-a302734362f6 tempest-ProjectReaderTests-1506540965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2fd4cade-49fb-4d81-89fa-f23f6837de16.70df5b73-cdeb-4781-b3cf-22a30ff6a5b3" returned: 0 in 0.246s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:01 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-61a32e22-ac60-43da-a34f-a302734362f6 tempest-ProjectReaderTests-1506540965 None] Lock "cinder-quobyte-70df5b73-cdeb-4781-b3cf-22a30ff6a5b3" released by "_delete_snapshot" :: held 1.380s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:12:01 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-61a32e22-ac60-43da-a34f-a302734362f6 tempest-ProjectReaderTests-1506540965 None] Lock "cinder-quobyte-2fd4cade-49fb-4d81-89fa-f23f6837de16" released by "delete_snapshot" :: held 1.405s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:12:01 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-61a32e22-ac60-43da-a34f-a302734362f6 tempest-ProjectReaderTests-1506540965 None] Created reservations ['4430824b-a690-4792-9acf-9ccb2431c2d0', 'ea201695-7c64-4362-8bd2-10ec6a122dda', '31bab61c-7f45-481e-ba0e-7062ab4bfe86', '7c813807-d0be-4f74-9939-fe58322b56be'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:12:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-c955f0e1-7f4f-4946-b474-ce30408a7b43 tempest-ProjectMemberTests-1556323482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:12:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-c955f0e1-7f4f-4946-b474-ce30408a7b43 tempest-ProjectMemberTests-1556323482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:12:01 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-c955f0e1-7f4f-4946-b474-ce30408a7b43 tempest-ProjectMemberTests-1556323482 None] Creating offline snapshot ca982fae-522b-41d1-b7e2-55a457196e93 of volume b5c3b5c6-4970-4f9b-a59b-8bd34c8da279 {{(pid=88568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:12:01 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-61a32e22-ac60-43da-a34f-a302734362f6 tempest-ProjectReaderTests-1506540965 None] Delete snapshot completed successfully. Jul 30 17:12:01 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-61a32e22-ac60-43da-a34f-a302734362f6 tempest-ProjectReaderTests-1506540965 None] Lock "cinder-70df5b73-cdeb-4781-b3cf-22a30ff6a5b3-delete_snapshot" released by "delete_snapshot" :: held 1.580s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:12:01 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[62eaef85-56a5-4591-a8e1-deba0b03433c]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:12:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-c955f0e1-7f4f-4946-b474-ce30408a7b43 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b5c3b5c6-4970-4f9b-a59b-8bd34c8da279 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:01 devstack sudo[109212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b5c3b5c6-4970-4f9b-a59b-8bd34c8da279 Jul 30 17:12:01 devstack sudo[109212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:01 devstack sudo[109212]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-c955f0e1-7f4f-4946-b474-ce30408a7b43 tempest-ProjectMemberTests-1556323482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b5c3b5c6-4970-4f9b-a59b-8bd34c8da279" returned: 0 in 0.347s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-c955f0e1-7f4f-4946-b474-ce30408a7b43 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b5c3b5c6-4970-4f9b-a59b-8bd34c8da279,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b5c3b5c6-4970-4f9b-a59b-8bd34c8da279.ca982fae-522b-41d1-b7e2-55a457196e93 1G {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:01 devstack sudo[109217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b5c3b5c6-4970-4f9b-a59b-8bd34c8da279,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b5c3b5c6-4970-4f9b-a59b-8bd34c8da279.ca982fae-522b-41d1-b7e2-55a457196e93 1G Jul 30 17:12:01 devstack sudo[109217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:01 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-58ced421-e123-4fda-bd8f-d10d6abdae2c tempest-ProjectReaderTests-1506540965 None] Acquiring lock "cinder-2fd4cade-49fb-4d81-89fa-f23f6837de16-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:12:01 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-58ced421-e123-4fda-bd8f-d10d6abdae2c tempest-ProjectReaderTests-1506540965 None] Lock "cinder-2fd4cade-49fb-4d81-89fa-f23f6837de16-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:12:01 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-58ced421-e123-4fda-bd8f-d10d6abdae2c tempest-ProjectReaderTests-1506540965 None] Acquiring lock "cinder-quobyte-2fd4cade-49fb-4d81-89fa-f23f6837de16" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:12:01 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-58ced421-e123-4fda-bd8f-d10d6abdae2c tempest-ProjectReaderTests-1506540965 None] Lock "cinder-quobyte-2fd4cade-49fb-4d81-89fa-f23f6837de16" acquired by "delete_volume" :: waited 0.014s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:12:01 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[897bde71-1b00-414a-9057-a04a7ace7c4f]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:12:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-58ced421-e123-4fda-bd8f-d10d6abdae2c tempest-ProjectReaderTests-1506540965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2fd4cade-49fb-4d81-89fa-f23f6837de16 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:01 devstack sudo[109217]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:01 devstack sudo[109222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2fd4cade-49fb-4d81-89fa-f23f6837de16 Jul 30 17:12:01 devstack sudo[109222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-c955f0e1-7f4f-4946-b474-ce30408a7b43 tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b5c3b5c6-4970-4f9b-a59b-8bd34c8da279,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b5c3b5c6-4970-4f9b-a59b-8bd34c8da279.ca982fae-522b-41d1-b7e2-55a457196e93 1G" returned: 0 in 0.453s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:01 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-c955f0e1-7f4f-4946-b474-ce30408a7b43 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5c3b5c6-4970-4f9b-a59b-8bd34c8da279 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b5c3b5c6-4970-4f9b-a59b-8bd34c8da279.ca982fae-522b-41d1-b7e2-55a457196e93 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:02 devstack sudo[109224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5c3b5c6-4970-4f9b-a59b-8bd34c8da279 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b5c3b5c6-4970-4f9b-a59b-8bd34c8da279.ca982fae-522b-41d1-b7e2-55a457196e93 Jul 30 17:12:02 devstack sudo[109224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:02 devstack sudo[109222]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-58ced421-e123-4fda-bd8f-d10d6abdae2c tempest-ProjectReaderTests-1506540965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2fd4cade-49fb-4d81-89fa-f23f6837de16" returned: 0 in 0.381s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-58ced421-e123-4fda-bd8f-d10d6abdae2c tempest-ProjectReaderTests-1506540965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2fd4cade-49fb-4d81-89fa-f23f6837de16 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:02 devstack sudo[109232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2fd4cade-49fb-4d81-89fa-f23f6837de16 Jul 30 17:12:02 devstack sudo[109232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:02 devstack sudo[109224]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-c955f0e1-7f4f-4946-b474-ce30408a7b43 tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5c3b5c6-4970-4f9b-a59b-8bd34c8da279 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b5c3b5c6-4970-4f9b-a59b-8bd34c8da279.ca982fae-522b-41d1-b7e2-55a457196e93" returned: 0 in 0.299s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:02 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-c955f0e1-7f4f-4946-b474-ce30408a7b43 tempest-ProjectMemberTests-1556323482 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b5c3b5c6-4970-4f9b-a59b-8bd34c8da279.ca982fae-522b-41d1-b7e2-55a457196e93 is being set with open permissions: ugo+rw Jul 30 17:12:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-c955f0e1-7f4f-4946-b474-ce30408a7b43 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b5c3b5c6-4970-4f9b-a59b-8bd34c8da279.ca982fae-522b-41d1-b7e2-55a457196e93 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:02 devstack sudo[109234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b5c3b5c6-4970-4f9b-a59b-8bd34c8da279.ca982fae-522b-41d1-b7e2-55a457196e93 Jul 30 17:12:02 devstack sudo[109234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:02 devstack sudo[109232]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-58ced421-e123-4fda-bd8f-d10d6abdae2c tempest-ProjectReaderTests-1506540965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-2fd4cade-49fb-4d81-89fa-f23f6837de16" returned: 0 in 0.255s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:02 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-58ced421-e123-4fda-bd8f-d10d6abdae2c tempest-ProjectReaderTests-1506540965 None] Lock "cinder-quobyte-2fd4cade-49fb-4d81-89fa-f23f6837de16" released by "delete_volume" :: held 0.695s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:12:02 devstack sudo[109234]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-c955f0e1-7f4f-4946-b474-ce30408a7b43 tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b5c3b5c6-4970-4f9b-a59b-8bd34c8da279.ca982fae-522b-41d1-b7e2-55a457196e93" returned: 0 in 0.245s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-c955f0e1-7f4f-4946-b474-ce30408a7b43 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b5c3b5c6-4970-4f9b-a59b-8bd34c8da279.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:02 devstack sudo[109238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b5c3b5c6-4970-4f9b-a59b-8bd34c8da279.info Jul 30 17:12:02 devstack sudo[109238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:02 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-58ced421-e123-4fda-bd8f-d10d6abdae2c tempest-ProjectReaderTests-1506540965 None] Created reservations ['a08083db-ab10-40d3-abde-5c1107b30796', 'de35fba0-efb9-4fe7-b36a-53c7cfe9a8d7', '28b9ec8b-1969-47b4-a245-2370811617b6', 'e32eb133-7985-4a25-8396-29b069bbfc10'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:12:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-58ced421-e123-4fda-bd8f-d10d6abdae2c tempest-ProjectReaderTests-1506540965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:12:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-58ced421-e123-4fda-bd8f-d10d6abdae2c tempest-ProjectReaderTests-1506540965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:12:02 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-58ced421-e123-4fda-bd8f-d10d6abdae2c tempest-ProjectReaderTests-1506540965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:12:02 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-58ced421-e123-4fda-bd8f-d10d6abdae2c tempest-ProjectReaderTests-1506540965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:12:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-58ced421-e123-4fda-bd8f-d10d6abdae2c tempest-ProjectReaderTests-1506540965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:12:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-58ced421-e123-4fda-bd8f-d10d6abdae2c tempest-ProjectReaderTests-1506540965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:02 devstack sudo[109240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:12:02 devstack sudo[109240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:02 devstack sudo[109238]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-c955f0e1-7f4f-4946-b474-ce30408a7b43 tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b5c3b5c6-4970-4f9b-a59b-8bd34c8da279.info" returned: 0 in 0.261s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:02 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-c955f0e1-7f4f-4946-b474-ce30408a7b43 tempest-ProjectMemberTests-1556323482 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b5c3b5c6-4970-4f9b-a59b-8bd34c8da279.info is being set with open permissions: ugo+rw Jul 30 17:12:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-c955f0e1-7f4f-4946-b474-ce30408a7b43 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b5c3b5c6-4970-4f9b-a59b-8bd34c8da279.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:02 devstack sudo[109243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b5c3b5c6-4970-4f9b-a59b-8bd34c8da279.info Jul 30 17:12:02 devstack sudo[109243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:02 devstack sudo[109240]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:02 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-58ced421-e123-4fda-bd8f-d10d6abdae2c tempest-ProjectReaderTests-1506540965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.264s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:02 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-58ced421-e123-4fda-bd8f-d10d6abdae2c tempest-ProjectReaderTests-1506540965 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:12:02 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-58ced421-e123-4fda-bd8f-d10d6abdae2c tempest-ProjectReaderTests-1506540965 None] Deleted volume successfully. Jul 30 17:12:02 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-58ced421-e123-4fda-bd8f-d10d6abdae2c tempest-ProjectReaderTests-1506540965 None] Lock "cinder-2fd4cade-49fb-4d81-89fa-f23f6837de16-delete_volume" released by "delete_volume" :: held 1.207s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:12:03 devstack sudo[109243]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-c955f0e1-7f4f-4946-b474-ce30408a7b43 tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b5c3b5c6-4970-4f9b-a59b-8bd34c8da279.info" returned: 0 in 0.256s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-c955f0e1-7f4f-4946-b474-ce30408a7b43 tempest-ProjectMemberTests-1556323482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.962s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:12:03 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-c955f0e1-7f4f-4946-b474-ce30408a7b43 tempest-ProjectMemberTests-1556323482 None] Create snapshot completed successfully Jul 30 17:12:03 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-0a87ac98-c402-4eb9-9e17-2a490d28c2ca tempest-ProjectMemberTests-1556323482 None] Acquiring lock "cinder-ca982fae-522b-41d1-b7e2-55a457196e93-delete_snapshot" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:12:03 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-0a87ac98-c402-4eb9-9e17-2a490d28c2ca tempest-ProjectMemberTests-1556323482 None] Lock "cinder-ca982fae-522b-41d1-b7e2-55a457196e93-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:12:03 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-0a87ac98-c402-4eb9-9e17-2a490d28c2ca tempest-ProjectMemberTests-1556323482 None] Acquiring lock "cinder-quobyte-b5c3b5c6-4970-4f9b-a59b-8bd34c8da279" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:12:03 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-0a87ac98-c402-4eb9-9e17-2a490d28c2ca tempest-ProjectMemberTests-1556323482 None] Lock "cinder-quobyte-b5c3b5c6-4970-4f9b-a59b-8bd34c8da279" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:12:03 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-0a87ac98-c402-4eb9-9e17-2a490d28c2ca tempest-ProjectMemberTests-1556323482 None] Acquiring lock "cinder-quobyte-ca982fae-522b-41d1-b7e2-55a457196e93" by "_delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:12:03 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-0a87ac98-c402-4eb9-9e17-2a490d28c2ca tempest-ProjectMemberTests-1556323482 None] Lock "cinder-quobyte-ca982fae-522b-41d1-b7e2-55a457196e93" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:12:03 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-0a87ac98-c402-4eb9-9e17-2a490d28c2ca tempest-ProjectMemberTests-1556323482 None] Deleting offline snapshot ca982fae-522b-41d1-b7e2-55a457196e93 of volume b5c3b5c6-4970-4f9b-a59b-8bd34c8da279 {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:12:03 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-0a87ac98-c402-4eb9-9e17-2a490d28c2ca tempest-ProjectMemberTests-1556323482 None] snapshot_file for this snap is: volume-b5c3b5c6-4970-4f9b-a59b-8bd34c8da279.ca982fae-522b-41d1-b7e2-55a457196e93 {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:12:03 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[b895df25-87f6-44f1-9a83-b6555ff2079a]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:12:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0a87ac98-c402-4eb9-9e17-2a490d28c2ca tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b5c3b5c6-4970-4f9b-a59b-8bd34c8da279.ca982fae-522b-41d1-b7e2-55a457196e93 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:03 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-51d86de5-80d4-455b-96a4-af3f60d371cb tempest-ProjectReaderTests-1506540965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:12:03 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-51d86de5-80d4-455b-96a4-af3f60d371cb tempest-ProjectReaderTests-1506540965 None] Flow 'volume_create_manager' (5199a131-0c61-4173-ba61-5660950338b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:12:03 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-51d86de5-80d4-455b-96a4-af3f60d371cb tempest-ProjectReaderTests-1506540965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dbad29c-e061-4c9c-8607-2653e365dd15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:12:03 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-51d86de5-80d4-455b-96a4-af3f60d371cb tempest-ProjectReaderTests-1506540965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dbad29c-e061-4c9c-8607-2653e365dd15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:12:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1551681895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7daa3132-8601-4b17-b9bb-2904056689cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d6f792b22ba46ca94d09af3b2157e87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:12:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:12:03Z,use_quota=True,user_id='32ed3c4f75834041b2773f0e7b64d007',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:12:03 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-51d86de5-80d4-455b-96a4-af3f60d371cb tempest-ProjectReaderTests-1506540965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf18a3cb-9b1c-481c-a876-18f65647abd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:12:03 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-51d86de5-80d4-455b-96a4-af3f60d371cb tempest-ProjectReaderTests-1506540965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf18a3cb-9b1c-481c-a876-18f65647abd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:12:03 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-51d86de5-80d4-455b-96a4-af3f60d371cb tempest-ProjectReaderTests-1506540965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (513c0c95-98cb-49e3-9dd4-c6525acb135b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:12:03 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-51d86de5-80d4-455b-96a4-af3f60d371cb tempest-ProjectReaderTests-1506540965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (513c0c95-98cb-49e3-9dd4-c6525acb135b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7daa3132-8601-4b17-b9bb-2904056689cf', 'volume_name': 'volume-7daa3132-8601-4b17-b9bb-2904056689cf', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:12:03 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-51d86de5-80d4-455b-96a4-af3f60d371cb tempest-ProjectReaderTests-1506540965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b8e7db0-b7f1-48e3-bb4e-55f7ee02c2bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:12:03 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-51d86de5-80d4-455b-96a4-af3f60d371cb tempest-ProjectReaderTests-1506540965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b8e7db0-b7f1-48e3-bb4e-55f7ee02c2bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:12:03 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-51d86de5-80d4-455b-96a4-af3f60d371cb tempest-ProjectReaderTests-1506540965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6a2c752-927d-45c0-a62f-12ec294993cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:12:03 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-51d86de5-80d4-455b-96a4-af3f60d371cb tempest-ProjectReaderTests-1506540965 None] Volume 7daa3132-8601-4b17-b9bb-2904056689cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7daa3132-8601-4b17-b9bb-2904056689cf', 'volume_size': 1} Jul 30 17:12:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-51d86de5-80d4-455b-96a4-af3f60d371cb tempest-ProjectReaderTests-1506540965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:12:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-51d86de5-80d4-455b-96a4-af3f60d371cb tempest-ProjectReaderTests-1506540965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:12:03 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-51d86de5-80d4-455b-96a4-af3f60d371cb tempest-ProjectReaderTests-1506540965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:12:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1551681895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7daa3132-8601-4b17-b9bb-2904056689cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d6f792b22ba46ca94d09af3b2157e87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:12:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:12:03Z,use_quota=True,user_id='32ed3c4f75834041b2773f0e7b64d007',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:12:03 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-51d86de5-80d4-455b-96a4-af3f60d371cb tempest-ProjectReaderTests-1506540965 None] Creating volume 7daa3132-8601-4b17-b9bb-2904056689cf {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:12:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-51d86de5-80d4-455b-96a4-af3f60d371cb tempest-ProjectReaderTests-1506540965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:12:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-51d86de5-80d4-455b-96a4-af3f60d371cb tempest-ProjectReaderTests-1506540965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:12:03 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-51d86de5-80d4-455b-96a4-af3f60d371cb tempest-ProjectReaderTests-1506540965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:12:03 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-51d86de5-80d4-455b-96a4-af3f60d371cb tempest-ProjectReaderTests-1506540965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:12:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-51d86de5-80d4-455b-96a4-af3f60d371cb tempest-ProjectReaderTests-1506540965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:12:03 devstack sudo[109247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b5c3b5c6-4970-4f9b-a59b-8bd34c8da279.ca982fae-522b-41d1-b7e2-55a457196e93 Jul 30 17:12:03 devstack sudo[109247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:03 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-51d86de5-80d4-455b-96a4-af3f60d371cb tempest-ProjectReaderTests-1506540965 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:12:03 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-51d86de5-80d4-455b-96a4-af3f60d371cb tempest-ProjectReaderTests-1506540965 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:12:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-51d86de5-80d4-455b-96a4-af3f60d371cb tempest-ProjectReaderTests-1506540965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7daa3132-8601-4b17-b9bb-2904056689cf 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:03 devstack sudo[109249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7daa3132-8601-4b17-b9bb-2904056689cf 1073741824 Jul 30 17:12:03 devstack sudo[109249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:03 devstack sudo[109247]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0a87ac98-c402-4eb9-9e17-2a490d28c2ca tempest-ProjectMemberTests-1556323482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b5c3b5c6-4970-4f9b-a59b-8bd34c8da279.ca982fae-522b-41d1-b7e2-55a457196e93" returned: 0 in 0.387s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:03 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-0a87ac98-c402-4eb9-9e17-2a490d28c2ca tempest-ProjectMemberTests-1556323482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5c3b5c6-4970-4f9b-a59b-8bd34c8da279(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:12:03 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[461b4c88-7c1a-4c6a-9a9b-94e7d58fb414]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:12:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0a87ac98-c402-4eb9-9e17-2a490d28c2ca tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b5c3b5c6-4970-4f9b-a59b-8bd34c8da279 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:03 devstack sudo[109258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b5c3b5c6-4970-4f9b-a59b-8bd34c8da279 Jul 30 17:12:03 devstack sudo[109258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:03 devstack sudo[109249]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-51d86de5-80d4-455b-96a4-af3f60d371cb tempest-ProjectReaderTests-1506540965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7daa3132-8601-4b17-b9bb-2904056689cf 1073741824" returned: 0 in 0.473s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-51d86de5-80d4-455b-96a4-af3f60d371cb tempest-ProjectReaderTests-1506540965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7daa3132-8601-4b17-b9bb-2904056689cf {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:04 devstack sudo[109260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7daa3132-8601-4b17-b9bb-2904056689cf Jul 30 17:12:04 devstack sudo[109260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:04 devstack sudo[109258]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0a87ac98-c402-4eb9-9e17-2a490d28c2ca tempest-ProjectMemberTests-1556323482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b5c3b5c6-4970-4f9b-a59b-8bd34c8da279" returned: 0 in 0.392s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0a87ac98-c402-4eb9-9e17-2a490d28c2ca tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b5c3b5c6-4970-4f9b-a59b-8bd34c8da279.ca982fae-522b-41d1-b7e2-55a457196e93 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:04 devstack sudo[109265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b5c3b5c6-4970-4f9b-a59b-8bd34c8da279.ca982fae-522b-41d1-b7e2-55a457196e93 Jul 30 17:12:04 devstack sudo[109265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:04 devstack sudo[109260]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-51d86de5-80d4-455b-96a4-af3f60d371cb tempest-ProjectReaderTests-1506540965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7daa3132-8601-4b17-b9bb-2904056689cf" returned: 0 in 0.262s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:04 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-51d86de5-80d4-455b-96a4-af3f60d371cb tempest-ProjectReaderTests-1506540965 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:12:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-51d86de5-80d4-455b-96a4-af3f60d371cb tempest-ProjectReaderTests-1506540965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:12:04 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-51d86de5-80d4-455b-96a4-af3f60d371cb tempest-ProjectReaderTests-1506540965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6a2c752-927d-45c0-a62f-12ec294993cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7daa3132-8601-4b17-b9bb-2904056689cf', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:12:04 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-51d86de5-80d4-455b-96a4-af3f60d371cb tempest-ProjectReaderTests-1506540965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (834d0c15-2b25-41f9-81c3-d9ff19836224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:12:04 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-51d86de5-80d4-455b-96a4-af3f60d371cb tempest-ProjectReaderTests-1506540965 None] Volume volume-7daa3132-8601-4b17-b9bb-2904056689cf (7daa3132-8601-4b17-b9bb-2904056689cf): created successfully Jul 30 17:12:04 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-51d86de5-80d4-455b-96a4-af3f60d371cb tempest-ProjectReaderTests-1506540965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (834d0c15-2b25-41f9-81c3-d9ff19836224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:12:04 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-51d86de5-80d4-455b-96a4-af3f60d371cb tempest-ProjectReaderTests-1506540965 None] Flow 'volume_create_manager' (5199a131-0c61-4173-ba61-5660950338b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:12:04 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-51d86de5-80d4-455b-96a4-af3f60d371cb tempest-ProjectReaderTests-1506540965 None] Created volume successfully. Jul 30 17:12:04 devstack sudo[109265]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0a87ac98-c402-4eb9-9e17-2a490d28c2ca tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b5c3b5c6-4970-4f9b-a59b-8bd34c8da279.ca982fae-522b-41d1-b7e2-55a457196e93" returned: 0 in 0.330s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0a87ac98-c402-4eb9-9e17-2a490d28c2ca tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b5c3b5c6-4970-4f9b-a59b-8bd34c8da279.ca982fae-522b-41d1-b7e2-55a457196e93 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:04 devstack sudo[109272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b5c3b5c6-4970-4f9b-a59b-8bd34c8da279.ca982fae-522b-41d1-b7e2-55a457196e93 Jul 30 17:12:04 devstack sudo[109272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:04 devstack sudo[109272]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:04 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0a87ac98-c402-4eb9-9e17-2a490d28c2ca tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b5c3b5c6-4970-4f9b-a59b-8bd34c8da279.ca982fae-522b-41d1-b7e2-55a457196e93" returned: 0 in 0.240s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:04 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-0a87ac98-c402-4eb9-9e17-2a490d28c2ca tempest-ProjectMemberTests-1556323482 None] Lock "cinder-quobyte-ca982fae-522b-41d1-b7e2-55a457196e93" released by "_delete_snapshot" :: held 1.465s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:12:04 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-0a87ac98-c402-4eb9-9e17-2a490d28c2ca tempest-ProjectMemberTests-1556323482 None] Lock "cinder-quobyte-b5c3b5c6-4970-4f9b-a59b-8bd34c8da279" released by "delete_snapshot" :: held 1.493s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:12:04 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-0a87ac98-c402-4eb9-9e17-2a490d28c2ca tempest-ProjectMemberTests-1556323482 None] Created reservations ['584138c9-7e67-47e9-a3cd-b06a4e22958a', '15b1541c-caf7-47d3-9cf3-7b934bb0d394', 'fe37eed9-c5db-4528-9fc1-0fc4e3fea5a0', '048e995a-d06b-4cef-9366-33ca93ef9ff9'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:12:04 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-0a87ac98-c402-4eb9-9e17-2a490d28c2ca tempest-ProjectMemberTests-1556323482 None] Delete snapshot completed successfully. Jul 30 17:12:04 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-0a87ac98-c402-4eb9-9e17-2a490d28c2ca tempest-ProjectMemberTests-1556323482 None] Lock "cinder-ca982fae-522b-41d1-b7e2-55a457196e93-delete_snapshot" released by "delete_snapshot" :: held 1.624s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:12:05 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-7f73dfad-a7cf-47af-ba72-5ede7e9a3706 tempest-ProjectMemberTests-1556323482 None] Acquiring lock "cinder-b5c3b5c6-4970-4f9b-a59b-8bd34c8da279-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:12:05 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-7f73dfad-a7cf-47af-ba72-5ede7e9a3706 tempest-ProjectMemberTests-1556323482 None] Lock "cinder-b5c3b5c6-4970-4f9b-a59b-8bd34c8da279-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:12:05 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-7f73dfad-a7cf-47af-ba72-5ede7e9a3706 tempest-ProjectMemberTests-1556323482 None] Acquiring lock "cinder-quobyte-b5c3b5c6-4970-4f9b-a59b-8bd34c8da279" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:12:05 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-7f73dfad-a7cf-47af-ba72-5ede7e9a3706 tempest-ProjectMemberTests-1556323482 None] Lock "cinder-quobyte-b5c3b5c6-4970-4f9b-a59b-8bd34c8da279" acquired by "delete_volume" :: waited 0.015s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:12:05 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ec8627-ca6f-46cb-b58c-ce3fdd8bccba]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:12:05 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7f73dfad-a7cf-47af-ba72-5ede7e9a3706 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b5c3b5c6-4970-4f9b-a59b-8bd34c8da279 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:05 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-0d9b9f00-5a23-48a5-ba3d-90cd04a7ad6a tempest-ProjectReaderTests-1506540965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:12:05 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-0d9b9f00-5a23-48a5-ba3d-90cd04a7ad6a tempest-ProjectReaderTests-1506540965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:12:05 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-0d9b9f00-5a23-48a5-ba3d-90cd04a7ad6a tempest-ProjectReaderTests-1506540965 None] Creating offline snapshot 80d84754-c01c-4c25-a335-8a12e5a04ad8 of volume 7daa3132-8601-4b17-b9bb-2904056689cf {{(pid=88568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:12:05 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[28743fd2-3ef4-4416-ab27-11066ffade9d]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:12:05 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0d9b9f00-5a23-48a5-ba3d-90cd04a7ad6a tempest-ProjectReaderTests-1506540965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7daa3132-8601-4b17-b9bb-2904056689cf {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:05 devstack sudo[109276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b5c3b5c6-4970-4f9b-a59b-8bd34c8da279 Jul 30 17:12:05 devstack sudo[109276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:05 devstack sudo[109278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7daa3132-8601-4b17-b9bb-2904056689cf Jul 30 17:12:05 devstack sudo[109278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:05 devstack sudo[109276]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:05 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7f73dfad-a7cf-47af-ba72-5ede7e9a3706 tempest-ProjectMemberTests-1556323482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b5c3b5c6-4970-4f9b-a59b-8bd34c8da279" returned: 0 in 0.376s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:05 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7f73dfad-a7cf-47af-ba72-5ede7e9a3706 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b5c3b5c6-4970-4f9b-a59b-8bd34c8da279 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:05 devstack sudo[109283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b5c3b5c6-4970-4f9b-a59b-8bd34c8da279 Jul 30 17:12:05 devstack sudo[109283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:06 devstack sudo[109278]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0d9b9f00-5a23-48a5-ba3d-90cd04a7ad6a tempest-ProjectReaderTests-1506540965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7daa3132-8601-4b17-b9bb-2904056689cf" returned: 0 in 0.384s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0d9b9f00-5a23-48a5-ba3d-90cd04a7ad6a tempest-ProjectReaderTests-1506540965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7daa3132-8601-4b17-b9bb-2904056689cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7daa3132-8601-4b17-b9bb-2904056689cf.80d84754-c01c-4c25-a335-8a12e5a04ad8 1G {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:06 devstack sudo[109288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7daa3132-8601-4b17-b9bb-2904056689cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7daa3132-8601-4b17-b9bb-2904056689cf.80d84754-c01c-4c25-a335-8a12e5a04ad8 1G Jul 30 17:12:06 devstack sudo[109288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:06 devstack sudo[109283]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7f73dfad-a7cf-47af-ba72-5ede7e9a3706 tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b5c3b5c6-4970-4f9b-a59b-8bd34c8da279" returned: 0 in 0.267s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:06 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-7f73dfad-a7cf-47af-ba72-5ede7e9a3706 tempest-ProjectMemberTests-1556323482 None] Lock "cinder-quobyte-b5c3b5c6-4970-4f9b-a59b-8bd34c8da279" released by "delete_volume" :: held 0.708s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:12:06 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-7f73dfad-a7cf-47af-ba72-5ede7e9a3706 tempest-ProjectMemberTests-1556323482 None] Created reservations ['493f9931-8153-4a9d-94cd-87055fd95f1e', '2ce98991-ef7e-40d5-8ad4-bb86f96dc082', '7119c349-05b3-45c7-9c4a-5e6d9f76109c', '9714995e-c51a-4de9-a427-89ac8229e2e7'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:12:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-7f73dfad-a7cf-47af-ba72-5ede7e9a3706 tempest-ProjectMemberTests-1556323482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:12:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-7f73dfad-a7cf-47af-ba72-5ede7e9a3706 tempest-ProjectMemberTests-1556323482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:12:06 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-7f73dfad-a7cf-47af-ba72-5ede7e9a3706 tempest-ProjectMemberTests-1556323482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:12:06 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-7f73dfad-a7cf-47af-ba72-5ede7e9a3706 tempest-ProjectMemberTests-1556323482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:12:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-7f73dfad-a7cf-47af-ba72-5ede7e9a3706 tempest-ProjectMemberTests-1556323482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:12:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7f73dfad-a7cf-47af-ba72-5ede7e9a3706 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:06 devstack sudo[109294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:12:06 devstack sudo[109294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:06 devstack sudo[109288]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0d9b9f00-5a23-48a5-ba3d-90cd04a7ad6a tempest-ProjectReaderTests-1506540965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7daa3132-8601-4b17-b9bb-2904056689cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7daa3132-8601-4b17-b9bb-2904056689cf.80d84754-c01c-4c25-a335-8a12e5a04ad8 1G" returned: 0 in 0.413s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0d9b9f00-5a23-48a5-ba3d-90cd04a7ad6a tempest-ProjectReaderTests-1506540965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7daa3132-8601-4b17-b9bb-2904056689cf -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7daa3132-8601-4b17-b9bb-2904056689cf.80d84754-c01c-4c25-a335-8a12e5a04ad8 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:06 devstack sudo[109296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7daa3132-8601-4b17-b9bb-2904056689cf -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7daa3132-8601-4b17-b9bb-2904056689cf.80d84754-c01c-4c25-a335-8a12e5a04ad8 Jul 30 17:12:06 devstack sudo[109296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:06 devstack sudo[109294]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7f73dfad-a7cf-47af-ba72-5ede7e9a3706 tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.272s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:06 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-7f73dfad-a7cf-47af-ba72-5ede7e9a3706 tempest-ProjectMemberTests-1556323482 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:12:06 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-7f73dfad-a7cf-47af-ba72-5ede7e9a3706 tempest-ProjectMemberTests-1556323482 None] Deleted volume successfully. Jul 30 17:12:06 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-7f73dfad-a7cf-47af-ba72-5ede7e9a3706 tempest-ProjectMemberTests-1556323482 None] Lock "cinder-b5c3b5c6-4970-4f9b-a59b-8bd34c8da279-delete_volume" released by "delete_volume" :: held 1.191s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:12:06 devstack sudo[109296]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0d9b9f00-5a23-48a5-ba3d-90cd04a7ad6a tempest-ProjectReaderTests-1506540965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7daa3132-8601-4b17-b9bb-2904056689cf -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7daa3132-8601-4b17-b9bb-2904056689cf.80d84754-c01c-4c25-a335-8a12e5a04ad8" returned: 0 in 0.333s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:06 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-0d9b9f00-5a23-48a5-ba3d-90cd04a7ad6a tempest-ProjectReaderTests-1506540965 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7daa3132-8601-4b17-b9bb-2904056689cf.80d84754-c01c-4c25-a335-8a12e5a04ad8 is being set with open permissions: ugo+rw Jul 30 17:12:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0d9b9f00-5a23-48a5-ba3d-90cd04a7ad6a tempest-ProjectReaderTests-1506540965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7daa3132-8601-4b17-b9bb-2904056689cf.80d84754-c01c-4c25-a335-8a12e5a04ad8 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:06 devstack sudo[109302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7daa3132-8601-4b17-b9bb-2904056689cf.80d84754-c01c-4c25-a335-8a12e5a04ad8 Jul 30 17:12:06 devstack sudo[109302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:07 devstack sudo[109302]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:07 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0d9b9f00-5a23-48a5-ba3d-90cd04a7ad6a tempest-ProjectReaderTests-1506540965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7daa3132-8601-4b17-b9bb-2904056689cf.80d84754-c01c-4c25-a335-8a12e5a04ad8" returned: 0 in 0.264s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:07 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc402106-50a7-4107-8404-de5454b98660 tempest-ProjectMemberTests-1556323482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:12:07 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fc402106-50a7-4107-8404-de5454b98660 tempest-ProjectMemberTests-1556323482 None] Flow 'volume_create_manager' (ab3005d8-584e-46af-beeb-10d0eb931e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:12:07 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fc402106-50a7-4107-8404-de5454b98660 tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b6b2253-73cb-44e3-b9a6-eac478742c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:12:07 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0d9b9f00-5a23-48a5-ba3d-90cd04a7ad6a tempest-ProjectReaderTests-1506540965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7daa3132-8601-4b17-b9bb-2904056689cf.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:07 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fc402106-50a7-4107-8404-de5454b98660 tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b6b2253-73cb-44e3-b9a6-eac478742c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:12:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2011890752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fa6305a-f0a1-4e87-8056-6acabd41f818,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72a0b0e3a199416698115290d71c6808',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:12:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:12:07Z,use_quota=True,user_id='8f2d7aa2b6ab4865b626b01a01acc0f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:12:07 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fc402106-50a7-4107-8404-de5454b98660 tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (918d85fd-7022-4c1d-9675-da102429cd87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:12:07 devstack sudo[109305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7daa3132-8601-4b17-b9bb-2904056689cf.info Jul 30 17:12:07 devstack sudo[109305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:07 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fc402106-50a7-4107-8404-de5454b98660 tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (918d85fd-7022-4c1d-9675-da102429cd87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:12:07 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fc402106-50a7-4107-8404-de5454b98660 tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd0b80d3-8323-4487-a153-04905e9cff9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:12:07 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fc402106-50a7-4107-8404-de5454b98660 tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd0b80d3-8323-4487-a153-04905e9cff9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fa6305a-f0a1-4e87-8056-6acabd41f818', 'volume_name': 'volume-6fa6305a-f0a1-4e87-8056-6acabd41f818', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:12:07 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fc402106-50a7-4107-8404-de5454b98660 tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (149a6539-b9bd-4d4b-a18f-ee78876d378a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:12:07 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fc402106-50a7-4107-8404-de5454b98660 tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (149a6539-b9bd-4d4b-a18f-ee78876d378a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:12:07 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fc402106-50a7-4107-8404-de5454b98660 tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7a38fc9-8f34-4399-b2ad-4530da79ff89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:12:07 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-fc402106-50a7-4107-8404-de5454b98660 tempest-ProjectMemberTests-1556323482 None] Volume 6fa6305a-f0a1-4e87-8056-6acabd41f818: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fa6305a-f0a1-4e87-8056-6acabd41f818', 'volume_size': 1} Jul 30 17:12:07 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-fc402106-50a7-4107-8404-de5454b98660 tempest-ProjectMemberTests-1556323482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:12:07 devstack sudo[109305]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:07 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0d9b9f00-5a23-48a5-ba3d-90cd04a7ad6a tempest-ProjectReaderTests-1506540965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7daa3132-8601-4b17-b9bb-2904056689cf.info" returned: 0 in 0.254s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:07 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-0d9b9f00-5a23-48a5-ba3d-90cd04a7ad6a tempest-ProjectReaderTests-1506540965 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7daa3132-8601-4b17-b9bb-2904056689cf.info is being set with open permissions: ugo+rw Jul 30 17:12:07 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0d9b9f00-5a23-48a5-ba3d-90cd04a7ad6a tempest-ProjectReaderTests-1506540965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7daa3132-8601-4b17-b9bb-2904056689cf.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:07 devstack sudo[109308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7daa3132-8601-4b17-b9bb-2904056689cf.info Jul 30 17:12:07 devstack sudo[109308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:07 devstack sudo[109308]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:07 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0d9b9f00-5a23-48a5-ba3d-90cd04a7ad6a tempest-ProjectReaderTests-1506540965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7daa3132-8601-4b17-b9bb-2904056689cf.info" returned: 0 in 0.246s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:07 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-0d9b9f00-5a23-48a5-ba3d-90cd04a7ad6a tempest-ProjectReaderTests-1506540965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.010s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:12:07 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-fc402106-50a7-4107-8404-de5454b98660 tempest-ProjectMemberTests-1556323482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.464s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:12:07 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-fc402106-50a7-4107-8404-de5454b98660 tempest-ProjectMemberTests-1556323482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:12:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2011890752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fa6305a-f0a1-4e87-8056-6acabd41f818,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72a0b0e3a199416698115290d71c6808',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:12:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:12:07Z,use_quota=True,user_id='8f2d7aa2b6ab4865b626b01a01acc0f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:12:07 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-fc402106-50a7-4107-8404-de5454b98660 tempest-ProjectMemberTests-1556323482 None] Creating volume 6fa6305a-f0a1-4e87-8056-6acabd41f818 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:12:07 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-fc402106-50a7-4107-8404-de5454b98660 tempest-ProjectMemberTests-1556323482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:12:07 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-fc402106-50a7-4107-8404-de5454b98660 tempest-ProjectMemberTests-1556323482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:12:07 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-fc402106-50a7-4107-8404-de5454b98660 tempest-ProjectMemberTests-1556323482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:12:07 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-fc402106-50a7-4107-8404-de5454b98660 tempest-ProjectMemberTests-1556323482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:12:07 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-fc402106-50a7-4107-8404-de5454b98660 tempest-ProjectMemberTests-1556323482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:12:07 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-fc402106-50a7-4107-8404-de5454b98660 tempest-ProjectMemberTests-1556323482 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:12:07 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-fc402106-50a7-4107-8404-de5454b98660 tempest-ProjectMemberTests-1556323482 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:12:07 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fc402106-50a7-4107-8404-de5454b98660 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6fa6305a-f0a1-4e87-8056-6acabd41f818 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:07 devstack sudo[109311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6fa6305a-f0a1-4e87-8056-6acabd41f818 1073741824 Jul 30 17:12:07 devstack sudo[109311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:07 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-0d9b9f00-5a23-48a5-ba3d-90cd04a7ad6a tempest-ProjectReaderTests-1506540965 None] Create snapshot completed successfully Jul 30 17:12:08 devstack sudo[109311]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:08 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fc402106-50a7-4107-8404-de5454b98660 tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6fa6305a-f0a1-4e87-8056-6acabd41f818 1073741824" returned: 0 in 0.412s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:08 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fc402106-50a7-4107-8404-de5454b98660 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6fa6305a-f0a1-4e87-8056-6acabd41f818 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:08 devstack sudo[109317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6fa6305a-f0a1-4e87-8056-6acabd41f818 Jul 30 17:12:08 devstack sudo[109317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:08 devstack sudo[109317]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:08 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-fc402106-50a7-4107-8404-de5454b98660 tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6fa6305a-f0a1-4e87-8056-6acabd41f818" returned: 0 in 0.254s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:08 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-fc402106-50a7-4107-8404-de5454b98660 tempest-ProjectMemberTests-1556323482 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:12:08 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-fc402106-50a7-4107-8404-de5454b98660 tempest-ProjectMemberTests-1556323482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:12:08 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fc402106-50a7-4107-8404-de5454b98660 tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7a38fc9-8f34-4399-b2ad-4530da79ff89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fa6305a-f0a1-4e87-8056-6acabd41f818', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:12:08 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fc402106-50a7-4107-8404-de5454b98660 tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf0ab81f-9214-4820-a488-8ad4d205e3cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:12:08 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-fc402106-50a7-4107-8404-de5454b98660 tempest-ProjectMemberTests-1556323482 None] Volume volume-6fa6305a-f0a1-4e87-8056-6acabd41f818 (6fa6305a-f0a1-4e87-8056-6acabd41f818): created successfully Jul 30 17:12:08 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fc402106-50a7-4107-8404-de5454b98660 tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf0ab81f-9214-4820-a488-8ad4d205e3cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:12:08 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-fc402106-50a7-4107-8404-de5454b98660 tempest-ProjectMemberTests-1556323482 None] Flow 'volume_create_manager' (ab3005d8-584e-46af-beeb-10d0eb931e37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:12:08 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-fc402106-50a7-4107-8404-de5454b98660 tempest-ProjectMemberTests-1556323482 None] Created volume successfully. Jul 30 17:12:08 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-6a30f8c8-eaad-445d-abac-51557e7cd553 tempest-ProjectReaderTests-1506540965 None] Acquiring lock "cinder-80d84754-c01c-4c25-a335-8a12e5a04ad8-delete_snapshot" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:12:08 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-6a30f8c8-eaad-445d-abac-51557e7cd553 tempest-ProjectReaderTests-1506540965 None] Lock "cinder-80d84754-c01c-4c25-a335-8a12e5a04ad8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:12:08 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-6a30f8c8-eaad-445d-abac-51557e7cd553 tempest-ProjectReaderTests-1506540965 None] Acquiring lock "cinder-quobyte-7daa3132-8601-4b17-b9bb-2904056689cf" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:12:08 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-6a30f8c8-eaad-445d-abac-51557e7cd553 tempest-ProjectReaderTests-1506540965 None] Lock "cinder-quobyte-7daa3132-8601-4b17-b9bb-2904056689cf" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:12:08 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-6a30f8c8-eaad-445d-abac-51557e7cd553 tempest-ProjectReaderTests-1506540965 None] Acquiring lock "cinder-quobyte-80d84754-c01c-4c25-a335-8a12e5a04ad8" by "_delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:12:08 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-6a30f8c8-eaad-445d-abac-51557e7cd553 tempest-ProjectReaderTests-1506540965 None] Lock "cinder-quobyte-80d84754-c01c-4c25-a335-8a12e5a04ad8" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:12:08 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-6a30f8c8-eaad-445d-abac-51557e7cd553 tempest-ProjectReaderTests-1506540965 None] Deleting offline snapshot 80d84754-c01c-4c25-a335-8a12e5a04ad8 of volume 7daa3132-8601-4b17-b9bb-2904056689cf {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:12:08 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-6a30f8c8-eaad-445d-abac-51557e7cd553 tempest-ProjectReaderTests-1506540965 None] snapshot_file for this snap is: volume-7daa3132-8601-4b17-b9bb-2904056689cf.80d84754-c01c-4c25-a335-8a12e5a04ad8 {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:12:08 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5971418-bf83-40a2-8bc8-f65d46d54e5c]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:12:08 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-6a30f8c8-eaad-445d-abac-51557e7cd553 tempest-ProjectReaderTests-1506540965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7daa3132-8601-4b17-b9bb-2904056689cf.80d84754-c01c-4c25-a335-8a12e5a04ad8 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:08 devstack sudo[109320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7daa3132-8601-4b17-b9bb-2904056689cf.80d84754-c01c-4c25-a335-8a12e5a04ad8 Jul 30 17:12:08 devstack sudo[109320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:09 devstack sudo[109320]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:09 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-6a30f8c8-eaad-445d-abac-51557e7cd553 tempest-ProjectReaderTests-1506540965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7daa3132-8601-4b17-b9bb-2904056689cf.80d84754-c01c-4c25-a335-8a12e5a04ad8" returned: 0 in 0.382s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:09 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-6a30f8c8-eaad-445d-abac-51557e7cd553 tempest-ProjectReaderTests-1506540965 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7daa3132-8601-4b17-b9bb-2904056689cf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:12:09 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[002cc82b-5c4d-42f6-9f48-4f72d122d4b9]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:12:09 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-6a30f8c8-eaad-445d-abac-51557e7cd553 tempest-ProjectReaderTests-1506540965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7daa3132-8601-4b17-b9bb-2904056689cf {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:09 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-8fe63ea0-3b86-402a-b0c1-fd3166458f4f tempest-ProjectMemberTests-1556323482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:12:09 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-8fe63ea0-3b86-402a-b0c1-fd3166458f4f tempest-ProjectMemberTests-1556323482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:12:09 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-8fe63ea0-3b86-402a-b0c1-fd3166458f4f tempest-ProjectMemberTests-1556323482 None] Creating offline snapshot b665299d-3a69-4e32-9a68-bbd32acabe60 of volume 6fa6305a-f0a1-4e87-8056-6acabd41f818 {{(pid=88568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:12:09 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[c41c826e-1b7b-4087-a4e9-4d8a0b82c1cc]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:12:09 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8fe63ea0-3b86-402a-b0c1-fd3166458f4f tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6fa6305a-f0a1-4e87-8056-6acabd41f818 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:09 devstack sudo[109325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7daa3132-8601-4b17-b9bb-2904056689cf Jul 30 17:12:09 devstack sudo[109325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:09 devstack sudo[109326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6fa6305a-f0a1-4e87-8056-6acabd41f818 Jul 30 17:12:09 devstack sudo[109326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:09 devstack sudo[109325]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:09 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-6a30f8c8-eaad-445d-abac-51557e7cd553 tempest-ProjectReaderTests-1506540965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7daa3132-8601-4b17-b9bb-2904056689cf" returned: 0 in 0.370s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:09 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-6a30f8c8-eaad-445d-abac-51557e7cd553 tempest-ProjectReaderTests-1506540965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7daa3132-8601-4b17-b9bb-2904056689cf.80d84754-c01c-4c25-a335-8a12e5a04ad8 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:09 devstack sudo[109334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7daa3132-8601-4b17-b9bb-2904056689cf.80d84754-c01c-4c25-a335-8a12e5a04ad8 Jul 30 17:12:09 devstack sudo[109334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:09 devstack sudo[109326]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:09 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8fe63ea0-3b86-402a-b0c1-fd3166458f4f tempest-ProjectMemberTests-1556323482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6fa6305a-f0a1-4e87-8056-6acabd41f818" returned: 0 in 0.377s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:09 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8fe63ea0-3b86-402a-b0c1-fd3166458f4f tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6fa6305a-f0a1-4e87-8056-6acabd41f818,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6fa6305a-f0a1-4e87-8056-6acabd41f818.b665299d-3a69-4e32-9a68-bbd32acabe60 1G {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:09 devstack sudo[109337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6fa6305a-f0a1-4e87-8056-6acabd41f818,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6fa6305a-f0a1-4e87-8056-6acabd41f818.b665299d-3a69-4e32-9a68-bbd32acabe60 1G Jul 30 17:12:09 devstack sudo[109337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:10 devstack sudo[109334]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:10 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-6a30f8c8-eaad-445d-abac-51557e7cd553 tempest-ProjectReaderTests-1506540965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7daa3132-8601-4b17-b9bb-2904056689cf.80d84754-c01c-4c25-a335-8a12e5a04ad8" returned: 0 in 0.341s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:10 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-6a30f8c8-eaad-445d-abac-51557e7cd553 tempest-ProjectReaderTests-1506540965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7daa3132-8601-4b17-b9bb-2904056689cf.80d84754-c01c-4c25-a335-8a12e5a04ad8 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:10 devstack sudo[109345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7daa3132-8601-4b17-b9bb-2904056689cf.80d84754-c01c-4c25-a335-8a12e5a04ad8 Jul 30 17:12:10 devstack sudo[109345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:10 devstack sudo[109337]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:10 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8fe63ea0-3b86-402a-b0c1-fd3166458f4f tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6fa6305a-f0a1-4e87-8056-6acabd41f818,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6fa6305a-f0a1-4e87-8056-6acabd41f818.b665299d-3a69-4e32-9a68-bbd32acabe60 1G" returned: 0 in 0.427s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:10 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8fe63ea0-3b86-402a-b0c1-fd3166458f4f tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fa6305a-f0a1-4e87-8056-6acabd41f818 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6fa6305a-f0a1-4e87-8056-6acabd41f818.b665299d-3a69-4e32-9a68-bbd32acabe60 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:10 devstack sudo[109349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fa6305a-f0a1-4e87-8056-6acabd41f818 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6fa6305a-f0a1-4e87-8056-6acabd41f818.b665299d-3a69-4e32-9a68-bbd32acabe60 Jul 30 17:12:10 devstack sudo[109349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:10 devstack sudo[109345]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:10 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-6a30f8c8-eaad-445d-abac-51557e7cd553 tempest-ProjectReaderTests-1506540965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7daa3132-8601-4b17-b9bb-2904056689cf.80d84754-c01c-4c25-a335-8a12e5a04ad8" returned: 0 in 0.255s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:10 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-6a30f8c8-eaad-445d-abac-51557e7cd553 tempest-ProjectReaderTests-1506540965 None] Lock "cinder-quobyte-80d84754-c01c-4c25-a335-8a12e5a04ad8" released by "_delete_snapshot" :: held 1.460s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:12:10 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-6a30f8c8-eaad-445d-abac-51557e7cd553 tempest-ProjectReaderTests-1506540965 None] Lock "cinder-quobyte-7daa3132-8601-4b17-b9bb-2904056689cf" released by "delete_snapshot" :: held 1.484s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:12:10 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-6a30f8c8-eaad-445d-abac-51557e7cd553 tempest-ProjectReaderTests-1506540965 None] Created reservations ['e08e7651-609c-4f20-8284-d3de21b5d133', 'a8e6d211-6f7d-45fd-a402-4b9bbf721cdf', 'bc06fa0c-b685-47ec-8df1-861412697cd0', '2fcc2613-118a-44c8-9846-20a6b98c23a9'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:12:10 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-6a30f8c8-eaad-445d-abac-51557e7cd553 tempest-ProjectReaderTests-1506540965 None] Delete snapshot completed successfully. Jul 30 17:12:10 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-6a30f8c8-eaad-445d-abac-51557e7cd553 tempest-ProjectReaderTests-1506540965 None] Lock "cinder-80d84754-c01c-4c25-a335-8a12e5a04ad8-delete_snapshot" released by "delete_snapshot" :: held 1.627s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:12:10 devstack sudo[109349]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:10 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8fe63ea0-3b86-402a-b0c1-fd3166458f4f tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fa6305a-f0a1-4e87-8056-6acabd41f818 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6fa6305a-f0a1-4e87-8056-6acabd41f818.b665299d-3a69-4e32-9a68-bbd32acabe60" returned: 0 in 0.307s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:10 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-8fe63ea0-3b86-402a-b0c1-fd3166458f4f tempest-ProjectMemberTests-1556323482 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6fa6305a-f0a1-4e87-8056-6acabd41f818.b665299d-3a69-4e32-9a68-bbd32acabe60 is being set with open permissions: ugo+rw Jul 30 17:12:10 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8fe63ea0-3b86-402a-b0c1-fd3166458f4f tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6fa6305a-f0a1-4e87-8056-6acabd41f818.b665299d-3a69-4e32-9a68-bbd32acabe60 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:10 devstack sudo[109355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6fa6305a-f0a1-4e87-8056-6acabd41f818.b665299d-3a69-4e32-9a68-bbd32acabe60 Jul 30 17:12:10 devstack sudo[109355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:10 devstack sudo[109355]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:10 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8fe63ea0-3b86-402a-b0c1-fd3166458f4f tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6fa6305a-f0a1-4e87-8056-6acabd41f818.b665299d-3a69-4e32-9a68-bbd32acabe60" returned: 0 in 0.247s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:10 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8fe63ea0-3b86-402a-b0c1-fd3166458f4f tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6fa6305a-f0a1-4e87-8056-6acabd41f818.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:10 devstack sudo[109358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6fa6305a-f0a1-4e87-8056-6acabd41f818.info Jul 30 17:12:10 devstack sudo[109358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:10 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-8d219436-e8d7-4096-b42d-6805bcf6e0f2 tempest-ProjectReaderTests-1506540965 None] Acquiring lock "cinder-7daa3132-8601-4b17-b9bb-2904056689cf-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:12:10 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-8d219436-e8d7-4096-b42d-6805bcf6e0f2 tempest-ProjectReaderTests-1506540965 None] Lock "cinder-7daa3132-8601-4b17-b9bb-2904056689cf-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:12:11 devstack sudo[109358]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8fe63ea0-3b86-402a-b0c1-fd3166458f4f tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6fa6305a-f0a1-4e87-8056-6acabd41f818.info" returned: 0 in 0.279s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:11 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-8fe63ea0-3b86-402a-b0c1-fd3166458f4f tempest-ProjectMemberTests-1556323482 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6fa6305a-f0a1-4e87-8056-6acabd41f818.info is being set with open permissions: ugo+rw Jul 30 17:12:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8fe63ea0-3b86-402a-b0c1-fd3166458f4f tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6fa6305a-f0a1-4e87-8056-6acabd41f818.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:11 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-8d219436-e8d7-4096-b42d-6805bcf6e0f2 tempest-ProjectReaderTests-1506540965 None] Acquiring lock "cinder-quobyte-7daa3132-8601-4b17-b9bb-2904056689cf" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:12:11 devstack sudo[109361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6fa6305a-f0a1-4e87-8056-6acabd41f818.info Jul 30 17:12:11 devstack sudo[109361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:11 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-8d219436-e8d7-4096-b42d-6805bcf6e0f2 tempest-ProjectReaderTests-1506540965 None] Lock "cinder-quobyte-7daa3132-8601-4b17-b9bb-2904056689cf" acquired by "delete_volume" :: waited 0.017s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:12:11 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[30762045-7686-4085-84ef-3f02f4139ea6]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:12:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8d219436-e8d7-4096-b42d-6805bcf6e0f2 tempest-ProjectReaderTests-1506540965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7daa3132-8601-4b17-b9bb-2904056689cf {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:11 devstack sudo[109363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7daa3132-8601-4b17-b9bb-2904056689cf Jul 30 17:12:11 devstack sudo[109363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:11 devstack sudo[109361]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8fe63ea0-3b86-402a-b0c1-fd3166458f4f tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6fa6305a-f0a1-4e87-8056-6acabd41f818.info" returned: 0 in 0.274s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-8fe63ea0-3b86-402a-b0c1-fd3166458f4f tempest-ProjectMemberTests-1556323482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.996s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:12:11 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-8fe63ea0-3b86-402a-b0c1-fd3166458f4f tempest-ProjectMemberTests-1556323482 None] Create snapshot completed successfully Jul 30 17:12:11 devstack sudo[109363]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8d219436-e8d7-4096-b42d-6805bcf6e0f2 tempest-ProjectReaderTests-1506540965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7daa3132-8601-4b17-b9bb-2904056689cf" returned: 0 in 0.393s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8d219436-e8d7-4096-b42d-6805bcf6e0f2 tempest-ProjectReaderTests-1506540965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7daa3132-8601-4b17-b9bb-2904056689cf {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:11 devstack sudo[109370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7daa3132-8601-4b17-b9bb-2904056689cf Jul 30 17:12:11 devstack sudo[109370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:11 devstack sudo[109370]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8d219436-e8d7-4096-b42d-6805bcf6e0f2 tempest-ProjectReaderTests-1506540965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7daa3132-8601-4b17-b9bb-2904056689cf" returned: 0 in 0.245s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:11 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-8d219436-e8d7-4096-b42d-6805bcf6e0f2 tempest-ProjectReaderTests-1506540965 None] Lock "cinder-quobyte-7daa3132-8601-4b17-b9bb-2904056689cf" released by "delete_volume" :: held 0.707s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:12:11 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-8d219436-e8d7-4096-b42d-6805bcf6e0f2 tempest-ProjectReaderTests-1506540965 None] Created reservations ['6898bf76-35ef-48b5-b148-a447db074542', 'cfbc111f-5c20-4aa7-bb26-e362b9ab696d', '37637c97-c50a-4761-83b3-7c77f2dbda70', 'f2727201-654d-4297-b5fb-8914bf79576e'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:12:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-8d219436-e8d7-4096-b42d-6805bcf6e0f2 tempest-ProjectReaderTests-1506540965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:12:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-8d219436-e8d7-4096-b42d-6805bcf6e0f2 tempest-ProjectReaderTests-1506540965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:12:11 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-8d219436-e8d7-4096-b42d-6805bcf6e0f2 tempest-ProjectReaderTests-1506540965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:12:11 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-8d219436-e8d7-4096-b42d-6805bcf6e0f2 tempest-ProjectReaderTests-1506540965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:12:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-8d219436-e8d7-4096-b42d-6805bcf6e0f2 tempest-ProjectReaderTests-1506540965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:12:11 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8d219436-e8d7-4096-b42d-6805bcf6e0f2 tempest-ProjectReaderTests-1506540965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:11 devstack sudo[109373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:12:11 devstack sudo[109373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:12 devstack sudo[109373]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-8d219436-e8d7-4096-b42d-6805bcf6e0f2 tempest-ProjectReaderTests-1506540965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.265s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:12 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-8d219436-e8d7-4096-b42d-6805bcf6e0f2 tempest-ProjectReaderTests-1506540965 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:12:12 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-8d219436-e8d7-4096-b42d-6805bcf6e0f2 tempest-ProjectReaderTests-1506540965 None] Deleted volume successfully. Jul 30 17:12:12 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-8d219436-e8d7-4096-b42d-6805bcf6e0f2 tempest-ProjectReaderTests-1506540965 None] Lock "cinder-7daa3132-8601-4b17-b9bb-2904056689cf-delete_volume" released by "delete_volume" :: held 1.193s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:12:12 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-68035f84-8a91-4cdd-ab1d-1be7a65e3f39 tempest-ProjectMemberTests-1556323482 None] Acquiring lock "cinder-b665299d-3a69-4e32-9a68-bbd32acabe60-delete_snapshot" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:12:12 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-68035f84-8a91-4cdd-ab1d-1be7a65e3f39 tempest-ProjectMemberTests-1556323482 None] Lock "cinder-b665299d-3a69-4e32-9a68-bbd32acabe60-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:12:12 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-68035f84-8a91-4cdd-ab1d-1be7a65e3f39 tempest-ProjectMemberTests-1556323482 None] Acquiring lock "cinder-quobyte-6fa6305a-f0a1-4e87-8056-6acabd41f818" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:12:12 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-68035f84-8a91-4cdd-ab1d-1be7a65e3f39 tempest-ProjectMemberTests-1556323482 None] Lock "cinder-quobyte-6fa6305a-f0a1-4e87-8056-6acabd41f818" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:12:12 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-68035f84-8a91-4cdd-ab1d-1be7a65e3f39 tempest-ProjectMemberTests-1556323482 None] Acquiring lock "cinder-quobyte-b665299d-3a69-4e32-9a68-bbd32acabe60" by "_delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:12:12 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-68035f84-8a91-4cdd-ab1d-1be7a65e3f39 tempest-ProjectMemberTests-1556323482 None] Lock "cinder-quobyte-b665299d-3a69-4e32-9a68-bbd32acabe60" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:12:12 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-68035f84-8a91-4cdd-ab1d-1be7a65e3f39 tempest-ProjectMemberTests-1556323482 None] Deleting offline snapshot b665299d-3a69-4e32-9a68-bbd32acabe60 of volume 6fa6305a-f0a1-4e87-8056-6acabd41f818 {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:12:12 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-68035f84-8a91-4cdd-ab1d-1be7a65e3f39 tempest-ProjectMemberTests-1556323482 None] snapshot_file for this snap is: volume-6fa6305a-f0a1-4e87-8056-6acabd41f818.b665299d-3a69-4e32-9a68-bbd32acabe60 {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:12:12 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d602500-979a-49a7-a5be-184b840d4d13]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:12:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-68035f84-8a91-4cdd-ab1d-1be7a65e3f39 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6fa6305a-f0a1-4e87-8056-6acabd41f818.b665299d-3a69-4e32-9a68-bbd32acabe60 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:12 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ca9c342-3897-4eaf-9f34-9a3762744852 tempest-ProjectReaderTests-1506540965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:12:12 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-5ca9c342-3897-4eaf-9f34-9a3762744852 tempest-ProjectReaderTests-1506540965 None] Flow 'volume_create_manager' (9c32968e-f8a8-425f-a909-82ada6e054f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:12:12 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-5ca9c342-3897-4eaf-9f34-9a3762744852 tempest-ProjectReaderTests-1506540965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c6e7bc5-8483-4914-a09e-31be9ccf8aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:12:12 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-5ca9c342-3897-4eaf-9f34-9a3762744852 tempest-ProjectReaderTests-1506540965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c6e7bc5-8483-4914-a09e-31be9ccf8aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:12:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1173873587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b43a6925-4692-4605-984f-f2e6fa09ad0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d6f792b22ba46ca94d09af3b2157e87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:12:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:12:13Z,use_quota=True,user_id='32ed3c4f75834041b2773f0e7b64d007',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:12:12 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-5ca9c342-3897-4eaf-9f34-9a3762744852 tempest-ProjectReaderTests-1506540965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdfcdcc8-c85a-4994-88cd-23b9993a1568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:12:12 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-5ca9c342-3897-4eaf-9f34-9a3762744852 tempest-ProjectReaderTests-1506540965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdfcdcc8-c85a-4994-88cd-23b9993a1568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:12:12 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-5ca9c342-3897-4eaf-9f34-9a3762744852 tempest-ProjectReaderTests-1506540965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d235de22-5f6d-482f-85a4-92202d3bc00a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:12:12 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-5ca9c342-3897-4eaf-9f34-9a3762744852 tempest-ProjectReaderTests-1506540965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d235de22-5f6d-482f-85a4-92202d3bc00a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b43a6925-4692-4605-984f-f2e6fa09ad0b', 'volume_name': 'volume-b43a6925-4692-4605-984f-f2e6fa09ad0b', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:12:12 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-5ca9c342-3897-4eaf-9f34-9a3762744852 tempest-ProjectReaderTests-1506540965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (699dbf00-b578-4b8f-b022-309dffc27c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:12:12 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-5ca9c342-3897-4eaf-9f34-9a3762744852 tempest-ProjectReaderTests-1506540965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (699dbf00-b578-4b8f-b022-309dffc27c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:12:12 devstack sudo[109376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6fa6305a-f0a1-4e87-8056-6acabd41f818.b665299d-3a69-4e32-9a68-bbd32acabe60 Jul 30 17:12:12 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-5ca9c342-3897-4eaf-9f34-9a3762744852 tempest-ProjectReaderTests-1506540965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (220e3bcf-719e-44b8-8a76-95a944666cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:12:12 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-5ca9c342-3897-4eaf-9f34-9a3762744852 tempest-ProjectReaderTests-1506540965 None] Volume b43a6925-4692-4605-984f-f2e6fa09ad0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b43a6925-4692-4605-984f-f2e6fa09ad0b', 'volume_size': 1} Jul 30 17:12:12 devstack sudo[109376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-5ca9c342-3897-4eaf-9f34-9a3762744852 tempest-ProjectReaderTests-1506540965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:12:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-5ca9c342-3897-4eaf-9f34-9a3762744852 tempest-ProjectReaderTests-1506540965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:12:12 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-5ca9c342-3897-4eaf-9f34-9a3762744852 tempest-ProjectReaderTests-1506540965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:12:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1173873587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b43a6925-4692-4605-984f-f2e6fa09ad0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d6f792b22ba46ca94d09af3b2157e87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:12:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:12:13Z,use_quota=True,user_id='32ed3c4f75834041b2773f0e7b64d007',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:12:12 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-5ca9c342-3897-4eaf-9f34-9a3762744852 tempest-ProjectReaderTests-1506540965 None] Creating volume b43a6925-4692-4605-984f-f2e6fa09ad0b {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:12:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-5ca9c342-3897-4eaf-9f34-9a3762744852 tempest-ProjectReaderTests-1506540965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:12:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-5ca9c342-3897-4eaf-9f34-9a3762744852 tempest-ProjectReaderTests-1506540965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:12:12 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-5ca9c342-3897-4eaf-9f34-9a3762744852 tempest-ProjectReaderTests-1506540965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:12:12 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-5ca9c342-3897-4eaf-9f34-9a3762744852 tempest-ProjectReaderTests-1506540965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:12:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-5ca9c342-3897-4eaf-9f34-9a3762744852 tempest-ProjectReaderTests-1506540965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:12:12 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-5ca9c342-3897-4eaf-9f34-9a3762744852 tempest-ProjectReaderTests-1506540965 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:12:12 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-5ca9c342-3897-4eaf-9f34-9a3762744852 tempest-ProjectReaderTests-1506540965 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:12:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-5ca9c342-3897-4eaf-9f34-9a3762744852 tempest-ProjectReaderTests-1506540965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b43a6925-4692-4605-984f-f2e6fa09ad0b 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:12 devstack sudo[109380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b43a6925-4692-4605-984f-f2e6fa09ad0b 1073741824 Jul 30 17:12:12 devstack sudo[109380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:12 devstack sudo[109376]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-68035f84-8a91-4cdd-ab1d-1be7a65e3f39 tempest-ProjectMemberTests-1556323482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6fa6305a-f0a1-4e87-8056-6acabd41f818.b665299d-3a69-4e32-9a68-bbd32acabe60" returned: 0 in 0.366s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:12 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-68035f84-8a91-4cdd-ab1d-1be7a65e3f39 tempest-ProjectMemberTests-1556323482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6fa6305a-f0a1-4e87-8056-6acabd41f818(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:12:12 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e86265-44e5-465c-8a0f-24076c6851d9]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:12:12 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-68035f84-8a91-4cdd-ab1d-1be7a65e3f39 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6fa6305a-f0a1-4e87-8056-6acabd41f818 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:13 devstack sudo[109388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6fa6305a-f0a1-4e87-8056-6acabd41f818 Jul 30 17:12:13 devstack sudo[109388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:13 devstack sudo[109380]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-5ca9c342-3897-4eaf-9f34-9a3762744852 tempest-ProjectReaderTests-1506540965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b43a6925-4692-4605-984f-f2e6fa09ad0b 1073741824" returned: 0 in 0.436s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-5ca9c342-3897-4eaf-9f34-9a3762744852 tempest-ProjectReaderTests-1506540965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b43a6925-4692-4605-984f-f2e6fa09ad0b {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:13 devstack sudo[109390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b43a6925-4692-4605-984f-f2e6fa09ad0b Jul 30 17:12:13 devstack sudo[109390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:13 devstack sudo[109388]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-68035f84-8a91-4cdd-ab1d-1be7a65e3f39 tempest-ProjectMemberTests-1556323482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6fa6305a-f0a1-4e87-8056-6acabd41f818" returned: 0 in 0.393s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-68035f84-8a91-4cdd-ab1d-1be7a65e3f39 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6fa6305a-f0a1-4e87-8056-6acabd41f818.b665299d-3a69-4e32-9a68-bbd32acabe60 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:13 devstack sudo[109395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6fa6305a-f0a1-4e87-8056-6acabd41f818.b665299d-3a69-4e32-9a68-bbd32acabe60 Jul 30 17:12:13 devstack sudo[109395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:13 devstack sudo[109390]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-5ca9c342-3897-4eaf-9f34-9a3762744852 tempest-ProjectReaderTests-1506540965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b43a6925-4692-4605-984f-f2e6fa09ad0b" returned: 0 in 0.253s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:13 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-5ca9c342-3897-4eaf-9f34-9a3762744852 tempest-ProjectReaderTests-1506540965 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:12:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-5ca9c342-3897-4eaf-9f34-9a3762744852 tempest-ProjectReaderTests-1506540965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:12:13 devstack cinder-volume[88568]: DEBUG dbcounter [-] [88568] Writing DB stats cinder:SELECT=233,cinder:INSERT=69,cinder:UPDATE=286,cinder:DELETE=20 {{(pid=88568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 17:12:13 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-5ca9c342-3897-4eaf-9f34-9a3762744852 tempest-ProjectReaderTests-1506540965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (220e3bcf-719e-44b8-8a76-95a944666cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b43a6925-4692-4605-984f-f2e6fa09ad0b', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:12:13 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-5ca9c342-3897-4eaf-9f34-9a3762744852 tempest-ProjectReaderTests-1506540965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07ad1350-54af-4423-a79e-77d84e71ea1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:12:13 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-5ca9c342-3897-4eaf-9f34-9a3762744852 tempest-ProjectReaderTests-1506540965 None] Volume volume-b43a6925-4692-4605-984f-f2e6fa09ad0b (b43a6925-4692-4605-984f-f2e6fa09ad0b): created successfully Jul 30 17:12:13 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-5ca9c342-3897-4eaf-9f34-9a3762744852 tempest-ProjectReaderTests-1506540965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07ad1350-54af-4423-a79e-77d84e71ea1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:12:13 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-5ca9c342-3897-4eaf-9f34-9a3762744852 tempest-ProjectReaderTests-1506540965 None] Flow 'volume_create_manager' (9c32968e-f8a8-425f-a909-82ada6e054f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:12:13 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-5ca9c342-3897-4eaf-9f34-9a3762744852 tempest-ProjectReaderTests-1506540965 None] Created volume successfully. Jul 30 17:12:13 devstack sudo[109395]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:13 devstack cinder-volume[88568]: DEBUG dbcounter [-] [88568] Writing DB stats cinder:UPDATE=292,cinder:INSERT=83,cinder:SELECT=195,cinder:DELETE=29 {{(pid=88568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 17:12:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-68035f84-8a91-4cdd-ab1d-1be7a65e3f39 tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6fa6305a-f0a1-4e87-8056-6acabd41f818.b665299d-3a69-4e32-9a68-bbd32acabe60" returned: 0 in 0.401s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-68035f84-8a91-4cdd-ab1d-1be7a65e3f39 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6fa6305a-f0a1-4e87-8056-6acabd41f818.b665299d-3a69-4e32-9a68-bbd32acabe60 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-30bce40a-f3ae-4a0d-8490-f51094bbb5a5 tempest-ProjectReaderTests-1506540965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:12:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-30bce40a-f3ae-4a0d-8490-f51094bbb5a5 tempest-ProjectReaderTests-1506540965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:12:13 devstack sudo[109402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6fa6305a-f0a1-4e87-8056-6acabd41f818.b665299d-3a69-4e32-9a68-bbd32acabe60 Jul 30 17:12:13 devstack sudo[109402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:13 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-30bce40a-f3ae-4a0d-8490-f51094bbb5a5 tempest-ProjectReaderTests-1506540965 None] Creating offline snapshot 5518a903-5781-454e-bebd-82a5f73688dc of volume b43a6925-4692-4605-984f-f2e6fa09ad0b {{(pid=88568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:12:13 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dcab8fd-9bc3-4209-8fe6-e2e63fb122fe]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:12:13 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-30bce40a-f3ae-4a0d-8490-f51094bbb5a5 tempest-ProjectReaderTests-1506540965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b43a6925-4692-4605-984f-f2e6fa09ad0b {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:13 devstack sudo[109404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b43a6925-4692-4605-984f-f2e6fa09ad0b Jul 30 17:12:13 devstack sudo[109404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:14 devstack sudo[109402]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-68035f84-8a91-4cdd-ab1d-1be7a65e3f39 tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6fa6305a-f0a1-4e87-8056-6acabd41f818.b665299d-3a69-4e32-9a68-bbd32acabe60" returned: 0 in 0.275s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:14 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-68035f84-8a91-4cdd-ab1d-1be7a65e3f39 tempest-ProjectMemberTests-1556323482 None] Lock "cinder-quobyte-b665299d-3a69-4e32-9a68-bbd32acabe60" released by "_delete_snapshot" :: held 1.545s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:12:14 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-68035f84-8a91-4cdd-ab1d-1be7a65e3f39 tempest-ProjectMemberTests-1556323482 None] Lock "cinder-quobyte-6fa6305a-f0a1-4e87-8056-6acabd41f818" released by "delete_snapshot" :: held 1.571s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:12:14 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-68035f84-8a91-4cdd-ab1d-1be7a65e3f39 tempest-ProjectMemberTests-1556323482 None] Created reservations ['6e6cdd35-4156-4615-83b3-954bed9674ad', 'bbe00e45-9d54-46cf-9d7a-516b7415067c', '3356a1b2-4cc0-47c2-862f-407ff68b4d07', '9f645938-8112-4b9b-8101-2565793d9c5b'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:12:14 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-68035f84-8a91-4cdd-ab1d-1be7a65e3f39 tempest-ProjectMemberTests-1556323482 None] Delete snapshot completed successfully. Jul 30 17:12:14 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-68035f84-8a91-4cdd-ab1d-1be7a65e3f39 tempest-ProjectMemberTests-1556323482 None] Lock "cinder-b665299d-3a69-4e32-9a68-bbd32acabe60-delete_snapshot" released by "delete_snapshot" :: held 1.721s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:12:14 devstack sudo[109404]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-30bce40a-f3ae-4a0d-8490-f51094bbb5a5 tempest-ProjectReaderTests-1506540965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b43a6925-4692-4605-984f-f2e6fa09ad0b" returned: 0 in 0.393s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-30bce40a-f3ae-4a0d-8490-f51094bbb5a5 tempest-ProjectReaderTests-1506540965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b43a6925-4692-4605-984f-f2e6fa09ad0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b43a6925-4692-4605-984f-f2e6fa09ad0b.5518a903-5781-454e-bebd-82a5f73688dc 1G {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:14 devstack sudo[109410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b43a6925-4692-4605-984f-f2e6fa09ad0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b43a6925-4692-4605-984f-f2e6fa09ad0b.5518a903-5781-454e-bebd-82a5f73688dc 1G Jul 30 17:12:14 devstack sudo[109410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:14 devstack sudo[109410]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-30bce40a-f3ae-4a0d-8490-f51094bbb5a5 tempest-ProjectReaderTests-1506540965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b43a6925-4692-4605-984f-f2e6fa09ad0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b43a6925-4692-4605-984f-f2e6fa09ad0b.5518a903-5781-454e-bebd-82a5f73688dc 1G" returned: 0 in 0.404s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-30bce40a-f3ae-4a0d-8490-f51094bbb5a5 tempest-ProjectReaderTests-1506540965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b43a6925-4692-4605-984f-f2e6fa09ad0b -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b43a6925-4692-4605-984f-f2e6fa09ad0b.5518a903-5781-454e-bebd-82a5f73688dc {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:14 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-0a9203d4-be44-4251-b189-2bdd2baca400 tempest-ProjectMemberTests-1556323482 None] Acquiring lock "cinder-6fa6305a-f0a1-4e87-8056-6acabd41f818-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:12:14 devstack sudo[109416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b43a6925-4692-4605-984f-f2e6fa09ad0b -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b43a6925-4692-4605-984f-f2e6fa09ad0b.5518a903-5781-454e-bebd-82a5f73688dc Jul 30 17:12:14 devstack sudo[109416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:14 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-0a9203d4-be44-4251-b189-2bdd2baca400 tempest-ProjectMemberTests-1556323482 None] Lock "cinder-6fa6305a-f0a1-4e87-8056-6acabd41f818-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:12:14 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-0a9203d4-be44-4251-b189-2bdd2baca400 tempest-ProjectMemberTests-1556323482 None] Acquiring lock "cinder-quobyte-6fa6305a-f0a1-4e87-8056-6acabd41f818" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:12:14 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-0a9203d4-be44-4251-b189-2bdd2baca400 tempest-ProjectMemberTests-1556323482 None] Lock "cinder-quobyte-6fa6305a-f0a1-4e87-8056-6acabd41f818" acquired by "delete_volume" :: waited 0.018s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:12:14 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be79d5c-47ec-41cd-a83d-e273654858a1]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:12:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0a9203d4-be44-4251-b189-2bdd2baca400 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6fa6305a-f0a1-4e87-8056-6acabd41f818 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:14 devstack sudo[109418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6fa6305a-f0a1-4e87-8056-6acabd41f818 Jul 30 17:12:14 devstack sudo[109418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:14 devstack sudo[109416]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-30bce40a-f3ae-4a0d-8490-f51094bbb5a5 tempest-ProjectReaderTests-1506540965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b43a6925-4692-4605-984f-f2e6fa09ad0b -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b43a6925-4692-4605-984f-f2e6fa09ad0b.5518a903-5781-454e-bebd-82a5f73688dc" returned: 0 in 0.338s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:14 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-30bce40a-f3ae-4a0d-8490-f51094bbb5a5 tempest-ProjectReaderTests-1506540965 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b43a6925-4692-4605-984f-f2e6fa09ad0b.5518a903-5781-454e-bebd-82a5f73688dc is being set with open permissions: ugo+rw Jul 30 17:12:14 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-30bce40a-f3ae-4a0d-8490-f51094bbb5a5 tempest-ProjectReaderTests-1506540965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b43a6925-4692-4605-984f-f2e6fa09ad0b.5518a903-5781-454e-bebd-82a5f73688dc {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:15 devstack sudo[109423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b43a6925-4692-4605-984f-f2e6fa09ad0b.5518a903-5781-454e-bebd-82a5f73688dc Jul 30 17:12:15 devstack sudo[109423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:15 devstack sudo[109418]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:15 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0a9203d4-be44-4251-b189-2bdd2baca400 tempest-ProjectMemberTests-1556323482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6fa6305a-f0a1-4e87-8056-6acabd41f818" returned: 0 in 0.392s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:15 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0a9203d4-be44-4251-b189-2bdd2baca400 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6fa6305a-f0a1-4e87-8056-6acabd41f818 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:15 devstack sudo[109429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6fa6305a-f0a1-4e87-8056-6acabd41f818 Jul 30 17:12:15 devstack sudo[109429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:15 devstack sudo[109423]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:15 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-30bce40a-f3ae-4a0d-8490-f51094bbb5a5 tempest-ProjectReaderTests-1506540965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b43a6925-4692-4605-984f-f2e6fa09ad0b.5518a903-5781-454e-bebd-82a5f73688dc" returned: 0 in 0.277s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:15 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-30bce40a-f3ae-4a0d-8490-f51094bbb5a5 tempest-ProjectReaderTests-1506540965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b43a6925-4692-4605-984f-f2e6fa09ad0b.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:15 devstack sudo[109432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b43a6925-4692-4605-984f-f2e6fa09ad0b.info Jul 30 17:12:15 devstack sudo[109432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:15 devstack sudo[109429]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:15 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0a9203d4-be44-4251-b189-2bdd2baca400 tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6fa6305a-f0a1-4e87-8056-6acabd41f818" returned: 0 in 0.255s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:15 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-0a9203d4-be44-4251-b189-2bdd2baca400 tempest-ProjectMemberTests-1556323482 None] Lock "cinder-quobyte-6fa6305a-f0a1-4e87-8056-6acabd41f818" released by "delete_volume" :: held 0.709s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:12:15 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-0a9203d4-be44-4251-b189-2bdd2baca400 tempest-ProjectMemberTests-1556323482 None] Created reservations ['2fdb3f17-9b8f-491a-bf7f-7a3c4a42f7b5', '6b7b79d9-d6dc-49b0-8565-6e189232c508', 'c0b8b403-c619-4654-80a4-dd9b9e8c2b12', '84cd96e5-fe94-4adc-91ed-8d7ecd219d3d'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:12:15 devstack sudo[109432]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:15 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-30bce40a-f3ae-4a0d-8490-f51094bbb5a5 tempest-ProjectReaderTests-1506540965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b43a6925-4692-4605-984f-f2e6fa09ad0b.info" returned: 0 in 0.249s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:15 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-30bce40a-f3ae-4a0d-8490-f51094bbb5a5 tempest-ProjectReaderTests-1506540965 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b43a6925-4692-4605-984f-f2e6fa09ad0b.info is being set with open permissions: ugo+rw Jul 30 17:12:15 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-30bce40a-f3ae-4a0d-8490-f51094bbb5a5 tempest-ProjectReaderTests-1506540965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b43a6925-4692-4605-984f-f2e6fa09ad0b.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:15 devstack sudo[109436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b43a6925-4692-4605-984f-f2e6fa09ad0b.info Jul 30 17:12:15 devstack sudo[109436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:15 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-0a9203d4-be44-4251-b189-2bdd2baca400 tempest-ProjectMemberTests-1556323482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:12:15 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-0a9203d4-be44-4251-b189-2bdd2baca400 tempest-ProjectMemberTests-1556323482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:12:15 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-0a9203d4-be44-4251-b189-2bdd2baca400 tempest-ProjectMemberTests-1556323482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:12:15 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-0a9203d4-be44-4251-b189-2bdd2baca400 tempest-ProjectMemberTests-1556323482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:12:15 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-0a9203d4-be44-4251-b189-2bdd2baca400 tempest-ProjectMemberTests-1556323482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:12:15 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0a9203d4-be44-4251-b189-2bdd2baca400 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:15 devstack sudo[109438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:12:15 devstack sudo[109438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:15 devstack sudo[109436]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:15 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-30bce40a-f3ae-4a0d-8490-f51094bbb5a5 tempest-ProjectReaderTests-1506540965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b43a6925-4692-4605-984f-f2e6fa09ad0b.info" returned: 0 in 0.268s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:15 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-30bce40a-f3ae-4a0d-8490-f51094bbb5a5 tempest-ProjectReaderTests-1506540965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.028s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:12:15 devstack sudo[109438]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:15 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0a9203d4-be44-4251-b189-2bdd2baca400 tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.278s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:15 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-0a9203d4-be44-4251-b189-2bdd2baca400 tempest-ProjectMemberTests-1556323482 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:12:15 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-0a9203d4-be44-4251-b189-2bdd2baca400 tempest-ProjectMemberTests-1556323482 None] Deleted volume successfully. Jul 30 17:12:15 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-30bce40a-f3ae-4a0d-8490-f51094bbb5a5 tempest-ProjectReaderTests-1506540965 None] Create snapshot completed successfully Jul 30 17:12:15 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-0a9203d4-be44-4251-b189-2bdd2baca400 tempest-ProjectMemberTests-1556323482 None] Lock "cinder-6fa6305a-f0a1-4e87-8056-6acabd41f818-delete_volume" released by "delete_volume" :: held 1.217s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:12:16 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-7386019a-c192-4968-b6e8-289b6147bebd tempest-ProjectMemberTests-1556323482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:12:16 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7386019a-c192-4968-b6e8-289b6147bebd tempest-ProjectMemberTests-1556323482 None] Flow 'volume_create_manager' (fea5f6c3-c9af-4a28-8685-09dacf1dc004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:12:16 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7386019a-c192-4968-b6e8-289b6147bebd tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (478be70b-a7dd-4d83-a1d9-c85baa041ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:12:16 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7386019a-c192-4968-b6e8-289b6147bebd tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (478be70b-a7dd-4d83-a1d9-c85baa041ca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:12:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-384138570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6639649b-5895-40f0-9504-08f07079b761,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72a0b0e3a199416698115290d71c6808',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:12:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:12:16Z,use_quota=True,user_id='8f2d7aa2b6ab4865b626b01a01acc0f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:12:16 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7386019a-c192-4968-b6e8-289b6147bebd tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61a4df89-6acd-4174-8bd8-61af6e0f6a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:12:16 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7386019a-c192-4968-b6e8-289b6147bebd tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61a4df89-6acd-4174-8bd8-61af6e0f6a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:12:16 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7386019a-c192-4968-b6e8-289b6147bebd tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6486935f-ffcb-4a15-9a63-7f07f77bc627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:12:16 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7386019a-c192-4968-b6e8-289b6147bebd tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6486935f-ffcb-4a15-9a63-7f07f77bc627) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6639649b-5895-40f0-9504-08f07079b761', 'volume_name': 'volume-6639649b-5895-40f0-9504-08f07079b761', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:12:16 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7386019a-c192-4968-b6e8-289b6147bebd tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93710bce-26a9-4f61-97ff-8554fef0ebac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:12:16 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7386019a-c192-4968-b6e8-289b6147bebd tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93710bce-26a9-4f61-97ff-8554fef0ebac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:12:16 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7386019a-c192-4968-b6e8-289b6147bebd tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e344eb69-2938-4c30-9c2d-d21d62e2ff62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:12:16 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-7386019a-c192-4968-b6e8-289b6147bebd tempest-ProjectMemberTests-1556323482 None] Volume 6639649b-5895-40f0-9504-08f07079b761: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6639649b-5895-40f0-9504-08f07079b761', 'volume_size': 1} Jul 30 17:12:16 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-7386019a-c192-4968-b6e8-289b6147bebd tempest-ProjectMemberTests-1556323482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:12:16 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-7386019a-c192-4968-b6e8-289b6147bebd tempest-ProjectMemberTests-1556323482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:12:16 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-7386019a-c192-4968-b6e8-289b6147bebd tempest-ProjectMemberTests-1556323482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:12:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-384138570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6639649b-5895-40f0-9504-08f07079b761,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72a0b0e3a199416698115290d71c6808',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:12:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:12:16Z,use_quota=True,user_id='8f2d7aa2b6ab4865b626b01a01acc0f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:12:16 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-7386019a-c192-4968-b6e8-289b6147bebd tempest-ProjectMemberTests-1556323482 None] Creating volume 6639649b-5895-40f0-9504-08f07079b761 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:12:16 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-7386019a-c192-4968-b6e8-289b6147bebd tempest-ProjectMemberTests-1556323482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:12:16 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-7386019a-c192-4968-b6e8-289b6147bebd tempest-ProjectMemberTests-1556323482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:12:16 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-7386019a-c192-4968-b6e8-289b6147bebd tempest-ProjectMemberTests-1556323482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:12:16 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-7386019a-c192-4968-b6e8-289b6147bebd tempest-ProjectMemberTests-1556323482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:12:16 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-7386019a-c192-4968-b6e8-289b6147bebd tempest-ProjectMemberTests-1556323482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:12:16 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-7386019a-c192-4968-b6e8-289b6147bebd tempest-ProjectMemberTests-1556323482 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:12:16 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-7386019a-c192-4968-b6e8-289b6147bebd tempest-ProjectMemberTests-1556323482 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:12:16 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7386019a-c192-4968-b6e8-289b6147bebd tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6639649b-5895-40f0-9504-08f07079b761 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:16 devstack sudo[109442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6639649b-5895-40f0-9504-08f07079b761 1073741824 Jul 30 17:12:16 devstack sudo[109442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:16 devstack sudo[109442]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:16 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7386019a-c192-4968-b6e8-289b6147bebd tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6639649b-5895-40f0-9504-08f07079b761 1073741824" returned: 0 in 0.396s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:16 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7386019a-c192-4968-b6e8-289b6147bebd tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6639649b-5895-40f0-9504-08f07079b761 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:16 devstack sudo[109448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6639649b-5895-40f0-9504-08f07079b761 Jul 30 17:12:16 devstack sudo[109448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:16 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-0355958b-af2a-4a4d-b74e-93d082b7b90d tempest-ProjectReaderTests-1506540965 None] Acquiring lock "cinder-5518a903-5781-454e-bebd-82a5f73688dc-delete_snapshot" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:12:16 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-0355958b-af2a-4a4d-b74e-93d082b7b90d tempest-ProjectReaderTests-1506540965 None] Lock "cinder-5518a903-5781-454e-bebd-82a5f73688dc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:12:16 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-0355958b-af2a-4a4d-b74e-93d082b7b90d tempest-ProjectReaderTests-1506540965 None] Acquiring lock "cinder-quobyte-b43a6925-4692-4605-984f-f2e6fa09ad0b" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:12:17 devstack sudo[109448]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-7386019a-c192-4968-b6e8-289b6147bebd tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6639649b-5895-40f0-9504-08f07079b761" returned: 0 in 0.262s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:17 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-7386019a-c192-4968-b6e8-289b6147bebd tempest-ProjectMemberTests-1556323482 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:12:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-7386019a-c192-4968-b6e8-289b6147bebd tempest-ProjectMemberTests-1556323482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.703s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:12:17 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-0355958b-af2a-4a4d-b74e-93d082b7b90d tempest-ProjectReaderTests-1506540965 None] Lock "cinder-quobyte-b43a6925-4692-4605-984f-f2e6fa09ad0b" acquired by "delete_snapshot" :: waited 0.066s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:12:17 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-0355958b-af2a-4a4d-b74e-93d082b7b90d tempest-ProjectReaderTests-1506540965 None] Acquiring lock "cinder-quobyte-5518a903-5781-454e-bebd-82a5f73688dc" by "_delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:12:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7386019a-c192-4968-b6e8-289b6147bebd tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e344eb69-2938-4c30-9c2d-d21d62e2ff62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6639649b-5895-40f0-9504-08f07079b761', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:12:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7386019a-c192-4968-b6e8-289b6147bebd tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5281581-8121-43bb-aa6e-ca5534662416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:12:17 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-0355958b-af2a-4a4d-b74e-93d082b7b90d tempest-ProjectReaderTests-1506540965 None] Lock "cinder-quobyte-5518a903-5781-454e-bebd-82a5f73688dc" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:12:17 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-0355958b-af2a-4a4d-b74e-93d082b7b90d tempest-ProjectReaderTests-1506540965 None] Deleting offline snapshot 5518a903-5781-454e-bebd-82a5f73688dc of volume b43a6925-4692-4605-984f-f2e6fa09ad0b {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:12:17 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-0355958b-af2a-4a4d-b74e-93d082b7b90d tempest-ProjectReaderTests-1506540965 None] snapshot_file for this snap is: volume-b43a6925-4692-4605-984f-f2e6fa09ad0b.5518a903-5781-454e-bebd-82a5f73688dc {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:12:17 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-7386019a-c192-4968-b6e8-289b6147bebd tempest-ProjectMemberTests-1556323482 None] Volume volume-6639649b-5895-40f0-9504-08f07079b761 (6639649b-5895-40f0-9504-08f07079b761): created successfully Jul 30 17:12:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7386019a-c192-4968-b6e8-289b6147bebd tempest-ProjectMemberTests-1556323482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5281581-8121-43bb-aa6e-ca5534662416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:12:17 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-7386019a-c192-4968-b6e8-289b6147bebd tempest-ProjectMemberTests-1556323482 None] Flow 'volume_create_manager' (fea5f6c3-c9af-4a28-8685-09dacf1dc004) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:12:17 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cca60c2-884f-4377-9c64-5dba1feaf9ff]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:12:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0355958b-af2a-4a4d-b74e-93d082b7b90d tempest-ProjectReaderTests-1506540965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b43a6925-4692-4605-984f-f2e6fa09ad0b.5518a903-5781-454e-bebd-82a5f73688dc {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:17 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-7386019a-c192-4968-b6e8-289b6147bebd tempest-ProjectMemberTests-1556323482 None] Created volume successfully. Jul 30 17:12:17 devstack sudo[109451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b43a6925-4692-4605-984f-f2e6fa09ad0b.5518a903-5781-454e-bebd-82a5f73688dc Jul 30 17:12:17 devstack sudo[109451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-4029be2f-0e1c-43e8-ae90-07ef636346f3 tempest-ProjectMemberTests-1556323482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:12:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-4029be2f-0e1c-43e8-ae90-07ef636346f3 tempest-ProjectMemberTests-1556323482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:12:17 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-4029be2f-0e1c-43e8-ae90-07ef636346f3 tempest-ProjectMemberTests-1556323482 None] Creating offline snapshot 3af48a01-6a40-4c4a-b772-28c036267460 of volume 6639649b-5895-40f0-9504-08f07079b761 {{(pid=88568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:12:17 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7528bad-75a4-454e-911f-42a91ca7a436]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:12:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-4029be2f-0e1c-43e8-ae90-07ef636346f3 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6639649b-5895-40f0-9504-08f07079b761 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:17 devstack sudo[109451]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0355958b-af2a-4a4d-b74e-93d082b7b90d tempest-ProjectReaderTests-1506540965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b43a6925-4692-4605-984f-f2e6fa09ad0b.5518a903-5781-454e-bebd-82a5f73688dc" returned: 0 in 0.380s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:17 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-0355958b-af2a-4a4d-b74e-93d082b7b90d tempest-ProjectReaderTests-1506540965 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b43a6925-4692-4605-984f-f2e6fa09ad0b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:12:17 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[122dc224-3490-4d3b-a4da-e3c70f26f61e]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:12:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0355958b-af2a-4a4d-b74e-93d082b7b90d tempest-ProjectReaderTests-1506540965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b43a6925-4692-4605-984f-f2e6fa09ad0b {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:17 devstack sudo[109456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6639649b-5895-40f0-9504-08f07079b761 Jul 30 17:12:17 devstack sudo[109456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:17 devstack sudo[109457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b43a6925-4692-4605-984f-f2e6fa09ad0b Jul 30 17:12:17 devstack sudo[109457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:17 devstack sudo[109456]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-4029be2f-0e1c-43e8-ae90-07ef636346f3 tempest-ProjectMemberTests-1556323482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6639649b-5895-40f0-9504-08f07079b761" returned: 0 in 0.354s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-4029be2f-0e1c-43e8-ae90-07ef636346f3 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6639649b-5895-40f0-9504-08f07079b761,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6639649b-5895-40f0-9504-08f07079b761.3af48a01-6a40-4c4a-b772-28c036267460 1G {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:17 devstack sudo[109465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6639649b-5895-40f0-9504-08f07079b761,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6639649b-5895-40f0-9504-08f07079b761.3af48a01-6a40-4c4a-b772-28c036267460 1G Jul 30 17:12:17 devstack sudo[109465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:17 devstack sudo[109457]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0355958b-af2a-4a4d-b74e-93d082b7b90d tempest-ProjectReaderTests-1506540965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b43a6925-4692-4605-984f-f2e6fa09ad0b" returned: 0 in 0.376s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:17 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0355958b-af2a-4a4d-b74e-93d082b7b90d tempest-ProjectReaderTests-1506540965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b43a6925-4692-4605-984f-f2e6fa09ad0b.5518a903-5781-454e-bebd-82a5f73688dc {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:17 devstack sudo[109468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b43a6925-4692-4605-984f-f2e6fa09ad0b.5518a903-5781-454e-bebd-82a5f73688dc Jul 30 17:12:17 devstack sudo[109468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:18 devstack sudo[109465]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-4029be2f-0e1c-43e8-ae90-07ef636346f3 tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6639649b-5895-40f0-9504-08f07079b761,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6639649b-5895-40f0-9504-08f07079b761.3af48a01-6a40-4c4a-b772-28c036267460 1G" returned: 0 in 0.396s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-4029be2f-0e1c-43e8-ae90-07ef636346f3 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6639649b-5895-40f0-9504-08f07079b761 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6639649b-5895-40f0-9504-08f07079b761.3af48a01-6a40-4c4a-b772-28c036267460 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:18 devstack sudo[109468]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0355958b-af2a-4a4d-b74e-93d082b7b90d tempest-ProjectReaderTests-1506540965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b43a6925-4692-4605-984f-f2e6fa09ad0b.5518a903-5781-454e-bebd-82a5f73688dc" returned: 0 in 0.337s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0355958b-af2a-4a4d-b74e-93d082b7b90d tempest-ProjectReaderTests-1506540965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b43a6925-4692-4605-984f-f2e6fa09ad0b.5518a903-5781-454e-bebd-82a5f73688dc {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:18 devstack sudo[109478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6639649b-5895-40f0-9504-08f07079b761 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6639649b-5895-40f0-9504-08f07079b761.3af48a01-6a40-4c4a-b772-28c036267460 Jul 30 17:12:18 devstack sudo[109478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:18 devstack sudo[109479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b43a6925-4692-4605-984f-f2e6fa09ad0b.5518a903-5781-454e-bebd-82a5f73688dc Jul 30 17:12:18 devstack sudo[109479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:18 devstack sudo[109479]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-0355958b-af2a-4a4d-b74e-93d082b7b90d tempest-ProjectReaderTests-1506540965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b43a6925-4692-4605-984f-f2e6fa09ad0b.5518a903-5781-454e-bebd-82a5f73688dc" returned: 0 in 0.257s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:18 devstack sudo[109478]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-4029be2f-0e1c-43e8-ae90-07ef636346f3 tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6639649b-5895-40f0-9504-08f07079b761 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6639649b-5895-40f0-9504-08f07079b761.3af48a01-6a40-4c4a-b772-28c036267460" returned: 0 in 0.300s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:18 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-4029be2f-0e1c-43e8-ae90-07ef636346f3 tempest-ProjectMemberTests-1556323482 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6639649b-5895-40f0-9504-08f07079b761.3af48a01-6a40-4c4a-b772-28c036267460 is being set with open permissions: ugo+rw Jul 30 17:12:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-4029be2f-0e1c-43e8-ae90-07ef636346f3 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6639649b-5895-40f0-9504-08f07079b761.3af48a01-6a40-4c4a-b772-28c036267460 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:18 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-0355958b-af2a-4a4d-b74e-93d082b7b90d tempest-ProjectReaderTests-1506540965 None] Lock "cinder-quobyte-5518a903-5781-454e-bebd-82a5f73688dc" released by "_delete_snapshot" :: held 1.474s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:12:18 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-0355958b-af2a-4a4d-b74e-93d082b7b90d tempest-ProjectReaderTests-1506540965 None] Lock "cinder-quobyte-b43a6925-4692-4605-984f-f2e6fa09ad0b" released by "delete_snapshot" :: held 1.513s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:12:18 devstack sudo[109486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6639649b-5895-40f0-9504-08f07079b761.3af48a01-6a40-4c4a-b772-28c036267460 Jul 30 17:12:18 devstack sudo[109486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:18 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-0355958b-af2a-4a4d-b74e-93d082b7b90d tempest-ProjectReaderTests-1506540965 None] Created reservations ['a50c3da3-6cb5-4b9c-aa34-7cda42c07a15', 'af4edef4-340b-4cec-a3c1-c43726b1a8c1', '5d7bf249-8db2-421b-8181-53110a7a160c', '2108d2c3-cfd0-459c-b59e-945cfc4e7426'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:12:18 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-0355958b-af2a-4a4d-b74e-93d082b7b90d tempest-ProjectReaderTests-1506540965 None] Delete snapshot completed successfully. Jul 30 17:12:18 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-0355958b-af2a-4a4d-b74e-93d082b7b90d tempest-ProjectReaderTests-1506540965 None] Lock "cinder-5518a903-5781-454e-bebd-82a5f73688dc-delete_snapshot" released by "delete_snapshot" :: held 1.696s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:12:18 devstack sudo[109486]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-4029be2f-0e1c-43e8-ae90-07ef636346f3 tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6639649b-5895-40f0-9504-08f07079b761.3af48a01-6a40-4c4a-b772-28c036267460" returned: 0 in 0.251s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:18 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-4029be2f-0e1c-43e8-ae90-07ef636346f3 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6639649b-5895-40f0-9504-08f07079b761.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:18 devstack sudo[109489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6639649b-5895-40f0-9504-08f07079b761.info Jul 30 17:12:18 devstack sudo[109489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:19 devstack sudo[109489]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:19 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-4029be2f-0e1c-43e8-ae90-07ef636346f3 tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6639649b-5895-40f0-9504-08f07079b761.info" returned: 0 in 0.254s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:19 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-4029be2f-0e1c-43e8-ae90-07ef636346f3 tempest-ProjectMemberTests-1556323482 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6639649b-5895-40f0-9504-08f07079b761.info is being set with open permissions: ugo+rw Jul 30 17:12:19 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-4029be2f-0e1c-43e8-ae90-07ef636346f3 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6639649b-5895-40f0-9504-08f07079b761.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:19 devstack sudo[109492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6639649b-5895-40f0-9504-08f07079b761.info Jul 30 17:12:19 devstack sudo[109492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:19 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-83117da0-c4f5-4007-9d32-5a88cb8e7215 tempest-ProjectReaderTests-1506540965 None] Acquiring lock "cinder-b43a6925-4692-4605-984f-f2e6fa09ad0b-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:12:19 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-83117da0-c4f5-4007-9d32-5a88cb8e7215 tempest-ProjectReaderTests-1506540965 None] Lock "cinder-b43a6925-4692-4605-984f-f2e6fa09ad0b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:12:19 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-83117da0-c4f5-4007-9d32-5a88cb8e7215 tempest-ProjectReaderTests-1506540965 None] Acquiring lock "cinder-quobyte-b43a6925-4692-4605-984f-f2e6fa09ad0b" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:12:19 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-83117da0-c4f5-4007-9d32-5a88cb8e7215 tempest-ProjectReaderTests-1506540965 None] Lock "cinder-quobyte-b43a6925-4692-4605-984f-f2e6fa09ad0b" acquired by "delete_volume" :: waited 0.018s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:12:19 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[957df574-ecdd-4dc1-8855-3a683fbea320]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:12:19 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-83117da0-c4f5-4007-9d32-5a88cb8e7215 tempest-ProjectReaderTests-1506540965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b43a6925-4692-4605-984f-f2e6fa09ad0b {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:19 devstack sudo[109492]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:19 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-4029be2f-0e1c-43e8-ae90-07ef636346f3 tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6639649b-5895-40f0-9504-08f07079b761.info" returned: 0 in 0.258s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:19 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-4029be2f-0e1c-43e8-ae90-07ef636346f3 tempest-ProjectMemberTests-1556323482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.890s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:12:19 devstack sudo[109494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b43a6925-4692-4605-984f-f2e6fa09ad0b Jul 30 17:12:19 devstack sudo[109494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:19 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-4029be2f-0e1c-43e8-ae90-07ef636346f3 tempest-ProjectMemberTests-1556323482 None] Create snapshot completed successfully Jul 30 17:12:19 devstack sudo[109494]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:19 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-83117da0-c4f5-4007-9d32-5a88cb8e7215 tempest-ProjectReaderTests-1506540965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b43a6925-4692-4605-984f-f2e6fa09ad0b" returned: 0 in 0.368s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:19 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-83117da0-c4f5-4007-9d32-5a88cb8e7215 tempest-ProjectReaderTests-1506540965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b43a6925-4692-4605-984f-f2e6fa09ad0b {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:19 devstack sudo[109500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b43a6925-4692-4605-984f-f2e6fa09ad0b Jul 30 17:12:19 devstack sudo[109500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:19 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-09e048f1-5dea-4ba8-b239-2d4c9f19d744 tempest-ProjectMemberTests-1556323482 None] Acquiring lock "cinder-3af48a01-6a40-4c4a-b772-28c036267460-delete_snapshot" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:12:19 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-09e048f1-5dea-4ba8-b239-2d4c9f19d744 tempest-ProjectMemberTests-1556323482 None] Lock "cinder-3af48a01-6a40-4c4a-b772-28c036267460-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:12:19 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-09e048f1-5dea-4ba8-b239-2d4c9f19d744 tempest-ProjectMemberTests-1556323482 None] Acquiring lock "cinder-quobyte-6639649b-5895-40f0-9504-08f07079b761" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:12:19 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-09e048f1-5dea-4ba8-b239-2d4c9f19d744 tempest-ProjectMemberTests-1556323482 None] Lock "cinder-quobyte-6639649b-5895-40f0-9504-08f07079b761" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:12:19 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-09e048f1-5dea-4ba8-b239-2d4c9f19d744 tempest-ProjectMemberTests-1556323482 None] Acquiring lock "cinder-quobyte-3af48a01-6a40-4c4a-b772-28c036267460" by "_delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:12:19 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-09e048f1-5dea-4ba8-b239-2d4c9f19d744 tempest-ProjectMemberTests-1556323482 None] Lock "cinder-quobyte-3af48a01-6a40-4c4a-b772-28c036267460" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:12:19 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-09e048f1-5dea-4ba8-b239-2d4c9f19d744 tempest-ProjectMemberTests-1556323482 None] Deleting offline snapshot 3af48a01-6a40-4c4a-b772-28c036267460 of volume 6639649b-5895-40f0-9504-08f07079b761 {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:12:19 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-09e048f1-5dea-4ba8-b239-2d4c9f19d744 tempest-ProjectMemberTests-1556323482 None] snapshot_file for this snap is: volume-6639649b-5895-40f0-9504-08f07079b761.3af48a01-6a40-4c4a-b772-28c036267460 {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:12:19 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2abbe00-dc29-4727-a3e2-5ca313697c26]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:12:19 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-09e048f1-5dea-4ba8-b239-2d4c9f19d744 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6639649b-5895-40f0-9504-08f07079b761.3af48a01-6a40-4c4a-b772-28c036267460 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:19 devstack sudo[109500]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:19 devstack sudo[109502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6639649b-5895-40f0-9504-08f07079b761.3af48a01-6a40-4c4a-b772-28c036267460 Jul 30 17:12:19 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-83117da0-c4f5-4007-9d32-5a88cb8e7215 tempest-ProjectReaderTests-1506540965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-b43a6925-4692-4605-984f-f2e6fa09ad0b" returned: 0 in 0.255s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:19 devstack sudo[109502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:19 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-83117da0-c4f5-4007-9d32-5a88cb8e7215 tempest-ProjectReaderTests-1506540965 None] Lock "cinder-quobyte-b43a6925-4692-4605-984f-f2e6fa09ad0b" released by "delete_volume" :: held 0.687s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:12:19 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-83117da0-c4f5-4007-9d32-5a88cb8e7215 tempest-ProjectReaderTests-1506540965 None] Created reservations ['1b8100da-ee3c-49cf-aa58-3ce1bfecc103', '8ed4de63-6039-4277-a71c-98d6839ae568', '064c58a1-f415-466e-8933-c580fca2cb73', '2f4ad3cc-f035-4251-b5db-ea93a93662d1'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:12:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-83117da0-c4f5-4007-9d32-5a88cb8e7215 tempest-ProjectReaderTests-1506540965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:12:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-83117da0-c4f5-4007-9d32-5a88cb8e7215 tempest-ProjectReaderTests-1506540965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:12:20 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-83117da0-c4f5-4007-9d32-5a88cb8e7215 tempest-ProjectReaderTests-1506540965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:12:20 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-83117da0-c4f5-4007-9d32-5a88cb8e7215 tempest-ProjectReaderTests-1506540965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:12:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-83117da0-c4f5-4007-9d32-5a88cb8e7215 tempest-ProjectReaderTests-1506540965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:12:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-83117da0-c4f5-4007-9d32-5a88cb8e7215 tempest-ProjectReaderTests-1506540965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:20 devstack sudo[109505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:12:20 devstack sudo[109505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:20 devstack sudo[109502]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-09e048f1-5dea-4ba8-b239-2d4c9f19d744 tempest-ProjectMemberTests-1556323482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6639649b-5895-40f0-9504-08f07079b761.3af48a01-6a40-4c4a-b772-28c036267460" returned: 0 in 0.364s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:20 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-09e048f1-5dea-4ba8-b239-2d4c9f19d744 tempest-ProjectMemberTests-1556323482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6639649b-5895-40f0-9504-08f07079b761(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:12:20 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[82313016-9468-416b-975a-8d14937cbabb]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:12:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-09e048f1-5dea-4ba8-b239-2d4c9f19d744 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6639649b-5895-40f0-9504-08f07079b761 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:20 devstack sudo[109510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6639649b-5895-40f0-9504-08f07079b761 Jul 30 17:12:20 devstack sudo[109510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:20 devstack sudo[109505]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-83117da0-c4f5-4007-9d32-5a88cb8e7215 tempest-ProjectReaderTests-1506540965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.287s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:20 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-83117da0-c4f5-4007-9d32-5a88cb8e7215 tempest-ProjectReaderTests-1506540965 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:12:20 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-83117da0-c4f5-4007-9d32-5a88cb8e7215 tempest-ProjectReaderTests-1506540965 None] Deleted volume successfully. Jul 30 17:12:20 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-83117da0-c4f5-4007-9d32-5a88cb8e7215 tempest-ProjectReaderTests-1506540965 None] Lock "cinder-b43a6925-4692-4605-984f-f2e6fa09ad0b-delete_volume" released by "delete_volume" :: held 1.184s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:12:20 devstack sudo[109510]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-09e048f1-5dea-4ba8-b239-2d4c9f19d744 tempest-ProjectMemberTests-1556323482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6639649b-5895-40f0-9504-08f07079b761" returned: 0 in 0.398s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-09e048f1-5dea-4ba8-b239-2d4c9f19d744 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6639649b-5895-40f0-9504-08f07079b761.3af48a01-6a40-4c4a-b772-28c036267460 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:20 devstack sudo[109517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6639649b-5895-40f0-9504-08f07079b761.3af48a01-6a40-4c4a-b772-28c036267460 Jul 30 17:12:20 devstack sudo[109517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:20 devstack sudo[109517]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-09e048f1-5dea-4ba8-b239-2d4c9f19d744 tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6639649b-5895-40f0-9504-08f07079b761.3af48a01-6a40-4c4a-b772-28c036267460" returned: 0 in 0.353s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:20 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-09e048f1-5dea-4ba8-b239-2d4c9f19d744 tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6639649b-5895-40f0-9504-08f07079b761.3af48a01-6a40-4c4a-b772-28c036267460 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:20 devstack sudo[109524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6639649b-5895-40f0-9504-08f07079b761.3af48a01-6a40-4c4a-b772-28c036267460 Jul 30 17:12:20 devstack sudo[109524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:21 devstack sudo[109524]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:21 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-09e048f1-5dea-4ba8-b239-2d4c9f19d744 tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6639649b-5895-40f0-9504-08f07079b761.3af48a01-6a40-4c4a-b772-28c036267460" returned: 0 in 0.256s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:21 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-09e048f1-5dea-4ba8-b239-2d4c9f19d744 tempest-ProjectMemberTests-1556323482 None] Lock "cinder-quobyte-3af48a01-6a40-4c4a-b772-28c036267460" released by "_delete_snapshot" :: held 1.476s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:12:21 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-09e048f1-5dea-4ba8-b239-2d4c9f19d744 tempest-ProjectMemberTests-1556323482 None] Lock "cinder-quobyte-6639649b-5895-40f0-9504-08f07079b761" released by "delete_snapshot" :: held 1.500s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:12:21 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-09e048f1-5dea-4ba8-b239-2d4c9f19d744 tempest-ProjectMemberTests-1556323482 None] Created reservations ['917c76c2-12da-419f-80d5-dd484a9ed171', '549e7025-f564-4304-a000-a37a2fe4c59e', 'f705a2e6-8156-40bf-91c4-aeb04d14a140', '61882c86-6a86-4c06-8403-7b4596ac160d'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:12:21 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-09e048f1-5dea-4ba8-b239-2d4c9f19d744 tempest-ProjectMemberTests-1556323482 None] Delete snapshot completed successfully. Jul 30 17:12:21 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-09e048f1-5dea-4ba8-b239-2d4c9f19d744 tempest-ProjectMemberTests-1556323482 None] Lock "cinder-3af48a01-6a40-4c4a-b772-28c036267460-delete_snapshot" released by "delete_snapshot" :: held 1.656s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:12:21 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-6aaee943-9032-43a4-b131-c7a20834409a tempest-ProjectMemberTests-1556323482 None] Acquiring lock "cinder-6639649b-5895-40f0-9504-08f07079b761-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:12:21 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-6aaee943-9032-43a4-b131-c7a20834409a tempest-ProjectMemberTests-1556323482 None] Lock "cinder-6639649b-5895-40f0-9504-08f07079b761-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:12:21 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-6aaee943-9032-43a4-b131-c7a20834409a tempest-ProjectMemberTests-1556323482 None] Acquiring lock "cinder-quobyte-6639649b-5895-40f0-9504-08f07079b761" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:12:21 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-6aaee943-9032-43a4-b131-c7a20834409a tempest-ProjectMemberTests-1556323482 None] Lock "cinder-quobyte-6639649b-5895-40f0-9504-08f07079b761" acquired by "delete_volume" :: waited 0.020s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:12:21 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f35562-3486-4341-8304-3d679acc0949]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:12:21 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-6aaee943-9032-43a4-b131-c7a20834409a tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6639649b-5895-40f0-9504-08f07079b761 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:22 devstack sudo[109528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6639649b-5895-40f0-9504-08f07079b761 Jul 30 17:12:22 devstack sudo[109528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:22 devstack sudo[109528]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:22 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-6aaee943-9032-43a4-b131-c7a20834409a tempest-ProjectMemberTests-1556323482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6639649b-5895-40f0-9504-08f07079b761" returned: 0 in 0.365s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:22 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-6aaee943-9032-43a4-b131-c7a20834409a tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6639649b-5895-40f0-9504-08f07079b761 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:22 devstack sudo[109533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6639649b-5895-40f0-9504-08f07079b761 Jul 30 17:12:22 devstack sudo[109533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:22 devstack sudo[109533]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:22 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-6aaee943-9032-43a4-b131-c7a20834409a tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-6639649b-5895-40f0-9504-08f07079b761" returned: 0 in 0.243s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:22 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-6aaee943-9032-43a4-b131-c7a20834409a tempest-ProjectMemberTests-1556323482 None] Lock "cinder-quobyte-6639649b-5895-40f0-9504-08f07079b761" released by "delete_volume" :: held 0.678s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:12:22 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-6aaee943-9032-43a4-b131-c7a20834409a tempest-ProjectMemberTests-1556323482 None] Created reservations ['2fe88300-cc91-4b24-9cb6-c61742bf7211', '4232b2f3-297f-477d-92c9-3830ff1e14c0', '739e4bff-0526-4831-9ff7-bcfbe482ed93', '009e41d6-1a2a-4315-a697-7e25ba94d811'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:12:22 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-6aaee943-9032-43a4-b131-c7a20834409a tempest-ProjectMemberTests-1556323482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:12:22 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-6aaee943-9032-43a4-b131-c7a20834409a tempest-ProjectMemberTests-1556323482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:12:22 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-6aaee943-9032-43a4-b131-c7a20834409a tempest-ProjectMemberTests-1556323482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:12:22 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-6aaee943-9032-43a4-b131-c7a20834409a tempest-ProjectMemberTests-1556323482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:12:22 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-6aaee943-9032-43a4-b131-c7a20834409a tempest-ProjectMemberTests-1556323482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:12:22 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-6aaee943-9032-43a4-b131-c7a20834409a tempest-ProjectMemberTests-1556323482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:22 devstack sudo[109536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:12:22 devstack sudo[109536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:23 devstack sudo[109536]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:23 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-6aaee943-9032-43a4-b131-c7a20834409a tempest-ProjectMemberTests-1556323482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.273s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:23 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-6aaee943-9032-43a4-b131-c7a20834409a tempest-ProjectMemberTests-1556323482 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:12:23 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-6aaee943-9032-43a4-b131-c7a20834409a tempest-ProjectMemberTests-1556323482 None] Deleted volume successfully. Jul 30 17:12:23 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-6aaee943-9032-43a4-b131-c7a20834409a tempest-ProjectMemberTests-1556323482 None] Lock "cinder-6639649b-5895-40f0-9504-08f07079b761-delete_volume" released by "delete_volume" :: held 1.176s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:12:32 devstack cinder-volume[88568]: DEBUG dbcounter [-] [88568] Writing DB stats cinder:SELECT=39,cinder:INSERT=12,cinder:UPDATE=48,cinder:DELETE=2 {{(pid=88568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 17:12:33 devstack cinder-volume[88568]: DEBUG dbcounter [-] [88568] Writing DB stats cinder:SELECT=32,cinder:INSERT=15,cinder:UPDATE=44,cinder:DELETE=4 {{(pid=88568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 17:12:52 devstack cinder-volume[88568]: DEBUG oslo_service.periodic_task [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 17:12:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:12:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:12:52 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:12:52 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:12:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:12:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:52 devstack sudo[109586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:12:52 devstack sudo[109586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:52 devstack sudo[109586]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:52 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.285s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:52 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:12:52 devstack cinder-volume[88568]: DEBUG oslo_service.periodic_task [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] Running periodic task VolumeManager._thread_info {{(pid=88568) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 17:12:52 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] thread count: 28 {{(pid=88568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 17:12:52 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-49618fd8-3e00-42f6-ae29-141e895c2581 None None] thread info: [<_MainThread(MainThread, started 127406866608256)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88568) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 17:12:54 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-d680c1e4-dea2-461d-afa3-f050406d170c tempest-SnapshotDependencyTests-1220441869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:12:54 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-d680c1e4-dea2-461d-afa3-f050406d170c tempest-SnapshotDependencyTests-1220441869 None] Flow 'volume_create_manager' (a29e2d32-8b32-4db4-93f6-afdb478723c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:12:54 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-d680c1e4-dea2-461d-afa3-f050406d170c tempest-SnapshotDependencyTests-1220441869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e893b5d-de7e-4c2b-8da2-e68bc7df930a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:12:54 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-d680c1e4-dea2-461d-afa3-f050406d170c tempest-SnapshotDependencyTests-1220441869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e893b5d-de7e-4c2b-8da2-e68bc7df930a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:12:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-645283776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d47f7072-1756-4a4c-8828-85514c4c6ba0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c540678e7ebe4b39b608975adcaba0ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:12:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:12:55Z,use_quota=True,user_id='52b5266ff7c9430b910fa39b217f0b84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:12:54 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-d680c1e4-dea2-461d-afa3-f050406d170c tempest-SnapshotDependencyTests-1220441869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe89b607-797b-4f21-a746-c3fdc5c290b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:12:54 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-d680c1e4-dea2-461d-afa3-f050406d170c tempest-SnapshotDependencyTests-1220441869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe89b607-797b-4f21-a746-c3fdc5c290b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:12:54 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-d680c1e4-dea2-461d-afa3-f050406d170c tempest-SnapshotDependencyTests-1220441869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d49c776-450f-40e3-aac5-9d6487fccf1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:12:54 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-d680c1e4-dea2-461d-afa3-f050406d170c tempest-SnapshotDependencyTests-1220441869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d49c776-450f-40e3-aac5-9d6487fccf1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd47f7072-1756-4a4c-8828-85514c4c6ba0', 'volume_name': 'volume-d47f7072-1756-4a4c-8828-85514c4c6ba0', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:12:54 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-d680c1e4-dea2-461d-afa3-f050406d170c tempest-SnapshotDependencyTests-1220441869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77f89dc3-725a-4c17-9b2f-38b738b00085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:12:54 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-d680c1e4-dea2-461d-afa3-f050406d170c tempest-SnapshotDependencyTests-1220441869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77f89dc3-725a-4c17-9b2f-38b738b00085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:12:54 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-d680c1e4-dea2-461d-afa3-f050406d170c tempest-SnapshotDependencyTests-1220441869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (987a0ec7-365e-44a4-85fb-573ce7681db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:12:54 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-d680c1e4-dea2-461d-afa3-f050406d170c tempest-SnapshotDependencyTests-1220441869 None] Volume d47f7072-1756-4a4c-8828-85514c4c6ba0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d47f7072-1756-4a4c-8828-85514c4c6ba0', 'volume_size': 1} Jul 30 17:12:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-d680c1e4-dea2-461d-afa3-f050406d170c tempest-SnapshotDependencyTests-1220441869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:12:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-d680c1e4-dea2-461d-afa3-f050406d170c tempest-SnapshotDependencyTests-1220441869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:12:54 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-d680c1e4-dea2-461d-afa3-f050406d170c tempest-SnapshotDependencyTests-1220441869 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:12:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-645283776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d47f7072-1756-4a4c-8828-85514c4c6ba0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c540678e7ebe4b39b608975adcaba0ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:12:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:12:55Z,use_quota=True,user_id='52b5266ff7c9430b910fa39b217f0b84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)}" {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:12:54 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-d680c1e4-dea2-461d-afa3-f050406d170c tempest-SnapshotDependencyTests-1220441869 None] Creating volume d47f7072-1756-4a4c-8828-85514c4c6ba0 {{(pid=88568) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:12:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-d680c1e4-dea2-461d-afa3-f050406d170c tempest-SnapshotDependencyTests-1220441869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:12:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-d680c1e4-dea2-461d-afa3-f050406d170c tempest-SnapshotDependencyTests-1220441869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:12:54 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-d680c1e4-dea2-461d-afa3-f050406d170c tempest-SnapshotDependencyTests-1220441869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:12:54 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-d680c1e4-dea2-461d-afa3-f050406d170c tempest-SnapshotDependencyTests-1220441869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:12:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-d680c1e4-dea2-461d-afa3-f050406d170c tempest-SnapshotDependencyTests-1220441869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:12:54 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-d680c1e4-dea2-461d-afa3-f050406d170c tempest-SnapshotDependencyTests-1220441869 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:12:54 devstack cinder-volume[88568]: INFO cinder.volume.drivers.remotefs [None req-d680c1e4-dea2-461d-afa3-f050406d170c tempest-SnapshotDependencyTests-1220441869 None] casted to osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 Jul 30 17:12:54 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d680c1e4-dea2-461d-afa3-f050406d170c tempest-SnapshotDependencyTests-1220441869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d47f7072-1756-4a4c-8828-85514c4c6ba0 1073741824 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:54 devstack sudo[109589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d47f7072-1756-4a4c-8828-85514c4c6ba0 1073741824 Jul 30 17:12:54 devstack sudo[109589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:55 devstack sudo[109589]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d680c1e4-dea2-461d-afa3-f050406d170c tempest-SnapshotDependencyTests-1220441869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d47f7072-1756-4a4c-8828-85514c4c6ba0 1073741824" returned: 0 in 0.428s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d680c1e4-dea2-461d-afa3-f050406d170c tempest-SnapshotDependencyTests-1220441869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d47f7072-1756-4a4c-8828-85514c4c6ba0 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:55 devstack sudo[109595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d47f7072-1756-4a4c-8828-85514c4c6ba0 Jul 30 17:12:55 devstack sudo[109595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:55 devstack sudo[109595]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d680c1e4-dea2-461d-afa3-f050406d170c tempest-SnapshotDependencyTests-1220441869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d47f7072-1756-4a4c-8828-85514c4c6ba0" returned: 0 in 0.249s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:55 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-d680c1e4-dea2-461d-afa3-f050406d170c tempest-SnapshotDependencyTests-1220441869 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'} {{(pid=88568) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:12:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-d680c1e4-dea2-461d-afa3-f050406d170c tempest-SnapshotDependencyTests-1220441869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:12:55 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-d680c1e4-dea2-461d-afa3-f050406d170c tempest-SnapshotDependencyTests-1220441869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (987a0ec7-365e-44a4-85fb-573ce7681db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d47f7072-1756-4a4c-8828-85514c4c6ba0', 'volume_size': 1}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:12:55 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-d680c1e4-dea2-461d-afa3-f050406d170c tempest-SnapshotDependencyTests-1220441869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1052416-a7a2-4fb8-b47a-4c4a9e86119d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:12:55 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-d680c1e4-dea2-461d-afa3-f050406d170c tempest-SnapshotDependencyTests-1220441869 None] Volume volume-d47f7072-1756-4a4c-8828-85514c4c6ba0 (d47f7072-1756-4a4c-8828-85514c4c6ba0): created successfully Jul 30 17:12:55 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-d680c1e4-dea2-461d-afa3-f050406d170c tempest-SnapshotDependencyTests-1220441869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1052416-a7a2-4fb8-b47a-4c4a9e86119d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:12:55 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-d680c1e4-dea2-461d-afa3-f050406d170c tempest-SnapshotDependencyTests-1220441869 None] Flow 'volume_create_manager' (a29e2d32-8b32-4db4-93f6-afdb478723c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:12:55 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-d680c1e4-dea2-461d-afa3-f050406d170c tempest-SnapshotDependencyTests-1220441869 None] Created volume successfully. Jul 30 17:12:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-2fe6e426-7838-4fc1-b223-67af4deb2371 tempest-SnapshotDependencyTests-1220441869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:12:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-2fe6e426-7838-4fc1-b223-67af4deb2371 tempest-SnapshotDependencyTests-1220441869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:12:55 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-2fe6e426-7838-4fc1-b223-67af4deb2371 tempest-SnapshotDependencyTests-1220441869 None] Creating offline snapshot b8229a50-a459-4522-8368-f0ab552fc403 of volume d47f7072-1756-4a4c-8828-85514c4c6ba0 {{(pid=88568) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:12:55 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[111859d8-ac36-4b51-a140-ecf276535398]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:12:55 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2fe6e426-7838-4fc1-b223-67af4deb2371 tempest-SnapshotDependencyTests-1220441869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d47f7072-1756-4a4c-8828-85514c4c6ba0 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:56 devstack sudo[109598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d47f7072-1756-4a4c-8828-85514c4c6ba0 Jul 30 17:12:56 devstack sudo[109598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:56 devstack sudo[109598]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2fe6e426-7838-4fc1-b223-67af4deb2371 tempest-SnapshotDependencyTests-1220441869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d47f7072-1756-4a4c-8828-85514c4c6ba0" returned: 0 in 0.360s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2fe6e426-7838-4fc1-b223-67af4deb2371 tempest-SnapshotDependencyTests-1220441869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d47f7072-1756-4a4c-8828-85514c4c6ba0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d47f7072-1756-4a4c-8828-85514c4c6ba0.b8229a50-a459-4522-8368-f0ab552fc403 1G {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:56 devstack sudo[109603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d47f7072-1756-4a4c-8828-85514c4c6ba0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d47f7072-1756-4a4c-8828-85514c4c6ba0.b8229a50-a459-4522-8368-f0ab552fc403 1G Jul 30 17:12:56 devstack sudo[109603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:56 devstack sudo[109603]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2fe6e426-7838-4fc1-b223-67af4deb2371 tempest-SnapshotDependencyTests-1220441869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d47f7072-1756-4a4c-8828-85514c4c6ba0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d47f7072-1756-4a4c-8828-85514c4c6ba0.b8229a50-a459-4522-8368-f0ab552fc403 1G" returned: 0 in 0.392s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2fe6e426-7838-4fc1-b223-67af4deb2371 tempest-SnapshotDependencyTests-1220441869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d47f7072-1756-4a4c-8828-85514c4c6ba0 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d47f7072-1756-4a4c-8828-85514c4c6ba0.b8229a50-a459-4522-8368-f0ab552fc403 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:56 devstack sudo[109609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d47f7072-1756-4a4c-8828-85514c4c6ba0 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d47f7072-1756-4a4c-8828-85514c4c6ba0.b8229a50-a459-4522-8368-f0ab552fc403 Jul 30 17:12:56 devstack sudo[109609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:56 devstack sudo[109609]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2fe6e426-7838-4fc1-b223-67af4deb2371 tempest-SnapshotDependencyTests-1220441869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d47f7072-1756-4a4c-8828-85514c4c6ba0 -F qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d47f7072-1756-4a4c-8828-85514c4c6ba0.b8229a50-a459-4522-8368-f0ab552fc403" returned: 0 in 0.287s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:56 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-2fe6e426-7838-4fc1-b223-67af4deb2371 tempest-SnapshotDependencyTests-1220441869 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d47f7072-1756-4a4c-8828-85514c4c6ba0.b8229a50-a459-4522-8368-f0ab552fc403 is being set with open permissions: ugo+rw Jul 30 17:12:56 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2fe6e426-7838-4fc1-b223-67af4deb2371 tempest-SnapshotDependencyTests-1220441869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d47f7072-1756-4a4c-8828-85514c4c6ba0.b8229a50-a459-4522-8368-f0ab552fc403 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:56 devstack sudo[109614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d47f7072-1756-4a4c-8828-85514c4c6ba0.b8229a50-a459-4522-8368-f0ab552fc403 Jul 30 17:12:56 devstack sudo[109614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:57 devstack sudo[109614]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2fe6e426-7838-4fc1-b223-67af4deb2371 tempest-SnapshotDependencyTests-1220441869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d47f7072-1756-4a4c-8828-85514c4c6ba0.b8229a50-a459-4522-8368-f0ab552fc403" returned: 0 in 0.244s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2fe6e426-7838-4fc1-b223-67af4deb2371 tempest-SnapshotDependencyTests-1220441869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d47f7072-1756-4a4c-8828-85514c4c6ba0.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:57 devstack sudo[109617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d47f7072-1756-4a4c-8828-85514c4c6ba0.info Jul 30 17:12:57 devstack sudo[109617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:57 devstack sudo[109617]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2fe6e426-7838-4fc1-b223-67af4deb2371 tempest-SnapshotDependencyTests-1220441869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d47f7072-1756-4a4c-8828-85514c4c6ba0.info" returned: 0 in 0.242s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:57 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-2fe6e426-7838-4fc1-b223-67af4deb2371 tempest-SnapshotDependencyTests-1220441869 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d47f7072-1756-4a4c-8828-85514c4c6ba0.info is being set with open permissions: ugo+rw Jul 30 17:12:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2fe6e426-7838-4fc1-b223-67af4deb2371 tempest-SnapshotDependencyTests-1220441869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d47f7072-1756-4a4c-8828-85514c4c6ba0.info {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:57 devstack sudo[109620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d47f7072-1756-4a4c-8828-85514c4c6ba0.info Jul 30 17:12:57 devstack sudo[109620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:57 devstack sudo[109620]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-2fe6e426-7838-4fc1-b223-67af4deb2371 tempest-SnapshotDependencyTests-1220441869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d47f7072-1756-4a4c-8828-85514c4c6ba0.info" returned: 0 in 0.243s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:57 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-2fe6e426-7838-4fc1-b223-67af4deb2371 tempest-SnapshotDependencyTests-1220441869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.852s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:12:57 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-2fe6e426-7838-4fc1-b223-67af4deb2371 tempest-SnapshotDependencyTests-1220441869 None] Create snapshot completed successfully Jul 30 17:12:58 devstack cinder-volume[88568]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4d9eb90-bd78-4230-8910-039abe5ebbc0 tempest-SnapshotDependencyTests-1220441869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88568) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:12:58 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-d4d9eb90-bd78-4230-8910-039abe5ebbc0 tempest-SnapshotDependencyTests-1220441869 None] Flow 'volume_create_manager' (6a756707-ed30-40b1-b02a-75b0f101045b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:12:58 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-d4d9eb90-bd78-4230-8910-039abe5ebbc0 tempest-SnapshotDependencyTests-1220441869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f98c257-e948-4ee6-b13f-7b42da47a8a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:12:58 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-d4d9eb90-bd78-4230-8910-039abe5ebbc0 tempest-SnapshotDependencyTests-1220441869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f98c257-e948-4ee6-b13f-7b42da47a8a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:12:58Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e8a5cbc-5f11-4b02-931b-9e26966e6d0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c540678e7ebe4b39b608975adcaba0ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:12:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b8229a50-a459-4522-8368-f0ab552fc403,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:12:58Z,use_quota=True,user_id='52b5266ff7c9430b910fa39b217f0b84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(994db7c8-d8b0-4e75-bd17-508cb402a6ab),volume_type_id=994db7c8-d8b0-4e75-bd17-508cb402a6ab)' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:12:58 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-d4d9eb90-bd78-4230-8910-039abe5ebbc0 tempest-SnapshotDependencyTests-1220441869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95c8bdd8-8bee-4493-85f5-0c5d4825adea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:12:58 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-d4d9eb90-bd78-4230-8910-039abe5ebbc0 tempest-SnapshotDependencyTests-1220441869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95c8bdd8-8bee-4493-85f5-0c5d4825adea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:12:58 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-d4d9eb90-bd78-4230-8910-039abe5ebbc0 tempest-SnapshotDependencyTests-1220441869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69bbf01b-2ec0-417c-a853-b57c09b39d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:12:58 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-d4d9eb90-bd78-4230-8910-039abe5ebbc0 tempest-SnapshotDependencyTests-1220441869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69bbf01b-2ec0-417c-a853-b57c09b39d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7e8a5cbc-5f11-4b02-931b-9e26966e6d0b', 'volume_name': 'volume-7e8a5cbc-5f11-4b02-931b-9e26966e6d0b', 'volume_size': 1, 'snapshot_id': 'b8229a50-a459-4522-8368-f0ab552fc403'}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:12:58 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-d4d9eb90-bd78-4230-8910-039abe5ebbc0 tempest-SnapshotDependencyTests-1220441869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cff138d-d76f-4569-a18e-3cfc1cec5cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:12:58 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-d4d9eb90-bd78-4230-8910-039abe5ebbc0 tempest-SnapshotDependencyTests-1220441869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cff138d-d76f-4569-a18e-3cfc1cec5cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:12:58 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-d4d9eb90-bd78-4230-8910-039abe5ebbc0 tempest-SnapshotDependencyTests-1220441869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abe27707-389f-4066-82e5-7cc4d1217c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:12:58 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-d4d9eb90-bd78-4230-8910-039abe5ebbc0 tempest-SnapshotDependencyTests-1220441869 None] Volume 7e8a5cbc-5f11-4b02-931b-9e26966e6d0b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7e8a5cbc-5f11-4b02-931b-9e26966e6d0b', 'volume_size': 1, 'snapshot_id': 'b8229a50-a459-4522-8368-f0ab552fc403'} Jul 30 17:12:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-d4d9eb90-bd78-4230-8910-039abe5ebbc0 tempest-SnapshotDependencyTests-1220441869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:12:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-d4d9eb90-bd78-4230-8910-039abe5ebbc0 tempest-SnapshotDependencyTests-1220441869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:12:58 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-d4d9eb90-bd78-4230-8910-039abe5ebbc0 tempest-SnapshotDependencyTests-1220441869 None] Acquiring lock "cinder-quobyte-b8229a50-a459-4522-8368-f0ab552fc403-7e8a5cbc-5f11-4b02-931b-9e26966e6d0b" by "_create_volume_from_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:12:58 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-d4d9eb90-bd78-4230-8910-039abe5ebbc0 tempest-SnapshotDependencyTests-1220441869 None] Lock "cinder-quobyte-b8229a50-a459-4522-8368-f0ab552fc403-7e8a5cbc-5f11-4b02-931b-9e26966e6d0b" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:12:58 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-d4d9eb90-bd78-4230-8910-039abe5ebbc0 tempest-SnapshotDependencyTests-1220441869 None] Creating volume 7e8a5cbc-5f11-4b02-931b-9e26966e6d0b from snapshot b8229a50-a459-4522-8368-f0ab552fc403 {{(pid=88568) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 30 17:12:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-d4d9eb90-bd78-4230-8910-039abe5ebbc0 tempest-SnapshotDependencyTests-1220441869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:12:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-d4d9eb90-bd78-4230-8910-039abe5ebbc0 tempest-SnapshotDependencyTests-1220441869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:12:58 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-d4d9eb90-bd78-4230-8910-039abe5ebbc0 tempest-SnapshotDependencyTests-1220441869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:12:58 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-d4d9eb90-bd78-4230-8910-039abe5ebbc0 tempest-SnapshotDependencyTests-1220441869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:12:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-d4d9eb90-bd78-4230-8910-039abe5ebbc0 tempest-SnapshotDependencyTests-1220441869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:12:58 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-d4d9eb90-bd78-4230-8910-039abe5ebbc0 tempest-SnapshotDependencyTests-1220441869 None] Selected osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924 as target Quobyte volume. {{(pid=88568) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:12:58 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-d4d9eb90-bd78-4230-8910-039abe5ebbc0 tempest-SnapshotDependencyTests-1220441869 None] Acquiring lock "cinder-quobyte-7e8a5cbc-5f11-4b02-931b-9e26966e6d0b" by "_copy_volume_from_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:12:58 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-d4d9eb90-bd78-4230-8910-039abe5ebbc0 tempest-SnapshotDependencyTests-1220441869 None] Lock "cinder-quobyte-7e8a5cbc-5f11-4b02-931b-9e26966e6d0b" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:12:58 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-d4d9eb90-bd78-4230-8910-039abe5ebbc0 tempest-SnapshotDependencyTests-1220441869 None] snapshot: b8229a50-a459-4522-8368-f0ab552fc403, volume: 7e8a5cbc-5f11-4b02-931b-9e26966e6d0b, {{(pid=88568) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 30 17:12:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-d4d9eb90-bd78-4230-8910-039abe5ebbc0 tempest-SnapshotDependencyTests-1220441869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:12:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-d4d9eb90-bd78-4230-8910-039abe5ebbc0 tempest-SnapshotDependencyTests-1220441869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:12:58 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-d4d9eb90-bd78-4230-8910-039abe5ebbc0 tempest-SnapshotDependencyTests-1220441869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:12:58 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-d4d9eb90-bd78-4230-8910-039abe5ebbc0 tempest-SnapshotDependencyTests-1220441869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:12:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-d4d9eb90-bd78-4230-8910-039abe5ebbc0 tempest-SnapshotDependencyTests-1220441869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:12:58 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[6857f8fa-9cf4-47da-ab2e-211ee51aae36]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:12:58 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d4d9eb90-bd78-4230-8910-039abe5ebbc0 tempest-SnapshotDependencyTests-1220441869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d47f7072-1756-4a4c-8828-85514c4c6ba0.b8229a50-a459-4522-8368-f0ab552fc403 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:58 devstack sudo[109623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d47f7072-1756-4a4c-8828-85514c4c6ba0.b8229a50-a459-4522-8368-f0ab552fc403 Jul 30 17:12:58 devstack sudo[109623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:59 devstack sudo[109623]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d4d9eb90-bd78-4230-8910-039abe5ebbc0 tempest-SnapshotDependencyTests-1220441869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d47f7072-1756-4a4c-8828-85514c4c6ba0.b8229a50-a459-4522-8368-f0ab552fc403" returned: 0 in 0.371s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:59 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-d4d9eb90-bd78-4230-8910-039abe5ebbc0 tempest-SnapshotDependencyTests-1220441869 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d47f7072-1756-4a4c-8828-85514c4c6ba0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:12:59 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[f07f0349-6dc2-485a-b56b-b00cea9c44c7]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:12:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d4d9eb90-bd78-4230-8910-039abe5ebbc0 tempest-SnapshotDependencyTests-1220441869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d47f7072-1756-4a4c-8828-85514c4c6ba0 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:59 devstack sudo[109628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d47f7072-1756-4a4c-8828-85514c4c6ba0 Jul 30 17:12:59 devstack sudo[109628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:59 devstack sudo[109628]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d4d9eb90-bd78-4230-8910-039abe5ebbc0 tempest-SnapshotDependencyTests-1220441869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d47f7072-1756-4a4c-8828-85514c4c6ba0" returned: 0 in 0.358s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:59 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-d4d9eb90-bd78-4230-8910-039abe5ebbc0 tempest-SnapshotDependencyTests-1220441869 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d47f7072-1756-4a4c-8828-85514c4c6ba0 {{(pid=88568) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 30 17:12:59 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-d4d9eb90-bd78-4230-8910-039abe5ebbc0 tempest-SnapshotDependencyTests-1220441869 None] Creating direct copy from snapshot {{(pid=88568) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 30 17:12:59 devstack cinder-volume[88568]: DEBUG cinder.utils [None req-d4d9eb90-bd78-4230-8910-039abe5ebbc0 tempest-SnapshotDependencyTests-1220441869 None] Path /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7e8a5cbc-5f11-4b02-931b-9e26966e6d0b not found in is_blk_device check {{(pid=88568) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 30 17:12:59 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d4d9eb90-bd78-4230-8910-039abe5ebbc0 tempest-SnapshotDependencyTests-1220441869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d47f7072-1756-4a4c-8828-85514c4c6ba0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7e8a5cbc-5f11-4b02-931b-9e26966e6d0b {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:59 devstack sudo[109633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d47f7072-1756-4a4c-8828-85514c4c6ba0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7e8a5cbc-5f11-4b02-931b-9e26966e6d0b Jul 30 17:12:59 devstack sudo[109633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:13:03 devstack sudo[109633]: pam_unix(sudo:session): session closed for user root Jul 30 17:13:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d4d9eb90-bd78-4230-8910-039abe5ebbc0 tempest-SnapshotDependencyTests-1220441869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d47f7072-1756-4a4c-8828-85514c4c6ba0 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7e8a5cbc-5f11-4b02-931b-9e26966e6d0b" returned: 0 in 4.088s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:13:03 devstack cinder-volume[88568]: DEBUG cinder.image.image_utils [None req-d4d9eb90-bd78-4230-8910-039abe5ebbc0 tempest-SnapshotDependencyTests-1220441869 None] Image conversion details: src /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d47f7072-1756-4a4c-8828-85514c4c6ba0, size 1024.00 MB, duration 4.09 sec, destination /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7e8a5cbc-5f11-4b02-931b-9e26966e6d0b {{(pid=88568) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 17:13:03 devstack cinder-volume[88568]: INFO cinder.image.image_utils [None req-d4d9eb90-bd78-4230-8910-039abe5ebbc0 tempest-SnapshotDependencyTests-1220441869 None] Converted 1024.00 MB image at 250.42 MB/s Jul 30 17:13:03 devstack cinder-volume[88568]: WARNING cinder.volume.drivers.remotefs [None req-d4d9eb90-bd78-4230-8910-039abe5ebbc0 tempest-SnapshotDependencyTests-1220441869 None] /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7e8a5cbc-5f11-4b02-931b-9e26966e6d0b is being set with open permissions: ugo+rw Jul 30 17:13:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d4d9eb90-bd78-4230-8910-039abe5ebbc0 tempest-SnapshotDependencyTests-1220441869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7e8a5cbc-5f11-4b02-931b-9e26966e6d0b {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:13:03 devstack sudo[109646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7e8a5cbc-5f11-4b02-931b-9e26966e6d0b Jul 30 17:13:03 devstack sudo[109646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:13:03 devstack sudo[109646]: pam_unix(sudo:session): session closed for user root Jul 30 17:13:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-d4d9eb90-bd78-4230-8910-039abe5ebbc0 tempest-SnapshotDependencyTests-1220441869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7e8a5cbc-5f11-4b02-931b-9e26966e6d0b" returned: 0 in 0.241s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:13:03 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-d4d9eb90-bd78-4230-8910-039abe5ebbc0 tempest-SnapshotDependencyTests-1220441869 None] Lock "cinder-quobyte-7e8a5cbc-5f11-4b02-931b-9e26966e6d0b" released by "_copy_volume_from_snapshot" :: held 5.136s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:13:03 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-d4d9eb90-bd78-4230-8910-039abe5ebbc0 tempest-SnapshotDependencyTests-1220441869 None] Lock "cinder-quobyte-b8229a50-a459-4522-8368-f0ab552fc403-7e8a5cbc-5f11-4b02-931b-9e26966e6d0b" released by "_create_volume_from_snapshot" :: held 5.194s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:13:03 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-d4d9eb90-bd78-4230-8910-039abe5ebbc0 tempest-SnapshotDependencyTests-1220441869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.212s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:13:03 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-d4d9eb90-bd78-4230-8910-039abe5ebbc0 tempest-SnapshotDependencyTests-1220441869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abe27707-389f-4066-82e5-7cc4d1217c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e8a5cbc-5f11-4b02-931b-9e26966e6d0b', 'volume_size': 1, 'snapshot_id': 'b8229a50-a459-4522-8368-f0ab552fc403'}' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:13:03 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-d4d9eb90-bd78-4230-8910-039abe5ebbc0 tempest-SnapshotDependencyTests-1220441869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b609ed60-cf7d-4e17-aab9-2ad3a870b8a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:13:03 devstack cinder-volume[88568]: INFO cinder.volume.flows.manager.create_volume [None req-d4d9eb90-bd78-4230-8910-039abe5ebbc0 tempest-SnapshotDependencyTests-1220441869 None] Volume volume-7e8a5cbc-5f11-4b02-931b-9e26966e6d0b (7e8a5cbc-5f11-4b02-931b-9e26966e6d0b): created successfully Jul 30 17:13:03 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-d4d9eb90-bd78-4230-8910-039abe5ebbc0 tempest-SnapshotDependencyTests-1220441869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b609ed60-cf7d-4e17-aab9-2ad3a870b8a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88568) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:13:03 devstack cinder-volume[88568]: DEBUG cinder.volume.manager [None req-d4d9eb90-bd78-4230-8910-039abe5ebbc0 tempest-SnapshotDependencyTests-1220441869 None] Flow 'volume_create_manager' (6a756707-ed30-40b1-b02a-75b0f101045b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88568) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:13:03 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-d4d9eb90-bd78-4230-8910-039abe5ebbc0 tempest-SnapshotDependencyTests-1220441869 None] Created volume successfully. Jul 30 17:13:05 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-07909506-b353-454d-b53a-acf28ef081a6 tempest-SnapshotDependencyTests-1220441869 None] Acquiring lock "cinder-b8229a50-a459-4522-8368-f0ab552fc403-delete_snapshot" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:13:05 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-07909506-b353-454d-b53a-acf28ef081a6 tempest-SnapshotDependencyTests-1220441869 None] Lock "cinder-b8229a50-a459-4522-8368-f0ab552fc403-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:13:05 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-07909506-b353-454d-b53a-acf28ef081a6 tempest-SnapshotDependencyTests-1220441869 None] Acquiring lock "cinder-quobyte-d47f7072-1756-4a4c-8828-85514c4c6ba0" by "delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:13:05 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-07909506-b353-454d-b53a-acf28ef081a6 tempest-SnapshotDependencyTests-1220441869 None] Lock "cinder-quobyte-d47f7072-1756-4a4c-8828-85514c4c6ba0" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:13:05 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-07909506-b353-454d-b53a-acf28ef081a6 tempest-SnapshotDependencyTests-1220441869 None] Acquiring lock "cinder-quobyte-b8229a50-a459-4522-8368-f0ab552fc403" by "_delete_snapshot" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:13:05 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-07909506-b353-454d-b53a-acf28ef081a6 tempest-SnapshotDependencyTests-1220441869 None] Lock "cinder-quobyte-b8229a50-a459-4522-8368-f0ab552fc403" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:13:05 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-07909506-b353-454d-b53a-acf28ef081a6 tempest-SnapshotDependencyTests-1220441869 None] Deleting offline snapshot b8229a50-a459-4522-8368-f0ab552fc403 of volume d47f7072-1756-4a4c-8828-85514c4c6ba0 {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:13:05 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-07909506-b353-454d-b53a-acf28ef081a6 tempest-SnapshotDependencyTests-1220441869 None] snapshot_file for this snap is: volume-d47f7072-1756-4a4c-8828-85514c4c6ba0.b8229a50-a459-4522-8368-f0ab552fc403 {{(pid=88568) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:13:05 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ae965ac-a20f-44c6-b560-892c6e54337c]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:13:05 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-07909506-b353-454d-b53a-acf28ef081a6 tempest-SnapshotDependencyTests-1220441869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d47f7072-1756-4a4c-8828-85514c4c6ba0.b8229a50-a459-4522-8368-f0ab552fc403 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:13:05 devstack sudo[109650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d47f7072-1756-4a4c-8828-85514c4c6ba0.b8229a50-a459-4522-8368-f0ab552fc403 Jul 30 17:13:05 devstack sudo[109650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:13:05 devstack sudo[109650]: pam_unix(sudo:session): session closed for user root Jul 30 17:13:05 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-07909506-b353-454d-b53a-acf28ef081a6 tempest-SnapshotDependencyTests-1220441869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d47f7072-1756-4a4c-8828-85514c4c6ba0.b8229a50-a459-4522-8368-f0ab552fc403" returned: 0 in 0.345s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:13:05 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.remotefs [None req-07909506-b353-454d-b53a-acf28ef081a6 tempest-SnapshotDependencyTests-1220441869 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d47f7072-1756-4a4c-8828-85514c4c6ba0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88568) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:13:05 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[554d8c1f-3446-4e0e-abdb-f3598ed1137a]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:13:05 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-07909506-b353-454d-b53a-acf28ef081a6 tempest-SnapshotDependencyTests-1220441869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d47f7072-1756-4a4c-8828-85514c4c6ba0 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:13:05 devstack sudo[109655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d47f7072-1756-4a4c-8828-85514c4c6ba0 Jul 30 17:13:05 devstack sudo[109655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:13:06 devstack sudo[109655]: pam_unix(sudo:session): session closed for user root Jul 30 17:13:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-07909506-b353-454d-b53a-acf28ef081a6 tempest-SnapshotDependencyTests-1220441869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d47f7072-1756-4a4c-8828-85514c4c6ba0" returned: 0 in 0.508s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:13:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-07909506-b353-454d-b53a-acf28ef081a6 tempest-SnapshotDependencyTests-1220441869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d47f7072-1756-4a4c-8828-85514c4c6ba0.b8229a50-a459-4522-8368-f0ab552fc403 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:13:06 devstack sudo[109660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d47f7072-1756-4a4c-8828-85514c4c6ba0.b8229a50-a459-4522-8368-f0ab552fc403 Jul 30 17:13:06 devstack sudo[109660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:13:06 devstack sudo[109660]: pam_unix(sudo:session): session closed for user root Jul 30 17:13:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-07909506-b353-454d-b53a-acf28ef081a6 tempest-SnapshotDependencyTests-1220441869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d47f7072-1756-4a4c-8828-85514c4c6ba0.b8229a50-a459-4522-8368-f0ab552fc403" returned: 0 in 0.306s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:13:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-07909506-b353-454d-b53a-acf28ef081a6 tempest-SnapshotDependencyTests-1220441869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d47f7072-1756-4a4c-8828-85514c4c6ba0.b8229a50-a459-4522-8368-f0ab552fc403 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:13:06 devstack sudo[109665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d47f7072-1756-4a4c-8828-85514c4c6ba0.b8229a50-a459-4522-8368-f0ab552fc403 Jul 30 17:13:06 devstack sudo[109665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:13:06 devstack sudo[109665]: pam_unix(sudo:session): session closed for user root Jul 30 17:13:06 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-07909506-b353-454d-b53a-acf28ef081a6 tempest-SnapshotDependencyTests-1220441869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d47f7072-1756-4a4c-8828-85514c4c6ba0.b8229a50-a459-4522-8368-f0ab552fc403" returned: 0 in 0.233s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:13:06 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-07909506-b353-454d-b53a-acf28ef081a6 tempest-SnapshotDependencyTests-1220441869 None] Lock "cinder-quobyte-b8229a50-a459-4522-8368-f0ab552fc403" released by "_delete_snapshot" :: held 1.483s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:13:06 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-07909506-b353-454d-b53a-acf28ef081a6 tempest-SnapshotDependencyTests-1220441869 None] Lock "cinder-quobyte-d47f7072-1756-4a4c-8828-85514c4c6ba0" released by "delete_snapshot" :: held 1.504s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:13:06 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-07909506-b353-454d-b53a-acf28ef081a6 tempest-SnapshotDependencyTests-1220441869 None] Created reservations ['08414971-fb6e-4315-a576-0bf518e44e7c', '3f1acb6a-2b25-46c1-a26e-514a8bb1faaa', '1d5fd6af-6b83-498f-bc8f-36235c00d949', '12808dfe-639b-425f-a1f4-9339eb8006ba'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:13:06 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-07909506-b353-454d-b53a-acf28ef081a6 tempest-SnapshotDependencyTests-1220441869 None] Delete snapshot completed successfully. Jul 30 17:13:06 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-07909506-b353-454d-b53a-acf28ef081a6 tempest-SnapshotDependencyTests-1220441869 None] Lock "cinder-b8229a50-a459-4522-8368-f0ab552fc403-delete_snapshot" released by "delete_snapshot" :: held 1.642s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:13:07 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-aa7d54dd-46c2-497c-8aa0-235ab623f7d8 tempest-SnapshotDependencyTests-1220441869 None] Acquiring lock "cinder-d47f7072-1756-4a4c-8828-85514c4c6ba0-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:13:07 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-aa7d54dd-46c2-497c-8aa0-235ab623f7d8 tempest-SnapshotDependencyTests-1220441869 None] Lock "cinder-d47f7072-1756-4a4c-8828-85514c4c6ba0-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:13:07 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-aa7d54dd-46c2-497c-8aa0-235ab623f7d8 tempest-SnapshotDependencyTests-1220441869 None] Acquiring lock "cinder-quobyte-d47f7072-1756-4a4c-8828-85514c4c6ba0" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:13:07 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-aa7d54dd-46c2-497c-8aa0-235ab623f7d8 tempest-SnapshotDependencyTests-1220441869 None] Lock "cinder-quobyte-d47f7072-1756-4a4c-8828-85514c4c6ba0" acquired by "delete_volume" :: waited 0.016s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:13:07 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[b80164e7-5675-4b50-88a3-e609f282a16b]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:13:07 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-aa7d54dd-46c2-497c-8aa0-235ab623f7d8 tempest-SnapshotDependencyTests-1220441869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d47f7072-1756-4a4c-8828-85514c4c6ba0 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:13:07 devstack sudo[109668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d47f7072-1756-4a4c-8828-85514c4c6ba0 Jul 30 17:13:07 devstack sudo[109668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:13:07 devstack sudo[109668]: pam_unix(sudo:session): session closed for user root Jul 30 17:13:07 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-aa7d54dd-46c2-497c-8aa0-235ab623f7d8 tempest-SnapshotDependencyTests-1220441869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d47f7072-1756-4a4c-8828-85514c4c6ba0" returned: 0 in 0.353s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:13:07 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-aa7d54dd-46c2-497c-8aa0-235ab623f7d8 tempest-SnapshotDependencyTests-1220441869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d47f7072-1756-4a4c-8828-85514c4c6ba0 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:13:07 devstack sudo[109673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d47f7072-1756-4a4c-8828-85514c4c6ba0 Jul 30 17:13:07 devstack sudo[109673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:13:07 devstack sudo[109673]: pam_unix(sudo:session): session closed for user root Jul 30 17:13:07 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-aa7d54dd-46c2-497c-8aa0-235ab623f7d8 tempest-SnapshotDependencyTests-1220441869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-d47f7072-1756-4a4c-8828-85514c4c6ba0" returned: 0 in 0.236s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:13:07 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-aa7d54dd-46c2-497c-8aa0-235ab623f7d8 tempest-SnapshotDependencyTests-1220441869 None] Lock "cinder-quobyte-d47f7072-1756-4a4c-8828-85514c4c6ba0" released by "delete_volume" :: held 0.642s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:13:07 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-aa7d54dd-46c2-497c-8aa0-235ab623f7d8 tempest-SnapshotDependencyTests-1220441869 None] Created reservations ['c8fead15-fd7d-4b55-bd41-c7d1fc373945', '04d3dab5-89e9-4f3b-8941-e9a135126975', '81ef7946-62aa-41bd-9b93-d34c2a89ad96', '00a0d4b7-42d8-4eb0-9c68-b234bf131c88'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:13:08 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-aa7d54dd-46c2-497c-8aa0-235ab623f7d8 tempest-SnapshotDependencyTests-1220441869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:13:08 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-aa7d54dd-46c2-497c-8aa0-235ab623f7d8 tempest-SnapshotDependencyTests-1220441869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:13:08 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-aa7d54dd-46c2-497c-8aa0-235ab623f7d8 tempest-SnapshotDependencyTests-1220441869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:13:08 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-aa7d54dd-46c2-497c-8aa0-235ab623f7d8 tempest-SnapshotDependencyTests-1220441869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:13:08 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-aa7d54dd-46c2-497c-8aa0-235ab623f7d8 tempest-SnapshotDependencyTests-1220441869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:13:08 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-aa7d54dd-46c2-497c-8aa0-235ab623f7d8 tempest-SnapshotDependencyTests-1220441869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:13:08 devstack sudo[109676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:13:08 devstack sudo[109676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:13:08 devstack sudo[109676]: pam_unix(sudo:session): session closed for user root Jul 30 17:13:08 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-aa7d54dd-46c2-497c-8aa0-235ab623f7d8 tempest-SnapshotDependencyTests-1220441869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.247s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:13:08 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-aa7d54dd-46c2-497c-8aa0-235ab623f7d8 tempest-SnapshotDependencyTests-1220441869 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:13:08 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-aa7d54dd-46c2-497c-8aa0-235ab623f7d8 tempest-SnapshotDependencyTests-1220441869 None] Deleted volume successfully. Jul 30 17:13:08 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-aa7d54dd-46c2-497c-8aa0-235ab623f7d8 tempest-SnapshotDependencyTests-1220441869 None] Lock "cinder-d47f7072-1756-4a4c-8828-85514c4c6ba0-delete_volume" released by "delete_volume" :: held 1.073s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:13:08 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-4350bbd3-adad-457e-8a5d-a006350bb3e0 tempest-SnapshotDependencyTests-1220441869 None] Acquiring lock "cinder-7e8a5cbc-5f11-4b02-931b-9e26966e6d0b-delete_volume" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:13:08 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-4350bbd3-adad-457e-8a5d-a006350bb3e0 tempest-SnapshotDependencyTests-1220441869 None] Lock "cinder-7e8a5cbc-5f11-4b02-931b-9e26966e6d0b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:13:08 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-4350bbd3-adad-457e-8a5d-a006350bb3e0 tempest-SnapshotDependencyTests-1220441869 None] Acquiring lock "cinder-quobyte-7e8a5cbc-5f11-4b02-931b-9e26966e6d0b" by "delete_volume" {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:13:08 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-4350bbd3-adad-457e-8a5d-a006350bb3e0 tempest-SnapshotDependencyTests-1220441869 None] Lock "cinder-quobyte-7e8a5cbc-5f11-4b02-931b-9e26966e6d0b" acquired by "delete_volume" :: waited 0.014s {{(pid=88568) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:13:08 devstack cinder-volume[88568]: DEBUG oslo.privsep.daemon [-] privsep: reply[c402f11a-45c7-4493-bbda-13783e95daab]: (4, 'qcow2') {{(pid=89882) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:13:08 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-4350bbd3-adad-457e-8a5d-a006350bb3e0 tempest-SnapshotDependencyTests-1220441869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7e8a5cbc-5f11-4b02-931b-9e26966e6d0b {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:13:08 devstack sudo[109679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7e8a5cbc-5f11-4b02-931b-9e26966e6d0b Jul 30 17:13:08 devstack sudo[109679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:13:08 devstack sudo[109679]: pam_unix(sudo:session): session closed for user root Jul 30 17:13:08 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-4350bbd3-adad-457e-8a5d-a006350bb3e0 tempest-SnapshotDependencyTests-1220441869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7e8a5cbc-5f11-4b02-931b-9e26966e6d0b" returned: 0 in 0.358s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:13:08 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-4350bbd3-adad-457e-8a5d-a006350bb3e0 tempest-SnapshotDependencyTests-1220441869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7e8a5cbc-5f11-4b02-931b-9e26966e6d0b {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:13:08 devstack sudo[109684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7e8a5cbc-5f11-4b02-931b-9e26966e6d0b Jul 30 17:13:08 devstack sudo[109684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:13:09 devstack sudo[109684]: pam_unix(sudo:session): session closed for user root Jul 30 17:13:09 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-4350bbd3-adad-457e-8a5d-a006350bb3e0 tempest-SnapshotDependencyTests-1220441869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6/volume-7e8a5cbc-5f11-4b02-931b-9e26966e6d0b" returned: 0 in 0.237s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:13:09 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-4350bbd3-adad-457e-8a5d-a006350bb3e0 tempest-SnapshotDependencyTests-1220441869 None] Lock "cinder-quobyte-7e8a5cbc-5f11-4b02-931b-9e26966e6d0b" released by "delete_volume" :: held 0.630s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:13:09 devstack cinder-volume[88568]: DEBUG cinder.quota [None req-4350bbd3-adad-457e-8a5d-a006350bb3e0 tempest-SnapshotDependencyTests-1220441869 None] Created reservations ['c73a3b8a-3ea0-489a-b263-e4dc09ec8816', 'b54dd205-6b1f-492a-924b-3f1479698612', '099b9a20-3503-467a-b1b8-4ae65c12554e', '1f76c4fe-ef9c-4bf2-85e0-2efe0a3f32c5'] {{(pid=88568) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:13:09 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-4350bbd3-adad-457e-8a5d-a006350bb3e0 tempest-SnapshotDependencyTests-1220441869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:13:09 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-4350bbd3-adad-457e-8a5d-a006350bb3e0 tempest-SnapshotDependencyTests-1220441869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:13:09 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-4350bbd3-adad-457e-8a5d-a006350bb3e0 tempest-SnapshotDependencyTests-1220441869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924': None} {{(pid=88568) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:13:09 devstack cinder-volume[88568]: DEBUG cinder.volume.drivers.quobyte [None req-4350bbd3-adad-457e-8a5d-a006350bb3e0 tempest-SnapshotDependencyTests-1220441869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-93fe4e4a-8332-49b6-96cf-ad95563de924'] {{(pid=88568) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:13:09 devstack cinder-volume[88568]: DEBUG oslo_concurrency.lockutils [None req-4350bbd3-adad-457e-8a5d-a006350bb3e0 tempest-SnapshotDependencyTests-1220441869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88568) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:13:09 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-4350bbd3-adad-457e-8a5d-a006350bb3e0 tempest-SnapshotDependencyTests-1220441869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:13:09 devstack sudo[109687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6 Jul 30 17:13:09 devstack sudo[109687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:13:09 devstack sudo[109687]: pam_unix(sudo:session): session closed for user root Jul 30 17:13:09 devstack cinder-volume[88568]: DEBUG oslo_concurrency.processutils [None req-4350bbd3-adad-457e-8a5d-a006350bb3e0 tempest-SnapshotDependencyTests-1220441869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb5b9553c53ead08e61928139cc9efa6" returned: 0 in 0.237s {{(pid=88568) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:13:09 devstack cinder-volume[88568]: DEBUG cinder.manager [None req-4350bbd3-adad-457e-8a5d-a006350bb3e0 tempest-SnapshotDependencyTests-1220441869 None] Notifying Schedulers of capabilities ... {{(pid=88568) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:13:09 devstack cinder-volume[88568]: INFO cinder.volume.manager [None req-4350bbd3-adad-457e-8a5d-a006350bb3e0 tempest-SnapshotDependencyTests-1220441869 None] Deleted volume successfully. Jul 30 17:13:09 devstack cinder-volume[88568]: DEBUG cinder.coordination [None req-4350bbd3-adad-457e-8a5d-a006350bb3e0 tempest-SnapshotDependencyTests-1220441869 None] Lock "cinder-7e8a5cbc-5f11-4b02-931b-9e26966e6d0b-delete_volume" released by "delete_volume" :: held 1.077s {{(pid=88568) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:13:19 devstack cinder-volume[88568]: DEBUG dbcounter [-] [88568] Writing DB stats cinder:SELECT=29,cinder:INSERT=5,cinder:UPDATE=26,cinder:DELETE=3 {{(pid=88568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 17:13:19 devstack cinder-volume[88568]: DEBUG dbcounter [-] [88568] Writing DB stats cinder:UPDATE=33,cinder:SELECT=21,cinder:DELETE=2,cinder:INSERT=10 {{(pid=88568) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}